PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2026-03-30 15:18:07 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:18:07 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:18:07 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:18:07 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:18:07 [auto_selling_autotrader.co.uk] INFO: _job: 4afb021a2c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:18:07 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:18:07 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:18:07 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:18:07 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:18:07 [scrapy.extensions.telnet] INFO: Telnet Password: 8b45b2eb702ada16
2026-03-30 15:18:07 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:18:07 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4afb021a2c1f11f18e133aacc95538c6.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 15:18:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:18:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:18:07 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:18:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:18:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:18:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:18:07 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:18:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:18:07 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:18:07 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:18:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:18:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-30 15:18:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 15:18:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:18:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:18:12 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 584354 and multipost_profile_id: f07cd8fd-037e-4c81-93b1-c0f93096a212 and job_id: 4afb021a2c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/dealers/chans-cars-ltd-584354
2026-03-30 15:18:12 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 584354, page: 1
2026-03-30 15:18:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:18:13 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:18:13 [auto_selling_autotrader.co.uk] INFO: Page: 1/2, total results: 23
2026-03-30 15:18:13 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 15:18:14 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603251011341%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603251011341: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603251009959%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603251009959: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200881626%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200881626: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090546706%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090546706: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603080512358%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603080512358: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050447194%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050447194: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050437257%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050437257: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270271250%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270271250: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270268775%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270268775: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260251124%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260251124: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602210105044%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602210105044: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200099405%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200099405: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200070106%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200070106: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190069566%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190069566: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119859543%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602119859543: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099779384%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602099779384: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079761897%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602079761897: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289500817%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289500817: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601179229665%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601179229665: 1
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601048918383%27 HTTP/1.1" 200 None
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601048918383: 1
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-30 15:18:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-30 15:18:14 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 584354, page: 2
2026-03-30 15:18:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:18:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:18:15 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:18:15 [auto_selling_autotrader.co.uk] INFO: Page: 2/2, total results: 23
2026-03-30 15:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512208733202%27 HTTP/1.1" 200 None
2026-03-30 15:18:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512208733202: 1
2026-03-30 15:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258136021%27 HTTP/1.1" 200 None
2026-03-30 15:18:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511258136021: 1
2026-03-30 15:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510217323078%27 HTTP/1.1" 200 None
2026-03-30 15:18:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510217323078: 1
2026-03-30 15:18:15 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 3 detail requests (batch 1)
2026-03-30 15:18:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:18:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:18:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c577a3b-c747-5a37-9c6b-77be4fe4176c with identifier: 202603251011341
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c577a3b-c747-5a37-9c6b-77be4fe4176c
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F542d8e7ef1c44fa8879b753b64f49d00.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/542d8e7ef1c44fa8879b753b64f49d00.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F61d4f5c7f2134a33878d4d1eddec50a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/61d4f5c7f2134a33878d4d1eddec50a7.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F67b93e99de70463ca9b479fba572d195.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/67b93e99de70463ca9b479fba572d195.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa40fa7112fa9419c9603b31da293d1b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a40fa7112fa9419c9603b31da293d1b9.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa46e54f15eb44ddd875165b095032a18.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a46e54f15eb44ddd875165b095032a18.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8378b4698e1d46f59347b5486931e03f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8378b4698e1d46f59347b5486931e03f.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5f711548e7d47afbfe09472b3555972.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5f711548e7d47afbfe09472b3555972.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0fcda9ff3e9847ccac89ddcb178f0222.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0fcda9ff3e9847ccac89ddcb178f0222.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd3d570c814ba423da51adc2b039c817f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d3d570c814ba423da51adc2b039c817f.jpg already downloaded
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b13391e0aa447a39704d26d77ecae0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b13391e0aa447a39704d26d77ecae0e.jpg already downloaded
2026-03-30 15:18:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3c577a3b-c747-5a37-9c6b-77be4fe4176c with identifier 202603251011341
2026-03-30 15:18:16 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:18:16 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:18:16 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:18:16 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:18:16 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:18:16 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:18:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:18:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2011
2026-03-30 15:18:17 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883897
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883897
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:18:17 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3c577a3b-c747-5a37-9c6b-77be4fe4176c
2026-03-30 15:18:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'White',
'currency': 'GBP',
'description': 'chans cars Are delighted To Bring You 2016 Suzuki Vitara 1.6 '
'SZ-T SUV 5dr Petrol Manual ,77282 MILES, 2 Previous Owner, '
'Manual, Next MOT due 15/5/2026 ,service history with 7 stamps '
'and last serviced at on 24-3-2026, Car play, Phone Blue '
'Tooth, Reverse Camera ,Sat-Nav, Air con, CD Player, mp3, '
'AUX, Remote central locking , Isofix, immobiliser system, '
'Alarm, 5 seats ,',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 118,
'fuel_type': 'Petrol',
'id': '3c577a3b-c747-5a37-9c6b-77be4fe4176c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603251011341',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 77282,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/542d8e7ef1c44fa8879b753b64f49d00.jpg',
'https://m.atcdn.co.uk/a/media/61d4f5c7f2134a33878d4d1eddec50a7.jpg',
'https://m.atcdn.co.uk/a/media/67b93e99de70463ca9b479fba572d195.jpg',
'https://m.atcdn.co.uk/a/media/a40fa7112fa9419c9603b31da293d1b9.jpg',
'https://m.atcdn.co.uk/a/media/a46e54f15eb44ddd875165b095032a18.jpg',
'https://m.atcdn.co.uk/a/media/8378b4698e1d46f59347b5486931e03f.jpg',
'https://m.atcdn.co.uk/a/media/c5f711548e7d47afbfe09472b3555972.jpg',
'https://m.atcdn.co.uk/a/media/0fcda9ff3e9847ccac89ddcb178f0222.jpg',
'https://m.atcdn.co.uk/a/media/d3d570c814ba423da51adc2b039c817f.jpg',
'https://m.atcdn.co.uk/a/media/2b13391e0aa447a39704d26d77ecae0e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320844,
'Height': 1362,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/542d8e7ef1c44fa8879b753b64f49d00.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378696,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/61d4f5c7f2134a33878d4d1eddec50a7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244631,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/67b93e99de70463ca9b479fba572d195.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348755,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a40fa7112fa9419c9603b31da293d1b9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437196,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a46e54f15eb44ddd875165b095032a18.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485051,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8378b4698e1d46f59347b5486931e03f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429440,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c5f711548e7d47afbfe09472b3555972.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407865,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0fcda9ff3e9847ccac89ddcb178f0222.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324070,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d3d570c814ba423da51adc2b039c817f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c577a3b-c747-5a37-9c6b-77be4fe4176c/3c577a3b-c747-5a37-9c6b-77be4fe4176c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302297,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b13391e0aa447a39704d26d77ecae0e.jpg',
'Width': 2048}],
'price': 7350,
'price_includes_vat': True,
'registration_date': '2016-10-21',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Vitara 1.6 SZ-T Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SZ-T',
'year': 2016}
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603251011341%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603251011341: {'created_time': 1774883897.263025, 'last_price_update_time': 1774883897.263037}
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603251011341') HTTP/1.1" 204 0
2026-03-30 15:18:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e03b4ed-7f34-5097-865c-1cd308d81e7d with identifier: 202603251009959
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e03b4ed-7f34-5097-865c-1cd308d81e7d
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3365c50d93ac47d193fcd159da734dbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3365c50d93ac47d193fcd159da734dbb.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feabccfa25fc34276b62cca6da8b6a080.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eabccfa25fc34276b62cca6da8b6a080.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb218cd4869d04fb9827c7fd0111afe44.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b218cd4869d04fb9827c7fd0111afe44.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe292065d9e3a4cd580f1964a3df4791f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e292065d9e3a4cd580f1964a3df4791f.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5a9cde7af5f84306afc02e436baa4562.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5a9cde7af5f84306afc02e436baa4562.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd52ea7973fde432b9ff37c808fae9df8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d52ea7973fde432b9ff37c808fae9df8.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36e16ae5aad64c4886849753e2ecbf3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36e16ae5aad64c4886849753e2ecbf3e.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F42065c53e9b942709f66489c805644a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/42065c53e9b942709f66489c805644a5.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fada69b29d1e6490eab320d717556e996.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ada69b29d1e6490eab320d717556e996.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ea8875f36964a4490aef7b32b0dec8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ea8875f36964a4490aef7b32b0dec8a.jpg already downloaded
2026-03-30 15:18:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7e03b4ed-7f34-5097-865c-1cd308d81e7d with identifier 202603251009959
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7e03b4ed-7f34-5097-865c-1cd308d81e7d
2026-03-30 15:18:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'White',
'currency': 'GBP',
'description': 'chans cars Cars Are Proud To offer You 2021 Mazda CX-5 2.0 '
'SKYACTIV-G SE-L SUV 5dr Petrol Manual Euro 6 (s/s) (165 ps) '
'Petrol Manual 40060 Miles , MOT--01/09/2026,1 Owner From new, '
'Car apple Play, Service history, Auto light and Wiper, Cruise '
'Control, Bluetooth, Digital Dual Zone, Climate Control, Front '
'and Rear Parking Sensors ,Digital Display, L.E.D Daytime '
'Running Lights, Stop /Start Technology, Bose Speakers, DAB '
'Radio, Air Con , Seat Height Adjustment, Immobilizer ,Climate '
'Control, Enjoy low interest rates',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 163,
'fuel_type': 'Petrol',
'id': '7e03b4ed-7f34-5097-865c-1cd308d81e7d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603251009959',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 40060,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 61,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3365c50d93ac47d193fcd159da734dbb.jpg',
'https://m.atcdn.co.uk/a/media/eabccfa25fc34276b62cca6da8b6a080.jpg',
'https://m.atcdn.co.uk/a/media/b218cd4869d04fb9827c7fd0111afe44.jpg',
'https://m.atcdn.co.uk/a/media/e292065d9e3a4cd580f1964a3df4791f.jpg',
'https://m.atcdn.co.uk/a/media/5a9cde7af5f84306afc02e436baa4562.jpg',
'https://m.atcdn.co.uk/a/media/d52ea7973fde432b9ff37c808fae9df8.jpg',
'https://m.atcdn.co.uk/a/media/36e16ae5aad64c4886849753e2ecbf3e.jpg',
'https://m.atcdn.co.uk/a/media/42065c53e9b942709f66489c805644a5.jpg',
'https://m.atcdn.co.uk/a/media/ada69b29d1e6490eab320d717556e996.jpg',
'https://m.atcdn.co.uk/a/media/2ea8875f36964a4490aef7b32b0dec8a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179748,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3365c50d93ac47d193fcd159da734dbb.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407600,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eabccfa25fc34276b62cca6da8b6a080.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294717,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b218cd4869d04fb9827c7fd0111afe44.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290201,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e292065d9e3a4cd580f1964a3df4791f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418003,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5a9cde7af5f84306afc02e436baa4562.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396184,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d52ea7973fde432b9ff37c808fae9df8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334638,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/36e16ae5aad64c4886849753e2ecbf3e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248948,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/42065c53e9b942709f66489c805644a5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231646,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ada69b29d1e6490eab320d717556e996.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e03b4ed-7f34-5097-865c-1cd308d81e7d/7e03b4ed-7f34-5097-865c-1cd308d81e7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446412,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ea8875f36964a4490aef7b32b0dec8a.jpg',
'Width': 2048}],
'price': 15195,
'price_includes_vat': True,
'registration_date': '2021-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-5 2.0 SKYACTIV-G SE-L Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE-L',
'year': 2021}
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603251009959%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603251009959: {'created_time': 1774883897.604384, 'last_price_update_time': 1774883897.604395}
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603251009959') HTTP/1.1" 204 0
2026-03-30 15:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:18:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1 with identifier: 202603200881626
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec28a5233867467f9e42132c07916f23.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec28a5233867467f9e42132c07916f23.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4b38855f4864113a48eeae83688647d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4b38855f4864113a48eeae83688647d.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e291e731e8f4272ad3891cc84e4cd67.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e291e731e8f4272ad3891cc84e4cd67.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd869cba749d14ba48dfd36b3a5910bb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d869cba749d14ba48dfd36b3a5910bb3.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff8b32345b99f4558997fa4b7eaab511d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f8b32345b99f4558997fa4b7eaab511d.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb069d6dd27074d7ca5efd8075c6abd2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b069d6dd27074d7ca5efd8075c6abd2b.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F530d0d93de6d4d04ab2c4ec6e0a644eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/530d0d93de6d4d04ab2c4ec6e0a644eb.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7bb4b9d9a93a41c4a9beb863373c8eaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7bb4b9d9a93a41c4a9beb863373c8eaa.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3dd66add1e1548db8a0c049b1ad4299b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3dd66add1e1548db8a0c049b1ad4299b.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1a81118363f146f08167a10c216d36b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1a81118363f146f08167a10c216d36b6.jpg already downloaded
2026-03-30 15:18:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1 with identifier 202603200881626
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1
2026-03-30 15:18:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'Blue',
'currency': 'GBP',
'description': '2019 Mazda2 1.5 SKYACTIV-G SE-L Nav+ Hatchback 5dr Petrol '
'Manual ,1 Previous Owner ,64936 MILES, MOT--21/03/27, Service '
'History ,SAT-NAV ,Rear Parking Sensors, Phone Bluetooth, '
'Apple car Play and Android Auto Air - Conditioning, Dual - '
'Zone Climate Control ,Cruise Control with Manual Speed '
'Adjustment ,AM/FM Radio/Single CD/ MP3 Audio Engine '
'Start/Stop Button, Hill Hold Assist , Front Rain - Sensing , '
'Isofix,',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': '420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200881626',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Mazda',
'model': 'Mazda2',
'odometer': 64936,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ec28a5233867467f9e42132c07916f23.jpg',
'https://m.atcdn.co.uk/a/media/f4b38855f4864113a48eeae83688647d.jpg',
'https://m.atcdn.co.uk/a/media/2e291e731e8f4272ad3891cc84e4cd67.jpg',
'https://m.atcdn.co.uk/a/media/d869cba749d14ba48dfd36b3a5910bb3.jpg',
'https://m.atcdn.co.uk/a/media/f8b32345b99f4558997fa4b7eaab511d.jpg',
'https://m.atcdn.co.uk/a/media/b069d6dd27074d7ca5efd8075c6abd2b.jpg',
'https://m.atcdn.co.uk/a/media/530d0d93de6d4d04ab2c4ec6e0a644eb.jpg',
'https://m.atcdn.co.uk/a/media/7bb4b9d9a93a41c4a9beb863373c8eaa.jpg',
'https://m.atcdn.co.uk/a/media/3dd66add1e1548db8a0c049b1ad4299b.jpg',
'https://m.atcdn.co.uk/a/media/1a81118363f146f08167a10c216d36b6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480914,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec28a5233867467f9e42132c07916f23.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551071,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4b38855f4864113a48eeae83688647d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304721,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e291e731e8f4272ad3891cc84e4cd67.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505559,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d869cba749d14ba48dfd36b3a5910bb3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514005,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f8b32345b99f4558997fa4b7eaab511d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554404,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b069d6dd27074d7ca5efd8075c6abd2b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345028,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/530d0d93de6d4d04ab2c4ec6e0a644eb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466988,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7bb4b9d9a93a41c4a9beb863373c8eaa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552827,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3dd66add1e1548db8a0c049b1ad4299b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1/420bf40c-88d1-5d4f-bc5c-607cbfe9b5a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226209,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a81118363f146f08167a10c216d36b6.jpg',
'Width': 2048}],
'price': 7795,
'price_includes_vat': True,
'registration_date': '2019-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda2 1.5 SKYACTIV-G SE-L Nav+ Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE-L Nav+',
'year': 2019}
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200881626%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200881626: {'created_time': 1774883897.83097, 'last_price_update_time': 1774883897.830981}
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200881626') HTTP/1.1" 204 0
2026-03-30 15:18:17 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_engine_horse_power: Unknown power unit: None
Traceback (most recent call last):
File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
return func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 337, in _extract_engine_horse_power
raise ValueError("Unknown power unit: %s" % unit)
ValueError: Unknown power unit: None
2026-03-30 15:18:17 [common.utils.decorators] ERROR: Payload: {"id": "202603090546706", "stockItemId": "8a42c1fe9cc3b02d019cd40484ed0766", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Toyota Estima Aeras 2.4L Petrol 5dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_dealer_partner_adverts", "at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": "2027-02-06T00:00:00Z", "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": "2026-02-06T00:00:00Z", "warrantyMonthsOnPurchase": "3", "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Toyota Estima", "subtitle": "Aeras 2.4L Petrol 5dr", "__typename": "Heading"}, "attentionGrabber": "Reverse Camera, Apple Car Play", "rrp": null, "price": 8995, "priceGBX": 899500, "priceExcludingFees": 8995, "priceExcludingFeesGBX": 899500, "suppliedPrice": 8995, "suppliedPriceGBX": 899500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2012-01-02", "homeDeliveryRegionCodes": ["AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DE", "DN", "DT", "DY", "E", "EC", "EN", "EX", "GL", "GU", "HA", "HD", "HG", "HP", "HR", "HU", "HX", "IG", "IP", "KT", "L", "LD", "LE", "LN", "LS", "LU", "M", "ME", "MK", "N", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PE", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SS", "ST", "SW", "SY", "TA", "TF", "TN", "TQ", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO"], "priceExcludingVat": 8995, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "L****SF", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": false, "isFinanceFullApplicationAvailable": false, "financeProvider": null, "financeDefaults": null, "hasFinanceInformation": false, "retailerId": "584354", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "584354", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 23, "van": null, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": null, "atAwards": [{"year": "2018", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2019", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2020", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2021", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2022", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2023", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2025", "category": "HIGHLY_RATED", "__typename": "ATAward"}], "branding": {"accreditations": [], "brands": [{"name": "AA Dealer Promise", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/aaDealerPromise.jpg", "__typename": "Brand"}, {"name": "Blue Motor Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/blueMotorFinance.jpg", "__typename": "Brand"}, {"name": "Close Brothers Motor Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/closeMotors.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": null, "instantMessagingText": null, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.8", "__typename": "Reviews"}, "location": {"addressOne": "29A OLDFIELDS ROAD", "addressTwo": null, "town": "Sutton", "county": "Surrey", "postcode": "SM1 2NB", "latLong": "51.373205,-0.206622", "__typename": "Location"}, "marketing": {"profile": null, "strapline": "AA BREAK DOWN /\u00a375 Admin applies to All cars/ 3 Months standard Warranty extended up to 2 years.", "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.chanscars.co.uk/", "__typename": "Link"}, "phoneNumber1": "(07537) 122073", "phoneNumber2": null, "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Chans Cars Ltd", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DEAL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WASV", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": ["View the vehicle from your home"], "paragraphs": null, "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": true, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": {"url": "https://youtube.com/embed/su_1QatrIKc?autoplay=1&rel=0", "preview": null, "__typename": "AdvertVideo"}, "spin": null, "imageList": {"nextCursor": null, "size": 50, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/0e3f63e5f7b54218a74e0674a37f22d1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/303ae8b27b4e44f88763406fb64b525b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/11b4192f8ae14726ace3977443aa733b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/78f14b72908740599b88c9e8bfd21f25.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/535fa44a86ad4a8ab9905711f8d7bab4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/79859db3e98c446995ce1c0bdf3159ad.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9186de90921b49f995dc8240627e9bd8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3a77ba0a90ab454b80f7e8af436ff1c7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1609e0a48d3f48739b24fb00c35329d8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/62b879fac2854a1bae60a26dc21d368f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3d934395d98043b1845de591b141f085.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8db7dd94066348bead7be84a5eed69cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/763435417ecd4bfb9bac0e455a07c2ff.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/024684f2e6cd4b9b8a5eda7231793dbe.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/38508aeac4ba4bfb8b4025890e4f7b00.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/185a02ee86ba4b3888c9ab422c8c0323.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/deb9b23f365a4416ae7f854a3f852356.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cb20179fd61044f99090e5c581e33844.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/284494ed587643c896a0f9437b6e1893.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/052e95cd1d7747ca8efcdddef6215967.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e2dbf9435e104756887fc9fd467b82ae.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/58a636a10a7b46339adc7c9905cf17a3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5bf6dbe0934f460688ad3c22f8067902.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/42dbd585b74b43439b0e576266fc804f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/669f5c8cc7784235b840914a003a3057.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9485d175222c4feaa76302066b615ea9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c704092d42a94431b69f1f60cab32a98.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c1b627a2f3c043beb2b75baac365ab35.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9bc2b3dd226440dc96e59169ac279181.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ae4f4d3f57304e3b800ef630156e6706.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1ec6cc9b765442b6a5ca441334c97979.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/39def3baf9254b7b961cb16dc773c7c4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e08f511d5444418bb8e5141418c36209.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ef5eae06160843789b59c2c2bbcf358a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9f5f2f7ac7a040acb7a383a5fc3700c1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/49d42786000b4553bb3eb50ee60dd0c1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Roof", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/90f2ac9475634e96a4b8b51f38f4ce0d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1c36297825d144a2b4229b674594b76f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a56bff983248466a9b7d1c9bf98bd85a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/36198290124f43dba3b4cdf0cd48cf4b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8d327a70f76747d19c958e2a25998163.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2d5b2f833e4d4527b1df9a88553fd042.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f000758b6345433bb33d5c58a1d568ef.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b5b8b25133614560b2b71f2b117e4157.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c6749035b36146f781937ed230ab5f8f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/08acc4991f2249e5b88861b626e632f0.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e1bf3b2e57854396accb41a07701e25d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Driver Instruments", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fe20c4bdfd774508a06ad0d1aa9f659e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wing Mirror", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8a6371048e3a40149de3bc65c4b651f4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4bbac0698401413f824b7e8d4b74539e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 70184, "unit": "MILE", "__typename": "Mileage"}, "plate": "61", "year": 2012, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "Chans Cars Ltd", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DEAL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WASV", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "SUTTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07537) 122073", "phoneNumberTwo": null, "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "2012 Toyota Estima 2.4 Hybrid Aeras Automatic 70184 Miles ,MOT---06/02/2027 Multi Function Power Steering, Remote Central Locking , 4 X Electric Windows, Electric Folding Mirrors, Both Rear Electric Sliding Doors, Captain Seats, Cruise Control, Climate Control, Air-Conditioning, Reverse Camera, Apple Car Play, Extremely Spacious and Comfortable Interior, Alloy Wheels, Good Tyres, Service Been Done Recently, Vehicle is in Excellent Condition Inside and Out, Smooth to Drive. ULEZ Compliance. VERIFIED MILEAGE, FIRST TO SEE WILL BUY WITH CONFIDENCE", "colour": "Grey", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 0, "keys": null, "vehicleCondition": {"tyreCondition": 85, "interiorCondition": 85, "bodyCondition": 85, "__typename": "VehicleCondition"}, "specification": {"driverPosition": "RHD", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": null, "sizeCC": null, "manufacturerEngineSize": null, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 7, "axleConfig": null, "ulezCompliant": false, "doors": 5, "bodyType": "Estate", "cabType": "Unlisted", "rawBodyType": "Estate", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Toyota", "model": "Estima", "trim": null, "optionalFeatures": null, "standardFeatures": [{"description": "Airbags", "category": "Standard", "__typename": "Feature"}, {"description": "Air conditioning", "category": "Standard", "__typename": "Feature"}, {"description": "Alloy wheels", "category": "Standard", "__typename": "Feature"}, {"description": "Central locking", "category": "Standard", "__typename": "Feature"}, {"description": "Cruise control", "category": "Standard", "__typename": "Feature"}, {"description": "Electric windows", "category": "Standard", "__typename": "Feature"}, {"description": "Folding rear seats", "category": "Standard", "__typename": "Feature"}, {"description": "Immobiliser", "category": "Standard", "__typename": "Feature"}, {"description": "Leather seats", "category": "Standard", "__typename": "Feature"}, {"description": "Lumbar support", "category": "Standard", "__typename": "Feature"}, {"description": "Power steering", "category": "Standard", "__typename": "Feature"}, {"description": "Parking aid", "category": "Standard", "__typename": "Feature"}, {"description": "Remote central locking", "category": "Standard", "__typename": "Feature"}, {"description": "Satellite navigation", "category": "Standard", "__typename": "Feature"}, {"description": "Sunroof", "category": "Standard", "__typename": "Feature"}, {"description": "Traction control", "category": "Standard", "__typename": "Feature"}], "features": [{"category": "Exterior", "features": [{"description": "Grey exterior colour", "type": "Standard", "__typename": "Feature"}], "__typename": "Features"}, {"category": "Interior", "features": [{"description": "Grey full leather interior", "type": "Standard", "__typename": "Feature"}], "__typename": "Features"}, {"category": "Other", "features": [{"description": "Airbags", "type": "Standard", "__typename": "Feature"}, {"description": "Air conditioning", "type": "Standard", "__typename": "Feature"}, {"description": "Alloy wheels", "type": "Standard", "__typename": "Feature"}, {"description": "Central locking", "type": "Standard", "__typename": "Feature"}, {"description": "Cruise control", "type": "Standard", "__typename": "Feature"}, {"description": "Electric windows", "type": "Standard", "__typename": "Feature"}, {"description": "Folding rear seats", "type": "Standard", "__typename": "Feature"}, {"description": "Immobiliser", "type": "Standard", "__typename": "Feature"}, {"description": "Leather seats", "type": "Standard", "__typename": "Feature"}, {"description": "Lumbar support", "type": "Standard", "__typename": "Feature"}, {"description": "Power steering", "type": "Standard", "__typename": "Feature"}, {"description": "Parking aid", "type": "Standard", "__typename": "Feature"}, {"description": "Remote central locking", "type": "Standard", "__typename": "Feature"}, {"description": "Satellite navigation", "type": "Standard", "__typename": "Feature"}, {"description": "Sunroof", "type": "Standard", "__typename": "Feature"}, {"description": "Traction control", "type": "Standard", "__typename": "Feature"}], "__typename": "Features"}], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": "Grey full leather interior", "exteriorDescription": "Grey exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "NOT_ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 0, "__typename": "AdvertReservation"}, "__typename": "Advert"}
2026-03-30 15:18:17 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_co2_emission_value: 'NoneType' object is not subscriptable
Traceback (most recent call last):
File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
return func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 390, in _extract_co2_emission_value
return data["specification"]["co2Emissions"]["co2Emission"]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable
2026-03-30 15:18:17 [common.utils.decorators] ERROR: Payload: {"id": "202603090546706", "stockItemId": "8a42c1fe9cc3b02d019cd40484ed0766", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Toyota Estima Aeras 2.4L Petrol 5dr", "excludePreviousOwners": false, "advertisedLocations": ["at_cars", "at_dealer_partner_adverts", "at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": "2027-02-06T00:00:00Z", "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": "2026-02-06T00:00:00Z", "warrantyMonthsOnPurchase": "3", "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Toyota Estima", "subtitle": "Aeras 2.4L Petrol 5dr", "__typename": "Heading"}, "attentionGrabber": "Reverse Camera, Apple Car Play", "rrp": null, "price": 8995, "priceGBX": 899500, "priceExcludingFees": 8995, "priceExcludingFeesGBX": 899500, "suppliedPrice": 8995, "suppliedPriceGBX": 899500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2012-01-02", "homeDeliveryRegionCodes": ["AL", "B", "BA", "BB", "BD", "BH", "BL", "BN", "BR", "BS", "CB", "CF", "CH", "CM", "CO", "CR", "CT", "CV", "CW", "DA", "DE", "DN", "DT", "DY", "E", "EC", "EN", "EX", "GL", "GU", "HA", "HD", "HG", "HP", "HR", "HU", "HX", "IG", "IP", "KT", "L", "LD", "LE", "LN", "LS", "LU", "M", "ME", "MK", "N", "NG", "NN", "NP", "NR", "NW", "OL", "OX", "PE", "PL", "PO", "PR", "RG", "RH", "RM", "S", "SA", "SE", "SG", "SK", "SL", "SM", "SN", "SO", "SP", "SS", "ST", "SW", "SY", "TA", "TF", "TN", "TQ", "TW", "UB", "W", "WA", "WC", "WD", "WF", "WN", "WR", "WS", "WV", "YO"], "priceExcludingVat": 8995, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": false, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "L****SF", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": true, "isFinanceAvailable": false, "isFinanceFullApplicationAvailable": false, "financeProvider": null, "financeDefaults": null, "hasFinanceInformation": false, "retailerId": "584354", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "584354", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 23, "van": null, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": null, "atAwards": [{"year": "2018", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2019", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2020", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2021", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2022", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2023", "category": "HIGHLY_RATED", "__typename": "ATAward"}, {"year": "2025", "category": "HIGHLY_RATED", "__typename": "ATAward"}], "branding": {"accreditations": [], "brands": [{"name": "AA Dealer Promise", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/aaDealerPromise.jpg", "__typename": "Brand"}, {"name": "Blue Motor Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/blueMotorFinance.jpg", "__typename": "Brand"}, {"name": "Close Brothers Motor Finance", "imageUrl": "https://m.atcdn.co.uk/service-partner-logo/closeMotors.jpg", "__typename": "Brand"}], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": null, "instantMessagingText": null, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.8", "__typename": "Reviews"}, "location": {"addressOne": "29A OLDFIELDS ROAD", "addressTwo": null, "town": "Sutton", "county": "Surrey", "postcode": "SM1 2NB", "latLong": "51.373205,-0.206622", "__typename": "Location"}, "marketing": {"profile": null, "strapline": "AA BREAK DOWN /\u00a375 Admin applies to All cars/ 3 Months standard Warranty extended up to 2 years.", "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.chanscars.co.uk/", "__typename": "Link"}, "phoneNumber1": "(07537) 122073", "phoneNumber2": null, "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Chans Cars Ltd", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DEAL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WASV", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": {"bulletPoints": ["View the vehicle from your home"], "paragraphs": null, "__typename": "ServiceOffered"}, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": true, "hasVideoWalkAround": true, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": {"url": "https://youtube.com/embed/su_1QatrIKc?autoplay=1&rel=0", "preview": null, "__typename": "AdvertVideo"}, "spin": null, "imageList": {"nextCursor": null, "size": 50, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/0e3f63e5f7b54218a74e0674a37f22d1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/303ae8b27b4e44f88763406fb64b525b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/11b4192f8ae14726ace3977443aa733b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/78f14b72908740599b88c9e8bfd21f25.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/535fa44a86ad4a8ab9905711f8d7bab4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/79859db3e98c446995ce1c0bdf3159ad.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9186de90921b49f995dc8240627e9bd8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3a77ba0a90ab454b80f7e8af436ff1c7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1609e0a48d3f48739b24fb00c35329d8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/62b879fac2854a1bae60a26dc21d368f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/3d934395d98043b1845de591b141f085.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8db7dd94066348bead7be84a5eed69cf.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/763435417ecd4bfb9bac0e455a07c2ff.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/024684f2e6cd4b9b8a5eda7231793dbe.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/38508aeac4ba4bfb8b4025890e4f7b00.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/185a02ee86ba4b3888c9ab422c8c0323.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/deb9b23f365a4416ae7f854a3f852356.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cb20179fd61044f99090e5c581e33844.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/284494ed587643c896a0f9437b6e1893.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/052e95cd1d7747ca8efcdddef6215967.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e2dbf9435e104756887fc9fd467b82ae.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/58a636a10a7b46339adc7c9905cf17a3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/5bf6dbe0934f460688ad3c22f8067902.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/42dbd585b74b43439b0e576266fc804f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/669f5c8cc7784235b840914a003a3057.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9485d175222c4feaa76302066b615ea9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c704092d42a94431b69f1f60cab32a98.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c1b627a2f3c043beb2b75baac365ab35.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9bc2b3dd226440dc96e59169ac279181.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ae4f4d3f57304e3b800ef630156e6706.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1ec6cc9b765442b6a5ca441334c97979.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/39def3baf9254b7b961cb16dc773c7c4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e08f511d5444418bb8e5141418c36209.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/ef5eae06160843789b59c2c2bbcf358a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9f5f2f7ac7a040acb7a383a5fc3700c1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/49d42786000b4553bb3eb50ee60dd0c1.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Roof", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/90f2ac9475634e96a4b8b51f38f4ce0d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1c36297825d144a2b4229b674594b76f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/a56bff983248466a9b7d1c9bf98bd85a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/36198290124f43dba3b4cdf0cd48cf4b.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8d327a70f76747d19c958e2a25998163.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2d5b2f833e4d4527b1df9a88553fd042.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f000758b6345433bb33d5c58a1d568ef.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b5b8b25133614560b2b71f2b117e4157.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c6749035b36146f781937ed230ab5f8f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/08acc4991f2249e5b88861b626e632f0.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/e1bf3b2e57854396accb41a07701e25d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Driver Instruments", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fe20c4bdfd774508a06ad0d1aa9f659e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wing Mirror", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8a6371048e3a40149de3bc65c4b651f4.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Lights Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/4bbac0698401413f824b7e8d4b74539e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 70184, "unit": "MILE", "__typename": "Mileage"}, "plate": "61", "year": 2012, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "Chans Cars Ltd", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CODRIVER", "DEAL", "DVID", "FCS", "FPBARGAIN", "FPBONUS", "FPS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WASV", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "SUTTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(07537) 122073", "phoneNumberTwo": null, "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "2012 Toyota Estima 2.4 Hybrid Aeras Automatic 70184 Miles ,MOT---06/02/2027 Multi Function Power Steering, Remote Central Locking , 4 X Electric Windows, Electric Folding Mirrors, Both Rear Electric Sliding Doors, Captain Seats, Cruise Control, Climate Control, Air-Conditioning, Reverse Camera, Apple Car Play, Extremely Spacious and Comfortable Interior, Alloy Wheels, Good Tyres, Service Been Done Recently, Vehicle is in Excellent Condition Inside and Out, Smooth to Drive. ULEZ Compliance. VERIFIED MILEAGE, FIRST TO SEE WILL BUY WITH CONFIDENCE", "colour": "Grey", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 0, "keys": null, "vehicleCondition": {"tyreCondition": 85, "interiorCondition": 85, "bodyCondition": 85, "__typename": "VehicleCondition"}, "specification": {"driverPosition": "RHD", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": null, "sizeCC": null, "manufacturerEngineSize": null, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 7, "axleConfig": null, "ulezCompliant": false, "doors": 5, "bodyType": "Estate", "cabType": "Unlisted", "rawBodyType": "Estate", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Toyota", "model": "Estima", "trim": null, "optionalFeatures": null, "standardFeatures": [{"description": "Airbags", "category": "Standard", "__typename": "Feature"}, {"description": "Air conditioning", "category": "Standard", "__typename": "Feature"}, {"description": "Alloy wheels", "category": "Standard", "__typename": "Feature"}, {"description": "Central locking", "category": "Standard", "__typename": "Feature"}, {"description": "Cruise control", "category": "Standard", "__typename": "Feature"}, {"description": "Electric windows", "category": "Standard", "__typename": "Feature"}, {"description": "Folding rear seats", "category": "Standard", "__typename": "Feature"}, {"description": "Immobiliser", "category": "Standard", "__typename": "Feature"}, {"description": "Leather seats", "category": "Standard", "__typename": "Feature"}, {"description": "Lumbar support", "category": "Standard", "__typename": "Feature"}, {"description": "Power steering", "category": "Standard", "__typename": "Feature"}, {"description": "Parking aid", "category": "Standard", "__typename": "Feature"}, {"description": "Remote central locking", "category": "Standard", "__typename": "Feature"}, {"description": "Satellite navigation", "category": "Standard", "__typename": "Feature"}, {"description": "Sunroof", "category": "Standard", "__typename": "Feature"}, {"description": "Traction control", "category": "Standard", "__typename": "Feature"}], "features": [{"category": "Exterior", "features": [{"description": "Grey exterior colour", "type": "Standard", "__typename": "Feature"}], "__typename": "Features"}, {"category": "Interior", "features": [{"description": "Grey full leather interior", "type": "Standard", "__typename": "Feature"}], "__typename": "Features"}, {"category": "Other", "features": [{"description": "Airbags", "type": "Standard", "__typename": "Feature"}, {"description": "Air conditioning", "type": "Standard", "__typename": "Feature"}, {"description": "Alloy wheels", "type": "Standard", "__typename": "Feature"}, {"description": "Central locking", "type": "Standard", "__typename": "Feature"}, {"description": "Cruise control", "type": "Standard", "__typename": "Feature"}, {"description": "Electric windows", "type": "Standard", "__typename": "Feature"}, {"description": "Folding rear seats", "type": "Standard", "__typename": "Feature"}, {"description": "Immobiliser", "type": "Standard", "__typename": "Feature"}, {"description": "Leather seats", "type": "Standard", "__typename": "Feature"}, {"description": "Lumbar support", "type": "Standard", "__typename": "Feature"}, {"description": "Power steering", "type": "Standard", "__typename": "Feature"}, {"description": "Parking aid", "type": "Standard", "__typename": "Feature"}, {"description": "Remote central locking", "type": "Standard", "__typename": "Feature"}, {"description": "Satellite navigation", "type": "Standard", "__typename": "Feature"}, {"description": "Sunroof", "type": "Standard", "__typename": "Feature"}, {"description": "Traction control", "type": "Standard", "__typename": "Feature"}], "__typename": "Features"}], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": "Grey full leather interior", "exteriorDescription": "Grey exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "NOT_ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 0, "__typename": "AdvertReservation"}, "__typename": "Advert"}
2026-03-30 15:18:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e8068a0-a153-5221-aa71-abe9cb8e63ae with identifier: 202603090546706
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e8068a0-a153-5221-aa71-abe9cb8e63ae
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e3f63e5f7b54218a74e0674a37f22d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e3f63e5f7b54218a74e0674a37f22d1.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F303ae8b27b4e44f88763406fb64b525b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/303ae8b27b4e44f88763406fb64b525b.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11b4192f8ae14726ace3977443aa733b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11b4192f8ae14726ace3977443aa733b.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78f14b72908740599b88c9e8bfd21f25.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78f14b72908740599b88c9e8bfd21f25.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F535fa44a86ad4a8ab9905711f8d7bab4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/535fa44a86ad4a8ab9905711f8d7bab4.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79859db3e98c446995ce1c0bdf3159ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79859db3e98c446995ce1c0bdf3159ad.jpg already downloaded
2026-03-30 15:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9186de90921b49f995dc8240627e9bd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9186de90921b49f995dc8240627e9bd8.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a77ba0a90ab454b80f7e8af436ff1c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a77ba0a90ab454b80f7e8af436ff1c7.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1609e0a48d3f48739b24fb00c35329d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1609e0a48d3f48739b24fb00c35329d8.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62b879fac2854a1bae60a26dc21d368f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62b879fac2854a1bae60a26dc21d368f.jpg already downloaded
2026-03-30 15:18:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7e8068a0-a153-5221-aa71-abe9cb8e63ae with identifier 202603090546706
2026-03-30 15:18:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7e8068a0-a153-5221-aa71-abe9cb8e63ae
2026-03-30 15:18:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'color': 'Grey',
'currency': 'GBP',
'description': '2012 Toyota Estima 2.4 Hybrid Aeras Automatic 70184 Miles '
',MOT---06/02/2027 Multi Function Power Steering, Remote '
'Central Locking , 4 X Electric Windows, Electric Folding '
'Mirrors, Both Rear Electric Sliding Doors, Captain Seats, '
'Cruise Control, Climate Control, Air-Conditioning, Reverse '
'Camera, Apple Car Play, Extremely Spacious and Comfortable '
'Interior, Alloy Wheels, Good Tyres, Service Been Done '
'Recently, Vehicle is in Excellent Condition Inside and Out, '
'Smooth to Drive. ULEZ Compliance. VERIFIED MILEAGE, FIRST TO '
'SEE WILL BUY WITH CONFIDENCE',
'doors_number': 5,
'fuel_type': 'Petrol',
'id': '7e8068a0-a153-5221-aa71-abe9cb8e63ae',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090546706',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Toyota',
'model': 'Estima',
'odometer': 70184,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0e3f63e5f7b54218a74e0674a37f22d1.jpg',
'https://m.atcdn.co.uk/a/media/303ae8b27b4e44f88763406fb64b525b.jpg',
'https://m.atcdn.co.uk/a/media/11b4192f8ae14726ace3977443aa733b.jpg',
'https://m.atcdn.co.uk/a/media/78f14b72908740599b88c9e8bfd21f25.jpg',
'https://m.atcdn.co.uk/a/media/535fa44a86ad4a8ab9905711f8d7bab4.jpg',
'https://m.atcdn.co.uk/a/media/79859db3e98c446995ce1c0bdf3159ad.jpg',
'https://m.atcdn.co.uk/a/media/9186de90921b49f995dc8240627e9bd8.jpg',
'https://m.atcdn.co.uk/a/media/3a77ba0a90ab454b80f7e8af436ff1c7.jpg',
'https://m.atcdn.co.uk/a/media/1609e0a48d3f48739b24fb00c35329d8.jpg',
'https://m.atcdn.co.uk/a/media/62b879fac2854a1bae60a26dc21d368f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424680,
'Height': 1362,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0e3f63e5f7b54218a74e0674a37f22d1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458149,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/303ae8b27b4e44f88763406fb64b525b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348815,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/11b4192f8ae14726ace3977443aa733b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337199,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/78f14b72908740599b88c9e8bfd21f25.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389536,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/535fa44a86ad4a8ab9905711f8d7bab4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436699,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79859db3e98c446995ce1c0bdf3159ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467885,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9186de90921b49f995dc8240627e9bd8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387304,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3a77ba0a90ab454b80f7e8af436ff1c7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493623,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1609e0a48d3f48739b24fb00c35329d8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e8068a0-a153-5221-aa71-abe9cb8e63ae/7e8068a0-a153-5221-aa71-abe9cb8e63ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281818,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62b879fac2854a1bae60a26dc21d368f.jpg',
'Width': 2048}],
'price': 8995,
'price_includes_vat': True,
'registration_date': '2012-01-02',
'seats_number': 7,
'seller_name': None,
'title': 'Toyota Estima Aeras 2.4L Petrol 5dr',
'transmission': 'automatic',
'year': 2012}
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090546706%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090546706: {'created_time': 1774883898.08979, 'last_price_update_time': 1774883898.089801}
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090546706') HTTP/1.1" 204 0
2026-03-30 15:18:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ad16270-f81a-570e-83d8-5f81f7cdc408 with identifier: 202602210105044
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ad16270-f81a-570e-83d8-5f81f7cdc408
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F15d16848312f48be99a574c2d10712d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/15d16848312f48be99a574c2d10712d8.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F87bd3384a6e0497d9d857d84c2d464b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/87bd3384a6e0497d9d857d84c2d464b6.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30fa92639e614a138e09fbc53d247c8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30fa92639e614a138e09fbc53d247c8c.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79bb3697c98e48109ba0a5727ccec263.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79bb3697c98e48109ba0a5727ccec263.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd5783e282ca14750998377e907753495.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d5783e282ca14750998377e907753495.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fce5fffc943884a8ab7743a82d4879d3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ce5fffc943884a8ab7743a82d4879d3d.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdaabf4f95b07404789117f3aa7dad7c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/daabf4f95b07404789117f3aa7dad7c3.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2df16653e14c4b62b61b5e4dd3244920.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2df16653e14c4b62b61b5e4dd3244920.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30711e2b33f84b6ebcde2a3cc31ec9c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30711e2b33f84b6ebcde2a3cc31ec9c3.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53f22c967be0411f9e47329e51beb19c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53f22c967be0411f9e47329e51beb19c.jpg already downloaded
2026-03-30 15:18:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 71eb2b5c-a217-5c36-b3c0-67859b9868ee with identifier: 202603080512358
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71eb2b5c-a217-5c36-b3c0-67859b9868ee
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F699f962146d9405a9b520c3a62d5a924.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/699f962146d9405a9b520c3a62d5a924.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F716c009691fb4c1e97c5647055d43adc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/716c009691fb4c1e97c5647055d43adc.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4659c0a1ab404d4ebac5de5e2aa83de1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4659c0a1ab404d4ebac5de5e2aa83de1.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c31acb30a374f84815267dbd0f719ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c31acb30a374f84815267dbd0f719ff.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff05f24fffda34a05a7e702b9a80d7d6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f05f24fffda34a05a7e702b9a80d7d6e.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b07e335f8714bbfb2ca3ccd3c5c4912.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b07e335f8714bbfb2ca3ccd3c5c4912.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e78e590c72d469495960fc27fcc0b4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e78e590c72d469495960fc27fcc0b4c.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a767471999545a79e5564f46ce1bc5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a767471999545a79e5564f46ce1bc5b.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F15d4a93cbeff475e83f6d12814ea034b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/15d4a93cbeff475e83f6d12814ea034b.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffcaae7eba9dc410aaa9f92dcfee5bd15.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fcaae7eba9dc410aaa9f92dcfee5bd15.jpg already downloaded
2026-03-30 15:18:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5ad16270-f81a-570e-83d8-5f81f7cdc408 with identifier 202602210105044
2026-03-30 15:18:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5ad16270-f81a-570e-83d8-5f81f7cdc408
2026-03-30 15:18:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'Blue',
'currency': 'GBP',
'description': '2016 Toyota Yaris 1.33 Dual VVT-i Icon Hatchback 5dr Petrol '
'Manual, 68779 Miles,1.3 Petrol, £35 TAX , 2 Previous owner , '
'MOT--20/02/2027 ,Full Service History With 9 stamps , Lcd '
'Touch Screen display, Reverse Camera, AUX-in Socket ,Phone '
'Blue Tooth, Air con ,Power Steering ,Immobiliser, MP3, Isofix '
',USP, Height adjustable drivers seat .',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.33L',
'engine_horse_power': 98,
'fuel_type': 'Petrol',
'id': '5ad16270-f81a-570e-83d8-5f81f7cdc408',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602210105044',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 68779,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photo_urls': ['https://m.atcdn.co.uk/a/media/15d16848312f48be99a574c2d10712d8.jpg',
'https://m.atcdn.co.uk/a/media/87bd3384a6e0497d9d857d84c2d464b6.jpg',
'https://m.atcdn.co.uk/a/media/30fa92639e614a138e09fbc53d247c8c.jpg',
'https://m.atcdn.co.uk/a/media/79bb3697c98e48109ba0a5727ccec263.jpg',
'https://m.atcdn.co.uk/a/media/d5783e282ca14750998377e907753495.jpg',
'https://m.atcdn.co.uk/a/media/ce5fffc943884a8ab7743a82d4879d3d.jpg',
'https://m.atcdn.co.uk/a/media/daabf4f95b07404789117f3aa7dad7c3.jpg',
'https://m.atcdn.co.uk/a/media/2df16653e14c4b62b61b5e4dd3244920.jpg',
'https://m.atcdn.co.uk/a/media/30711e2b33f84b6ebcde2a3cc31ec9c3.jpg',
'https://m.atcdn.co.uk/a/media/53f22c967be0411f9e47329e51beb19c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200912,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/15d16848312f48be99a574c2d10712d8.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458088,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/87bd3384a6e0497d9d857d84c2d464b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327964,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/30fa92639e614a138e09fbc53d247c8c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465660,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79bb3697c98e48109ba0a5727ccec263.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430235,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d5783e282ca14750998377e907753495.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349002,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ce5fffc943884a8ab7743a82d4879d3d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331828,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/daabf4f95b07404789117f3aa7dad7c3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427294,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2df16653e14c4b62b61b5e4dd3244920.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500992,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/30711e2b33f84b6ebcde2a3cc31ec9c3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad16270-f81a-570e-83d8-5f81f7cdc408/5ad16270-f81a-570e-83d8-5f81f7cdc408_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404932,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53f22c967be0411f9e47329e51beb19c.jpg',
'Width': 2048}],
'price': 6650,
'price_includes_vat': True,
'registration_date': '2016-03-16',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.33 Dual VVT-i Icon Euro 6 5dr',
'transmission': 'manual',
'trim': 'Icon',
'year': 2016}
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602210105044%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602210105044: {'created_time': 1774883898.557217, 'last_price_update_time': 1774883898.557229}
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602210105044') HTTP/1.1" 204 0
2026-03-30 15:18:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 71eb2b5c-a217-5c36-b3c0-67859b9868ee with identifier 202603080512358
2026-03-30 15:18:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 71eb2b5c-a217-5c36-b3c0-67859b9868ee
2026-03-30 15:18:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'Black',
'currency': 'GBP',
'description': '2018 Audi Q3 1.4 TFSI CoD Sport SUV 5dr Petrol Manual,1 '
'Previous Owners, 71658 Miles, Service History ,MOT '
'Until--12/08/26\n'
',There are many times Great features in this car like SAT-NAV '
', The Blue Tooth interface , LCD Display, DAB, Different '
'Driving Modes, ISOFIX, Cruise Control',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '71eb2b5c-a217-5c36-b3c0-67859b9868ee',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603080512358',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Audi',
'model': 'Q3',
'odometer': 71658,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 57,
'photo_urls': ['https://m.atcdn.co.uk/a/media/699f962146d9405a9b520c3a62d5a924.jpg',
'https://m.atcdn.co.uk/a/media/716c009691fb4c1e97c5647055d43adc.jpg',
'https://m.atcdn.co.uk/a/media/4659c0a1ab404d4ebac5de5e2aa83de1.jpg',
'https://m.atcdn.co.uk/a/media/0c31acb30a374f84815267dbd0f719ff.jpg',
'https://m.atcdn.co.uk/a/media/f05f24fffda34a05a7e702b9a80d7d6e.jpg',
'https://m.atcdn.co.uk/a/media/6b07e335f8714bbfb2ca3ccd3c5c4912.jpg',
'https://m.atcdn.co.uk/a/media/0e78e590c72d469495960fc27fcc0b4c.jpg',
'https://m.atcdn.co.uk/a/media/4a767471999545a79e5564f46ce1bc5b.jpg',
'https://m.atcdn.co.uk/a/media/15d4a93cbeff475e83f6d12814ea034b.jpg',
'https://m.atcdn.co.uk/a/media/fcaae7eba9dc410aaa9f92dcfee5bd15.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174558,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/699f962146d9405a9b520c3a62d5a924.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296686,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/716c009691fb4c1e97c5647055d43adc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434775,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4659c0a1ab404d4ebac5de5e2aa83de1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242896,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c31acb30a374f84815267dbd0f719ff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277677,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f05f24fffda34a05a7e702b9a80d7d6e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427212,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b07e335f8714bbfb2ca3ccd3c5c4912.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377956,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0e78e590c72d469495960fc27fcc0b4c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384033,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a767471999545a79e5564f46ce1bc5b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460928,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/15d4a93cbeff475e83f6d12814ea034b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71eb2b5c-a217-5c36-b3c0-67859b9868ee/71eb2b5c-a217-5c36-b3c0-67859b9868ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408206,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fcaae7eba9dc410aaa9f92dcfee5bd15.jpg',
'Width': 2048}],
'price': 11195,
'price_includes_vat': True,
'registration_date': '2018-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 1.4 TFSI CoD Sport Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2018}
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603080512358%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603080512358: {'created_time': 1774883898.609521, 'last_price_update_time': 1774883898.609531}
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603080512358') HTTP/1.1" 204 0
2026-03-30 15:18:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fcf53be-cbf1-5a4b-8a60-ace6d4532256 with identifier: 202602200099405
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fcf53be-cbf1-5a4b-8a60-ace6d4532256
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe367fb37fb6243d5911a18343aa5f650.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e367fb37fb6243d5911a18343aa5f650.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbfc958e0cebd4c4f937d0ea9ac7c684c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bfc958e0cebd4c4f937d0ea9ac7c684c.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe62c55cfc966430695be6658f608bcf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e62c55cfc966430695be6658f608bcf2.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e0ba9107ad74cdc851dad5ad4c62c8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e0ba9107ad74cdc851dad5ad4c62c8b.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9b3f2c58c504bfa9407ec2e67602c3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9b3f2c58c504bfa9407ec2e67602c3d.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe7fc2f628244cd39094c7ffc6bcc19e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe7fc2f628244cd39094c7ffc6bcc19e.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbd5f72d5355b4c7baa99dd59be7d15a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bd5f72d5355b4c7baa99dd59be7d15a6.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b6f276477cd4e73883cb8611865e545.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b6f276477cd4e73883cb8611865e545.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F03928265aaa64a5285ac57cd7dd2398d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/03928265aaa64a5285ac57cd7dd2398d.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffabd7aa6fa46499c9e91cd24b7c52a93.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fabd7aa6fa46499c9e91cd24b7c52a93.jpg already downloaded
2026-03-30 15:18:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 82eed8d0-bc43-5659-bae5-3ff6639193dd with identifier: 202603050447194
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82eed8d0-bc43-5659-bae5-3ff6639193dd
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc048250c64ae4f66b3e81869768c0340.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c048250c64ae4f66b3e81869768c0340.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe67524a039104c12a4d40b00186c8110.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e67524a039104c12a4d40b00186c8110.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff51451594cf4457ab651824972e76de.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff51451594cf4457ab651824972e76de.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13365038f1a94d79bf0ba12b055a979d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13365038f1a94d79bf0ba12b055a979d.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1fa55c68393c4b47973a7cd42bda3d95.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1fa55c68393c4b47973a7cd42bda3d95.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F16b2fbbf98994b4b92082a102eacb666.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/16b2fbbf98994b4b92082a102eacb666.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09069b0c412740a88a60f4f4119f7c87.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09069b0c412740a88a60f4f4119f7c87.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff84fbf91d5084c2c86d33df08c814b21.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f84fbf91d5084c2c86d33df08c814b21.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F290b3f24dfff49ba9b564ad89f2ed845.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/290b3f24dfff49ba9b564ad89f2ed845.jpg already downloaded
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b620fa131c24dee8b534a462b41949f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b620fa131c24dee8b534a462b41949f.jpg already downloaded
2026-03-30 15:18:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8fcf53be-cbf1-5a4b-8a60-ace6d4532256 with identifier 202602200099405
2026-03-30 15:18:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8fcf53be-cbf1-5a4b-8a60-ace6d4532256
2026-03-30 15:18:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'Blue',
'currency': 'GBP',
'description': 'chans cars ltd is pleased to present for sale this '
'outstanding 2016 VOLVO V40 2.0 T2 122 R DESIGN Hatchback, 2 '
'Keys, Euro 6 (s/s), 55622 Miles ,Full Service History, 1 '
'Previous Owner, MOT---26/08/2026,This car got Great features '
'like Bluetooth and BT Audio ,DAB - Digital Audio '
'Broadcasting Radio. AUX/USB Connection, Air Conditioning , '
'2-zone Climate Control, Braking Assist, Cruise Control, '
'Traction Control, Hill Start Assist, Front and Side Airbags, '
'ISOFIX, Auto Headlights',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 120,
'fuel_type': 'Petrol',
'id': '8fcf53be-cbf1-5a4b-8a60-ace6d4532256',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200099405',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Volvo',
'model': 'V40',
'odometer': 55622,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 59,
'photo_urls': ['https://m.atcdn.co.uk/a/media/e367fb37fb6243d5911a18343aa5f650.jpg',
'https://m.atcdn.co.uk/a/media/bfc958e0cebd4c4f937d0ea9ac7c684c.jpg',
'https://m.atcdn.co.uk/a/media/e62c55cfc966430695be6658f608bcf2.jpg',
'https://m.atcdn.co.uk/a/media/2e0ba9107ad74cdc851dad5ad4c62c8b.jpg',
'https://m.atcdn.co.uk/a/media/f9b3f2c58c504bfa9407ec2e67602c3d.jpg',
'https://m.atcdn.co.uk/a/media/fe7fc2f628244cd39094c7ffc6bcc19e.jpg',
'https://m.atcdn.co.uk/a/media/bd5f72d5355b4c7baa99dd59be7d15a6.jpg',
'https://m.atcdn.co.uk/a/media/0b6f276477cd4e73883cb8611865e545.jpg',
'https://m.atcdn.co.uk/a/media/03928265aaa64a5285ac57cd7dd2398d.jpg',
'https://m.atcdn.co.uk/a/media/fabd7aa6fa46499c9e91cd24b7c52a93.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204093,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e367fb37fb6243d5911a18343aa5f650.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448986,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bfc958e0cebd4c4f937d0ea9ac7c684c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479562,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e62c55cfc966430695be6658f608bcf2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 466014,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e0ba9107ad74cdc851dad5ad4c62c8b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491012,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9b3f2c58c504bfa9407ec2e67602c3d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318011,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe7fc2f628244cd39094c7ffc6bcc19e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399837,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bd5f72d5355b4c7baa99dd59be7d15a6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388855,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b6f276477cd4e73883cb8611865e545.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348486,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/03928265aaa64a5285ac57cd7dd2398d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fcf53be-cbf1-5a4b-8a60-ace6d4532256/8fcf53be-cbf1-5a4b-8a60-ace6d4532256_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312660,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fabd7aa6fa46499c9e91cd24b7c52a93.jpg',
'Width': 2048}],
'price': 8550,
'price_includes_vat': True,
'registration_date': '2016-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 2.0 T2 R-Design Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'R-Design',
'year': 2016}
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200099405%27 HTTP/1.1" 200 None
2026-03-30 15:18:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200099405: {'created_time': 1774883898.998278, 'last_price_update_time': 1774883898.99829}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200099405') HTTP/1.1" 204 0
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 82eed8d0-bc43-5659-bae5-3ff6639193dd with identifier 202603050447194
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 82eed8d0-bc43-5659-bae5-3ff6639193dd
2026-03-30 15:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'Blue',
'currency': 'GBP',
'description': 'chans cars Are Proud To offer You This Fine 2016 Audi A1 '
'1.4 TFSI Sport Sportback 5dr Petrol ,63439 Miles, Manual, Tax '
'only £35 , MOT--20/01/27,Service history With 6 Service '
'stamps and Last Service ON March / 2026 , 1 Previous Owner, , '
'Auto light and Wiper, Cruise Control, Bluetooth, Digital Dual '
'Zone Climate Control, Digital Display, L.E.D Daytime Running '
'Lights, Stop /Start Technology, Vehicle Driving Dynamic '
'Modes, DAB Radio, Air Con , Audi Hill-Hold Assist, Seat '
'Height Adjustment, Immobilizer ,isofix ,Climate Control',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '82eed8d0-bc43-5659-bae5-3ff6639193dd',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050447194',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Audi',
'model': 'A1',
'odometer': 63439,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c048250c64ae4f66b3e81869768c0340.jpg',
'https://m.atcdn.co.uk/a/media/e67524a039104c12a4d40b00186c8110.jpg',
'https://m.atcdn.co.uk/a/media/ff51451594cf4457ab651824972e76de.jpg',
'https://m.atcdn.co.uk/a/media/13365038f1a94d79bf0ba12b055a979d.jpg',
'https://m.atcdn.co.uk/a/media/1fa55c68393c4b47973a7cd42bda3d95.jpg',
'https://m.atcdn.co.uk/a/media/16b2fbbf98994b4b92082a102eacb666.jpg',
'https://m.atcdn.co.uk/a/media/09069b0c412740a88a60f4f4119f7c87.jpg',
'https://m.atcdn.co.uk/a/media/f84fbf91d5084c2c86d33df08c814b21.jpg',
'https://m.atcdn.co.uk/a/media/290b3f24dfff49ba9b564ad89f2ed845.jpg',
'https://m.atcdn.co.uk/a/media/0b620fa131c24dee8b534a462b41949f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203175,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c048250c64ae4f66b3e81869768c0340.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430453,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e67524a039104c12a4d40b00186c8110.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89014,
'Height': 681,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ff51451594cf4457ab651824972e76de.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478630,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13365038f1a94d79bf0ba12b055a979d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431387,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1fa55c68393c4b47973a7cd42bda3d95.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504016,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/16b2fbbf98994b4b92082a102eacb666.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623063,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09069b0c412740a88a60f4f4119f7c87.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548398,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f84fbf91d5084c2c86d33df08c814b21.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447697,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/290b3f24dfff49ba9b564ad89f2ed845.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82eed8d0-bc43-5659-bae5-3ff6639193dd/82eed8d0-bc43-5659-bae5-3ff6639193dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461736,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b620fa131c24dee8b534a462b41949f.jpg',
'Width': 2048}],
'price': 8595,
'price_includes_vat': True,
'registration_date': '2016-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 1.4 TFSI Sport Sportback Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050447194%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050447194: {'created_time': 1774883899.043895, 'last_price_update_time': 1774883899.043906}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050447194') HTTP/1.1" 204 0
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 92983d99-30fe-5530-9b16-48aad54a4454 with identifier: 202602200070106
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92983d99-30fe-5530-9b16-48aad54a4454
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff38b2a225a544c5b4f27bf35f9341c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff38b2a225a544c5b4f27bf35f9341c4.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ba6e619afe84fcc87edfa671cdcbd6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ba6e619afe84fcc87edfa671cdcbd6e.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fadbe23261d524df9b7423aaf9282f09f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/adbe23261d524df9b7423aaf9282f09f.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0944be1a03314f7a8886f2a2d1a1b236.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0944be1a03314f7a8886f2a2d1a1b236.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcddf301f2c0946daa22683f3b35e4c5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cddf301f2c0946daa22683f3b35e4c5b.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff784159cef2c4b47b6924333ca337fc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f784159cef2c4b47b6924333ca337fc4.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F16b9004afd9a4b4abfe130101dcdd9e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/16b9004afd9a4b4abfe130101dcdd9e6.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbadb68c6251b40e682e0054652f90cfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/badb68c6251b40e682e0054652f90cfb.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F633aea0ef7eb4ccb9f49a8716a76178a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/633aea0ef7eb4ccb9f49a8716a76178a.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb9cf6f678884279ad86cf718c0792cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db9cf6f678884279ad86cf718c0792cd.jpg already downloaded
2026-03-30 15:18:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ab015560-da06-584e-9d27-e16d75a78929 with identifier: 202603050437257
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab015560-da06-584e-9d27-e16d75a78929
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d835a6fd99f49509bfdc10db0d5eda2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d835a6fd99f49509bfdc10db0d5eda2.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54bca2cf05064f64b0bda27120082908.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54bca2cf05064f64b0bda27120082908.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26b905ed5e9140278ba07acd162f2517.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26b905ed5e9140278ba07acd162f2517.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F99e4afed88074c4e9bd903f007ef0ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/99e4afed88074c4e9bd903f007ef0ec7.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F022031ff35ff463ab1bc09eff1d5cd74.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/022031ff35ff463ab1bc09eff1d5cd74.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F14ff64dcfbb3452f9a764191c1d13d47.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/14ff64dcfbb3452f9a764191c1d13d47.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b1d539112ce49d69069e98d5aa3fecd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b1d539112ce49d69069e98d5aa3fecd.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcab256321f514736aafc123843945c18.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cab256321f514736aafc123843945c18.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fef2ff93e9a8c476984f2177c2078701a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ef2ff93e9a8c476984f2177c2078701a.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c082de5dfa64e5796913e28214b35b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c082de5dfa64e5796913e28214b35b7.jpg already downloaded
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 92983d99-30fe-5530-9b16-48aad54a4454 with identifier 202602200070106
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 92983d99-30fe-5530-9b16-48aad54a4454
2026-03-30 15:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Red',
'currency': 'GBP',
'description': '2018 Toyota Yaris 1.5 VVT-i Icon Hatchback 5dr Petrol Manual, '
'76388 Miles,1.5 Petrol, 1 Previous owner , MOT--15/12/26 '
',Service History , Lcd Touch Screen display, Reverse Camera, '
'AUX-in Socket ,Phone Blue Tooth, Air con ,Power Steering '
',Immobiliser, MP3, Isofix ,USP, Height adjustable drivers '
'seat',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 109,
'fuel_type': 'Petrol',
'id': '92983d99-30fe-5530-9b16-48aad54a4454',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200070106',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 76388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ff38b2a225a544c5b4f27bf35f9341c4.jpg',
'https://m.atcdn.co.uk/a/media/4ba6e619afe84fcc87edfa671cdcbd6e.jpg',
'https://m.atcdn.co.uk/a/media/adbe23261d524df9b7423aaf9282f09f.jpg',
'https://m.atcdn.co.uk/a/media/0944be1a03314f7a8886f2a2d1a1b236.jpg',
'https://m.atcdn.co.uk/a/media/cddf301f2c0946daa22683f3b35e4c5b.jpg',
'https://m.atcdn.co.uk/a/media/f784159cef2c4b47b6924333ca337fc4.jpg',
'https://m.atcdn.co.uk/a/media/16b9004afd9a4b4abfe130101dcdd9e6.jpg',
'https://m.atcdn.co.uk/a/media/badb68c6251b40e682e0054652f90cfb.jpg',
'https://m.atcdn.co.uk/a/media/633aea0ef7eb4ccb9f49a8716a76178a.jpg',
'https://m.atcdn.co.uk/a/media/db9cf6f678884279ad86cf718c0792cd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423462,
'Height': 1362,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ff38b2a225a544c5b4f27bf35f9341c4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335422,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ba6e619afe84fcc87edfa671cdcbd6e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311532,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/adbe23261d524df9b7423aaf9282f09f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374598,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0944be1a03314f7a8886f2a2d1a1b236.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367311,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cddf301f2c0946daa22683f3b35e4c5b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416019,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f784159cef2c4b47b6924333ca337fc4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467121,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/16b9004afd9a4b4abfe130101dcdd9e6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428276,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/badb68c6251b40e682e0054652f90cfb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414910,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/633aea0ef7eb4ccb9f49a8716a76178a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92983d99-30fe-5530-9b16-48aad54a4454/92983d99-30fe-5530-9b16-48aad54a4454_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372362,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db9cf6f678884279ad86cf718c0792cd.jpg',
'Width': 2048}],
'price': 7395,
'price_includes_vat': True,
'registration_date': '2018-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.5 VVT-i Icon Euro 6 5dr',
'transmission': 'manual',
'trim': 'Icon',
'year': 2018}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200070106%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200070106: {'created_time': 1774883899.486348, 'last_price_update_time': 1774883899.486358}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200070106') HTTP/1.1" 204 0
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ab015560-da06-584e-9d27-e16d75a78929 with identifier 202603050437257
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ab015560-da06-584e-9d27-e16d75a78929
2026-03-30 15:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 137,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2007 Honda Jazz i-DSI SE is a rare find, having been '
'cherished by only 1 Previous owner from new. The clutch was '
'Replaced Recently. This well maintained example boasts a '
'reliable 1.4 litre petrol engine and comes in the popular SE '
'trim. A Good service history with 14 Stamps .AA Breakdown '
'Cover .\n'
'\n'
'You can expect impressive running costs with this Jazz, '
'achieving an excellent fuel economy of 49 miles per gallon. '
'its low CO2 emissions mean it is kinder to the environment. '
'These highlights demonstrate how this particular Honda Jazz '
'offers a more economical and responsible driving experience '
'compared to many other vehicles in its class.',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.4L',
'engine_horse_power': 82,
'fuel_type': 'Petrol',
'id': 'ab015560-da06-584e-9d27-e16d75a78929',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050437257',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Honda',
'model': 'Jazz',
'odometer': 74236,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9d835a6fd99f49509bfdc10db0d5eda2.jpg',
'https://m.atcdn.co.uk/a/media/54bca2cf05064f64b0bda27120082908.jpg',
'https://m.atcdn.co.uk/a/media/26b905ed5e9140278ba07acd162f2517.jpg',
'https://m.atcdn.co.uk/a/media/99e4afed88074c4e9bd903f007ef0ec7.jpg',
'https://m.atcdn.co.uk/a/media/022031ff35ff463ab1bc09eff1d5cd74.jpg',
'https://m.atcdn.co.uk/a/media/14ff64dcfbb3452f9a764191c1d13d47.jpg',
'https://m.atcdn.co.uk/a/media/9b1d539112ce49d69069e98d5aa3fecd.jpg',
'https://m.atcdn.co.uk/a/media/cab256321f514736aafc123843945c18.jpg',
'https://m.atcdn.co.uk/a/media/ef2ff93e9a8c476984f2177c2078701a.jpg',
'https://m.atcdn.co.uk/a/media/8c082de5dfa64e5796913e28214b35b7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528706,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d835a6fd99f49509bfdc10db0d5eda2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545243,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/54bca2cf05064f64b0bda27120082908.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583096,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/26b905ed5e9140278ba07acd162f2517.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377589,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/99e4afed88074c4e9bd903f007ef0ec7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537370,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/022031ff35ff463ab1bc09eff1d5cd74.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500520,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/14ff64dcfbb3452f9a764191c1d13d47.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483117,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9b1d539112ce49d69069e98d5aa3fecd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574842,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cab256321f514736aafc123843945c18.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526481,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ef2ff93e9a8c476984f2177c2078701a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab015560-da06-584e-9d27-e16d75a78929/ab015560-da06-584e-9d27-e16d75a78929_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368199,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c082de5dfa64e5796913e28214b35b7.jpg',
'Width': 2048}],
'price': 2495,
'price_includes_vat': True,
'registration_date': '2007-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Jazz 1.4 i-DSI SE 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2007}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050437257%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050437257: {'created_time': 1774883899.535803, 'last_price_update_time': 1774883899.535813}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050437257') HTTP/1.1" 204 0
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 51830ff5-b460-57c9-ba3c-d29ceebf0d80 with identifier: 202602190069566
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51830ff5-b460-57c9-ba3c-d29ceebf0d80
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7f12be472e9c452a9419e12692d7d02f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7f12be472e9c452a9419e12692d7d02f.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9624e66c537047bdacec72b27ec61d14.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9624e66c537047bdacec72b27ec61d14.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff247f9e07af24c4195739623e15455c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f247f9e07af24c4195739623e15455c9.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d89de073be742d6b9a98392d7ac8b50.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d89de073be742d6b9a98392d7ac8b50.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe3238e9f5be843e48696df3ebab449a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e3238e9f5be843e48696df3ebab449a5.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd924fdcbecd34cc8b64db64f443ce671.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d924fdcbecd34cc8b64db64f443ce671.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fffb42d2faf7d4140b936c946222b6592.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ffb42d2faf7d4140b936c946222b6592.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f56e2b84f9f43e28766d4c4bf933b21.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f56e2b84f9f43e28766d4c4bf933b21.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad801c8b2a78409ba5103cd14e89bd3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad801c8b2a78409ba5103cd14e89bd3a.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F789d593b57884541b4a689cd018e18c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/789d593b57884541b4a689cd018e18c8.jpg already downloaded
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ce3d947c-137c-5583-afd1-17e83347d99f with identifier: 202602270271250
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce3d947c-137c-5583-afd1-17e83347d99f
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f00e9aba56e40b097519c5864e0e077.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f00e9aba56e40b097519c5864e0e077.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80eeb96532334e5c953c36f562e44a13.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80eeb96532334e5c953c36f562e44a13.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F66992bf74b804ed1bdcb375660bb5b4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/66992bf74b804ed1bdcb375660bb5b4f.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb0cee6ce36b48a8891c3c4447c8f884.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db0cee6ce36b48a8891c3c4447c8f884.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F96fc5f63ab5b4e29a98b73a1eb624553.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/96fc5f63ab5b4e29a98b73a1eb624553.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2444628fe9714afebf3503b4ffc75d63.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2444628fe9714afebf3503b4ffc75d63.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3684fa62128401f85d44a90112d2bb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3684fa62128401f85d44a90112d2bb8.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c37de1bef5e4282b7918ca3e1f4f049.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c37de1bef5e4282b7918ca3e1f4f049.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5cd8636ce36434b9db3406e224e7bf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5cd8636ce36434b9db3406e224e7bf7.jpg already downloaded
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32626568540b480cb719c917843d3e69.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32626568540b480cb719c917843d3e69.jpg already downloaded
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 51830ff5-b460-57c9-ba3c-d29ceebf0d80 with identifier 202602190069566
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 51830ff5-b460-57c9-ba3c-d29ceebf0d80
2026-03-30 15:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Blue',
'currency': 'GBP',
'description': '2017 Toyota Yaris 1.5 VVT-i Icon Tech Hatchback 5dr Petrol '
'Manual, 56012 Miles,1.5 Petrol, 1 Previous owner , '
'MOT--28-09-2026 ,Service History ,Front Parking Sensor, Lcd '
'Touch Screen display, Reverse Camera,SAT-NAV, AUX-in Socket '
',Phone Blue Tooth, Air con ,Power Steering ,Immobiliser, MP3, '
'Isofix ,USP, Height adjustable drivers seat',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 109,
'fuel_type': 'Petrol',
'id': '51830ff5-b460-57c9-ba3c-d29ceebf0d80',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190069566',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 56012,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 53,
'photo_urls': ['https://m.atcdn.co.uk/a/media/7f12be472e9c452a9419e12692d7d02f.jpg',
'https://m.atcdn.co.uk/a/media/9624e66c537047bdacec72b27ec61d14.jpg',
'https://m.atcdn.co.uk/a/media/f247f9e07af24c4195739623e15455c9.jpg',
'https://m.atcdn.co.uk/a/media/0d89de073be742d6b9a98392d7ac8b50.jpg',
'https://m.atcdn.co.uk/a/media/e3238e9f5be843e48696df3ebab449a5.jpg',
'https://m.atcdn.co.uk/a/media/d924fdcbecd34cc8b64db64f443ce671.jpg',
'https://m.atcdn.co.uk/a/media/ffb42d2faf7d4140b936c946222b6592.jpg',
'https://m.atcdn.co.uk/a/media/9f56e2b84f9f43e28766d4c4bf933b21.jpg',
'https://m.atcdn.co.uk/a/media/ad801c8b2a78409ba5103cd14e89bd3a.jpg',
'https://m.atcdn.co.uk/a/media/789d593b57884541b4a689cd018e18c8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320070,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7f12be472e9c452a9419e12692d7d02f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254453,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9624e66c537047bdacec72b27ec61d14.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256664,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f247f9e07af24c4195739623e15455c9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334072,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d89de073be742d6b9a98392d7ac8b50.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416961,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e3238e9f5be843e48696df3ebab449a5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313780,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d924fdcbecd34cc8b64db64f443ce671.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400365,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ffb42d2faf7d4140b936c946222b6592.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351370,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f56e2b84f9f43e28766d4c4bf933b21.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407475,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad801c8b2a78409ba5103cd14e89bd3a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51830ff5-b460-57c9-ba3c-d29ceebf0d80/51830ff5-b460-57c9-ba3c-d29ceebf0d80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444071,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/789d593b57884541b4a689cd018e18c8.jpg',
'Width': 2048}],
'price': 8495,
'price_includes_vat': True,
'registration_date': '2017-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.5 VVT-i Icon Tech Euro 6 5dr',
'transmission': 'manual',
'trim': 'Icon Tech',
'year': 2017}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190069566%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190069566: {'created_time': 1774883899.918269, 'last_price_update_time': 1774883899.918277}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190069566') HTTP/1.1" 204 0
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ce3d947c-137c-5583-afd1-17e83347d99f with identifier 202602270271250
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ce3d947c-137c-5583-afd1-17e83347d99f
2026-03-30 15:18:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 101,
'color': 'Black',
'currency': 'GBP',
'description': 'chans cars ltd is pleased to present yourself with this '
'outstanding Lexus IS 2.5 300h Advance Saloon 4dr Petrol '
'Hybrid E-CVT Euro 6 With 59043 Miles, FULL Lexus Service '
'History With 10 stamps,1 Owner From New, MOT '
'Until---02/03/2027 . £20 TAX/ YEAR ,There are many Great '
'features in this car like Sat-Nav to help you navigate To '
'Places, Heated Leather, Seats Reverse Parking Sensors And '
'Camera, ECO And Sports Mode Driving ,The Blue Tooth interface '
'-Smart, safe and simple to use meaning you can stay connected '
'all the time, lane Assist.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 220,
'fuel_type': 'Petrol Hybrid',
'id': 'ce3d947c-137c-5583-afd1-17e83347d99f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270271250',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Lexus',
'model': 'IS',
'odometer': 59043,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 65,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8f00e9aba56e40b097519c5864e0e077.jpg',
'https://m.atcdn.co.uk/a/media/80eeb96532334e5c953c36f562e44a13.jpg',
'https://m.atcdn.co.uk/a/media/66992bf74b804ed1bdcb375660bb5b4f.jpg',
'https://m.atcdn.co.uk/a/media/db0cee6ce36b48a8891c3c4447c8f884.jpg',
'https://m.atcdn.co.uk/a/media/96fc5f63ab5b4e29a98b73a1eb624553.jpg',
'https://m.atcdn.co.uk/a/media/2444628fe9714afebf3503b4ffc75d63.jpg',
'https://m.atcdn.co.uk/a/media/c3684fa62128401f85d44a90112d2bb8.jpg',
'https://m.atcdn.co.uk/a/media/8c37de1bef5e4282b7918ca3e1f4f049.jpg',
'https://m.atcdn.co.uk/a/media/f5cd8636ce36434b9db3406e224e7bf7.jpg',
'https://m.atcdn.co.uk/a/media/32626568540b480cb719c917843d3e69.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186354,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f00e9aba56e40b097519c5864e0e077.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434090,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/80eeb96532334e5c953c36f562e44a13.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353393,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/66992bf74b804ed1bdcb375660bb5b4f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452552,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db0cee6ce36b48a8891c3c4447c8f884.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435478,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/96fc5f63ab5b4e29a98b73a1eb624553.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448686,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2444628fe9714afebf3503b4ffc75d63.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387066,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c3684fa62128401f85d44a90112d2bb8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433834,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c37de1bef5e4282b7918ca3e1f4f049.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344520,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f5cd8636ce36434b9db3406e224e7bf7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce3d947c-137c-5583-afd1-17e83347d99f/ce3d947c-137c-5583-afd1-17e83347d99f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389019,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/32626568540b480cb719c917843d3e69.jpg',
'Width': 2048}],
'price': 13000,
'price_includes_vat': True,
'registration_date': '2015-06-12',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus IS 2.5 300h Advance E-CVT Euro 6 (s/s) 4dr',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2015}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270271250%27 HTTP/1.1" 200 None
2026-03-30 15:18:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270271250: {'created_time': 1774883899.979694, 'last_price_update_time': 1774883899.979706}
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270271250') HTTP/1.1" 204 0
2026-03-30 15:18:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ca31cd1-4164-58e0-8b2c-f602d5637abd with identifier: 202602119859543
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ca31cd1-4164-58e0-8b2c-f602d5637abd
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F140fafda59f14fae879aeabe99798432.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/140fafda59f14fae879aeabe99798432.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48b5bb2a7bd04fd4b9e8249d6bb8366d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48b5bb2a7bd04fd4b9e8249d6bb8366d.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5650d46b864a422d9cf48d72acbb35d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5650d46b864a422d9cf48d72acbb35d3.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2cfc2644429b40ff822fe8c2e4e9edc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2cfc2644429b40ff822fe8c2e4e9edc1.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F327a370dc11d48318b45285852f23b07.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/327a370dc11d48318b45285852f23b07.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07a7c23d0ecb49f4a7a09556b7ec8397.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07a7c23d0ecb49f4a7a09556b7ec8397.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc39e294ff48148e096c40065e367b6ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c39e294ff48148e096c40065e367b6ec.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F81a7ecaca130465dbf6a2d4ec6d60f4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/81a7ecaca130465dbf6a2d4ec6d60f4e.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e2a13722a2847ea925d565c4f2f7c96.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e2a13722a2847ea925d565c4f2f7c96.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1d7428466fc48b9910fc75d482ce420.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1d7428466fc48b9910fc75d482ce420.jpg already downloaded
2026-03-30 15:18:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6afec78b-fbe7-5aac-99d5-020e6c3d4c7f with identifier: 202512208733202
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6afec78b-fbe7-5aac-99d5-020e6c3d4c7f
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F997ecd4148d8424791473164289c4b33.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/997ecd4148d8424791473164289c4b33.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2963b199eb946b288856e4baedf7170.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2963b199eb946b288856e4baedf7170.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff872e06169554701bfaaaac6f5366e56.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f872e06169554701bfaaaac6f5366e56.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9ffb38c0d85846f8b0fcba971c5119fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9ffb38c0d85846f8b0fcba971c5119fa.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9adb27aefe814fb987cdf59bd9eb8362.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9adb27aefe814fb987cdf59bd9eb8362.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9b6763603e841cfb573ced4e383e1a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9b6763603e841cfb573ced4e383e1a4.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4687c25179c04245a7206faf61a98213.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4687c25179c04245a7206faf61a98213.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84cc85aae7b440c68b7cfed5065f98e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84cc85aae7b440c68b7cfed5065f98e9.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F043dde80574b4a558e527b990936c62d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/043dde80574b4a558e527b990936c62d.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb4e0a494238d4b9a90a1db77ca2ed4a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b4e0a494238d4b9a90a1db77ca2ed4a9.jpg already downloaded
2026-03-30 15:18:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bf844352-4459-599d-aa83-96e05336509c with identifier: 202602270268775
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf844352-4459-599d-aa83-96e05336509c
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F72c55f4137a544cfb1228461fa2d31bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/72c55f4137a544cfb1228461fa2d31bd.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb96762876ca2412bbb4739ef297e580b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b96762876ca2412bbb4739ef297e580b.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6272c472f519459d9624183148c3774d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6272c472f519459d9624183148c3774d.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb656db9c81a54a99b727c9afcb5bbd90.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b656db9c81a54a99b727c9afcb5bbd90.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa9ac5b4508f8419f87a587ec67b0a164.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a9ac5b4508f8419f87a587ec67b0a164.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed25a507031648b1b0ae6c80e17e2393.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed25a507031648b1b0ae6c80e17e2393.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48cae98450c34c16b905f65d516c8795.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48cae98450c34c16b905f65d516c8795.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcbd5a9870b504da69d196d88b9007706.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cbd5a9870b504da69d196d88b9007706.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbba3f4674b1b47ce9869b9687713e78d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bba3f4674b1b47ce9869b9687713e78d.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4363f2e2a4d04b5fb0c04775b370a866.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4363f2e2a4d04b5fb0c04775b370a866.jpg already downloaded
2026-03-30 15:18:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4ca31cd1-4164-58e0-8b2c-f602d5637abd with identifier 202602119859543
2026-03-30 15:18:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4ca31cd1-4164-58e0-8b2c-f602d5637abd
2026-03-30 15:18:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 94,
'color': 'Black',
'currency': 'GBP',
'description': 'chanscars ltd is pleased to present yourself with this '
'outstanding 2014 Lexus CT 200h 1.8 Advance CVT (s/s) 5dr '
'Hybrid With 71451 Miles & 2 Previous Owners. you can be '
'confident this car is in great condition With the Full '
'Service History, MOT Untill 14/11/2026 .It is £20 Road tax '
'for this car. There are many Great features in this car like '
'Sat-Nav to help you navigate To Places, Reverse Parking '
'Sensors, ECO And Sports Mode Driving , The Blue Tooth '
'interface -Smart, safe and simple to use meaning you can stay '
'connected all the time. Convenient Heated Seats For The Cold '
'Mornings',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.8L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': '4ca31cd1-4164-58e0-8b2c-f602d5637abd',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602119859543',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Lexus',
'model': 'CT',
'odometer': 71451,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 66,
'photo_urls': ['https://m.atcdn.co.uk/a/media/140fafda59f14fae879aeabe99798432.jpg',
'https://m.atcdn.co.uk/a/media/48b5bb2a7bd04fd4b9e8249d6bb8366d.jpg',
'https://m.atcdn.co.uk/a/media/5650d46b864a422d9cf48d72acbb35d3.jpg',
'https://m.atcdn.co.uk/a/media/2cfc2644429b40ff822fe8c2e4e9edc1.jpg',
'https://m.atcdn.co.uk/a/media/327a370dc11d48318b45285852f23b07.jpg',
'https://m.atcdn.co.uk/a/media/07a7c23d0ecb49f4a7a09556b7ec8397.jpg',
'https://m.atcdn.co.uk/a/media/c39e294ff48148e096c40065e367b6ec.jpg',
'https://m.atcdn.co.uk/a/media/81a7ecaca130465dbf6a2d4ec6d60f4e.jpg',
'https://m.atcdn.co.uk/a/media/3e2a13722a2847ea925d565c4f2f7c96.jpg',
'https://m.atcdn.co.uk/a/media/d1d7428466fc48b9910fc75d482ce420.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192346,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/140fafda59f14fae879aeabe99798432.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355002,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/48b5bb2a7bd04fd4b9e8249d6bb8366d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328683,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5650d46b864a422d9cf48d72acbb35d3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360127,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2cfc2644429b40ff822fe8c2e4e9edc1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509349,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/327a370dc11d48318b45285852f23b07.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461521,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/07a7c23d0ecb49f4a7a09556b7ec8397.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417450,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c39e294ff48148e096c40065e367b6ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419499,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/81a7ecaca130465dbf6a2d4ec6d60f4e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359201,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e2a13722a2847ea925d565c4f2f7c96.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ca31cd1-4164-58e0-8b2c-f602d5637abd/4ca31cd1-4164-58e0-8b2c-f602d5637abd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510975,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1d7428466fc48b9910fc75d482ce420.jpg',
'Width': 2048}],
'price': 9650,
'price_includes_vat': True,
'registration_date': '2014-11-25',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus CT 1.8 200h Advance CVT Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2014}
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119859543%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602119859543: {'created_time': 1774883900.575832, 'last_price_update_time': 1774883900.575844}
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602119859543') HTTP/1.1" 204 0
2026-03-30 15:18:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6afec78b-fbe7-5aac-99d5-020e6c3d4c7f with identifier 202512208733202
2026-03-30 15:18:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6afec78b-fbe7-5aac-99d5-020e6c3d4c7f
2026-03-30 15:18:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'Grey',
'currency': 'GBP',
'description': '2017 Audi Q2 1.4 TFSI CoD S line SUV 5dr Petrol Manual Euro '
'6 With 2 Previous Owners. 48360 Miles, Service History With 6 '
'Service ,MOT Until--13/12/2026 There are many times Great '
'features in this car like SAT-NAV , Apple Play , The Blue '
'Tooth interface ,Reserve Parking Sensors, Heated Seats, LCD '
'Display, DAB, Different Driving Modes, good family car,',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '6afec78b-fbe7-5aac-99d5-020e6c3d4c7f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512208733202',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Audi',
'model': 'Q2',
'odometer': 48360,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photo_urls': ['https://m.atcdn.co.uk/a/media/997ecd4148d8424791473164289c4b33.jpg',
'https://m.atcdn.co.uk/a/media/d2963b199eb946b288856e4baedf7170.jpg',
'https://m.atcdn.co.uk/a/media/f872e06169554701bfaaaac6f5366e56.jpg',
'https://m.atcdn.co.uk/a/media/9ffb38c0d85846f8b0fcba971c5119fa.jpg',
'https://m.atcdn.co.uk/a/media/9adb27aefe814fb987cdf59bd9eb8362.jpg',
'https://m.atcdn.co.uk/a/media/b9b6763603e841cfb573ced4e383e1a4.jpg',
'https://m.atcdn.co.uk/a/media/4687c25179c04245a7206faf61a98213.jpg',
'https://m.atcdn.co.uk/a/media/84cc85aae7b440c68b7cfed5065f98e9.jpg',
'https://m.atcdn.co.uk/a/media/043dde80574b4a558e527b990936c62d.jpg',
'https://m.atcdn.co.uk/a/media/b4e0a494238d4b9a90a1db77ca2ed4a9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207898,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/997ecd4148d8424791473164289c4b33.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314831,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2963b199eb946b288856e4baedf7170.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382344,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f872e06169554701bfaaaac6f5366e56.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322922,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9ffb38c0d85846f8b0fcba971c5119fa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492804,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9adb27aefe814fb987cdf59bd9eb8362.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584659,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9b6763603e841cfb573ced4e383e1a4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503883,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4687c25179c04245a7206faf61a98213.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435038,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/84cc85aae7b440c68b7cfed5065f98e9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417318,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/043dde80574b4a558e527b990936c62d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6afec78b-fbe7-5aac-99d5-020e6c3d4c7f/6afec78b-fbe7-5aac-99d5-020e6c3d4c7f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528696,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b4e0a494238d4b9a90a1db77ca2ed4a9.jpg',
'Width': 2048}],
'price': 12795,
'price_includes_vat': True,
'registration_date': '2017-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 1.4 TFSI CoD S line Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'S line',
'year': 2017}
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512208733202%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512208733202: {'created_time': 1774883900.63163, 'last_price_update_time': 1774883900.631642}
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512208733202') HTTP/1.1" 204 0
2026-03-30 15:18:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bf844352-4459-599d-aa83-96e05336509c with identifier 202602270268775
2026-03-30 15:18:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bf844352-4459-599d-aa83-96e05336509c
2026-03-30 15:18:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'Red',
'currency': 'GBP',
'description': '2013 Mazda Mazda3 1.6 Venture Hatchback 5dr Petrol Manual ,1 '
'Previous Owner ,103925 MILES, MOT--25/03/2027, Service '
'History With last serviced on 26/02/2026, Heated seats ,Car '
'Play, Android Auto , Apple Play , Reverse Camera, Rear '
'Parking Sensors, Sat Nav, Air - Conditioning, Dual - Zone '
'Climate Control, AM/FM Radio/Single CD/ MP3 Audio',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Petrol',
'id': 'bf844352-4459-599d-aa83-96e05336509c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270268775',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Mazda',
'model': 'Mazda3',
'odometer': 103000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photo_urls': ['https://m.atcdn.co.uk/a/media/72c55f4137a544cfb1228461fa2d31bd.jpg',
'https://m.atcdn.co.uk/a/media/b96762876ca2412bbb4739ef297e580b.jpg',
'https://m.atcdn.co.uk/a/media/6272c472f519459d9624183148c3774d.jpg',
'https://m.atcdn.co.uk/a/media/b656db9c81a54a99b727c9afcb5bbd90.jpg',
'https://m.atcdn.co.uk/a/media/a9ac5b4508f8419f87a587ec67b0a164.jpg',
'https://m.atcdn.co.uk/a/media/ed25a507031648b1b0ae6c80e17e2393.jpg',
'https://m.atcdn.co.uk/a/media/48cae98450c34c16b905f65d516c8795.jpg',
'https://m.atcdn.co.uk/a/media/cbd5a9870b504da69d196d88b9007706.jpg',
'https://m.atcdn.co.uk/a/media/bba3f4674b1b47ce9869b9687713e78d.jpg',
'https://m.atcdn.co.uk/a/media/4363f2e2a4d04b5fb0c04775b370a866.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357355,
'Height': 1362,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/72c55f4137a544cfb1228461fa2d31bd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484022,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b96762876ca2412bbb4739ef297e580b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 494698,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6272c472f519459d9624183148c3774d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393064,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b656db9c81a54a99b727c9afcb5bbd90.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523297,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a9ac5b4508f8419f87a587ec67b0a164.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503430,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed25a507031648b1b0ae6c80e17e2393.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440129,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/48cae98450c34c16b905f65d516c8795.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444732,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cbd5a9870b504da69d196d88b9007706.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394213,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bba3f4674b1b47ce9869b9687713e78d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf844352-4459-599d-aa83-96e05336509c/bf844352-4459-599d-aa83-96e05336509c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402239,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4363f2e2a4d04b5fb0c04775b370a866.jpg',
'Width': 2048}],
'price': 3130,
'price_includes_vat': True,
'registration_date': '2013-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda3 1.6 Venture Euro 5 5dr',
'transmission': 'manual',
'trim': 'Venture',
'year': 2013}
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270268775%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270268775: {'created_time': 1774883900.681203, 'last_price_update_time': 1774883900.681215}
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270268775') HTTP/1.1" 204 0
2026-03-30 15:18:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6584708a-ef6f-557d-9caf-d7e036676893 with identifier: 202602099779384
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6584708a-ef6f-557d-9caf-d7e036676893
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe218af0ed7a474f8ece197ddfdd0588.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe218af0ed7a474f8ece197ddfdd0588.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd670d2a807fb424f8b379e3c721d86b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d670d2a807fb424f8b379e3c721d86b1.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Facdb2b8ea99b4a1ebcce69da67f88a77.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/acdb2b8ea99b4a1ebcce69da67f88a77.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F024aa93f0dd4489da022a142c60deb48.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/024aa93f0dd4489da022a142c60deb48.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0aed6ca801e4813b80996b65eed62a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0aed6ca801e4813b80996b65eed62a9.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd44101f7fd104e2f9102dd2f7fd20ae1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d44101f7fd104e2f9102dd2f7fd20ae1.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f7b7ee349b24230916d2b02c56e6505.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f7b7ee349b24230916d2b02c56e6505.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F969600661304496a93091dde39762d23.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/969600661304496a93091dde39762d23.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe1d4c923caa4b1694ecfde27dd2d468.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe1d4c923caa4b1694ecfde27dd2d468.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd49d1bfb9e37449c916bd6dea4337db4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d49d1bfb9e37449c916bd6dea4337db4.jpg already downloaded
2026-03-30 15:18:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e26a9ad6-aac0-5269-9c5e-899a19ca5e81 with identifier: 202511258136021
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e26a9ad6-aac0-5269-9c5e-899a19ca5e81
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9a419198171460aba516a98e27cac7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9a419198171460aba516a98e27cac7c.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1dc98165b2f44cbab48c7195e1fd5adb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1dc98165b2f44cbab48c7195e1fd5adb.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F508e620dc10e4e0fa819f9021ef0011b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/508e620dc10e4e0fa819f9021ef0011b.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F754973a2f3eb4ba0b0f115d5586c3603.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/754973a2f3eb4ba0b0f115d5586c3603.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85acac3576df4360ac49f03542824122.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85acac3576df4360ac49f03542824122.jpg already downloaded
2026-03-30 15:18:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe72a0c4d1b414132aa1fe6daa0858e9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e72a0c4d1b414132aa1fe6daa0858e9d.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F907bfdbfff344040a7eaa8e677f1e61e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/907bfdbfff344040a7eaa8e677f1e61e.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F575c0f724ef74fbba9b71a915a30a986.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/575c0f724ef74fbba9b71a915a30a986.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff596ae7db1f841e3a9c207dd35390d58.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f596ae7db1f841e3a9c207dd35390d58.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1f2d970a53244d708889298543bfc782.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1f2d970a53244d708889298543bfc782.jpg already downloaded
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c383a47-975f-548c-84bd-6493bb1fae42 with identifier: 202602260251124
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c383a47-975f-548c-84bd-6493bb1fae42
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fab6c48269509424e9d91657c8e1553ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ab6c48269509424e9d91657c8e1553ce.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f07ecf96277494a8dc61e597cfb35b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f07ecf96277494a8dc61e597cfb35b2.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F527eeaccb52543f68f0b40ce494e8ec5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/527eeaccb52543f68f0b40ce494e8ec5.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff051e081f494735b4ad015cab119601.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff051e081f494735b4ad015cab119601.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d694f3ac33846e99330ba97ca4fbfe4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d694f3ac33846e99330ba97ca4fbfe4.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6decb8a100aa4a36bb9e745c8d5415bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6decb8a100aa4a36bb9e745c8d5415bb.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F322680f1684847d8b57e2b6df7f5cbea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/322680f1684847d8b57e2b6df7f5cbea.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1604bfaa8e6e4909ac2d2dda979d8bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1604bfaa8e6e4909ac2d2dda979d8bbb.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ce219155d8b468ab02a0ae66507a11d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ce219155d8b468ab02a0ae66507a11d.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc13a49ef146a404cb033baf02cc54ac6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c13a49ef146a404cb033baf02cc54ac6.jpg already downloaded
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6584708a-ef6f-557d-9caf-d7e036676893 with identifier 202602099779384
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6584708a-ef6f-557d-9caf-d7e036676893
2026-03-30 15:18:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'Blue',
'currency': 'GBP',
'description': 'Chans cars ltd is pleased to present yourself with this '
'outstanding 2018 Audi A3 1.5 TFSI CoD Black Edition Saloon '
'4dr Petrol Manual With 60515 Miles With 1 Previous Owners, '
'Service History And Recently Serviced ,MOT--03/11/26, There '
'are many times Great features in this car like SAT-NAV ,CAR '
'Play, Rear Parking Sensors, The Blue Tooth, LCD Display, DAB, '
'ISOFIX, Hill hold Assistant, Dynamic Driving Modes.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '6584708a-ef6f-557d-9caf-d7e036676893',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602099779384',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Audi',
'model': 'A3',
'odometer': 60515,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photo_urls': ['https://m.atcdn.co.uk/a/media/fe218af0ed7a474f8ece197ddfdd0588.jpg',
'https://m.atcdn.co.uk/a/media/d670d2a807fb424f8b379e3c721d86b1.jpg',
'https://m.atcdn.co.uk/a/media/acdb2b8ea99b4a1ebcce69da67f88a77.jpg',
'https://m.atcdn.co.uk/a/media/024aa93f0dd4489da022a142c60deb48.jpg',
'https://m.atcdn.co.uk/a/media/d0aed6ca801e4813b80996b65eed62a9.jpg',
'https://m.atcdn.co.uk/a/media/d44101f7fd104e2f9102dd2f7fd20ae1.jpg',
'https://m.atcdn.co.uk/a/media/8f7b7ee349b24230916d2b02c56e6505.jpg',
'https://m.atcdn.co.uk/a/media/969600661304496a93091dde39762d23.jpg',
'https://m.atcdn.co.uk/a/media/fe1d4c923caa4b1694ecfde27dd2d468.jpg',
'https://m.atcdn.co.uk/a/media/d49d1bfb9e37449c916bd6dea4337db4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468308,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe218af0ed7a474f8ece197ddfdd0588.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523019,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d670d2a807fb424f8b379e3c721d86b1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363431,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/acdb2b8ea99b4a1ebcce69da67f88a77.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504727,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/024aa93f0dd4489da022a142c60deb48.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557449,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0aed6ca801e4813b80996b65eed62a9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442775,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d44101f7fd104e2f9102dd2f7fd20ae1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507054,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f7b7ee349b24230916d2b02c56e6505.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542407,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/969600661304496a93091dde39762d23.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538604,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe1d4c923caa4b1694ecfde27dd2d468.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6584708a-ef6f-557d-9caf-d7e036676893/6584708a-ef6f-557d-9caf-d7e036676893_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429158,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d49d1bfb9e37449c916bd6dea4337db4.jpg',
'Width': 2048}],
'price': 13250,
'price_includes_vat': True,
'registration_date': '2018-05-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 1.5 TFSI CoD Black Edition Euro 6 (s/s) 4dr',
'transmission': 'manual',
'trim': 'Black Edition',
'year': 2018}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099779384%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602099779384: {'created_time': 1774883901.324912, 'last_price_update_time': 1774883901.324925}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099779384') HTTP/1.1" 204 0
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e26a9ad6-aac0-5269-9c5e-899a19ca5e81 with identifier 202511258136021
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e26a9ad6-aac0-5269-9c5e-899a19ca5e81
2026-03-30 15:18:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'Black',
'currency': 'GBP',
'description': '2019 Nissan Qashqai 1.3 DIG-T N-Connecta SUV 5dr Petrol '
'Manual Euro 6, 52285 Miles ,2 Previous owner, Service history '
', Mot --29/07/2026 ,Apple car Play, In built BLUETOOTH FOR '
'PHONES ,USP PORT, SAT-NAV, 360` And Reverse Camera & Front '
'and Reverse parking sensor, Lane Warning, Aux in, air con, '
'16" alloy wheels, Lumbar support, Immobiliser, Child locks & '
'Isofix system , Cruise control ,Electric front/rear windows, '
"Radio + CD ,climate control, PAS, Alarm, Driver's lumbar "
'support, 3 Months Warranty ,5 Day Driveway Insurance , HPI '
'Clear , cards accepted, Finance arranged More cars at '
'CHANSCARS.CO.UK. Enjoy low interest rates and no admin fees '
'on finance when you deal with us directly and Avoid admin '
'charges!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.3L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': 'e26a9ad6-aac0-5269-9c5e-899a19ca5e81',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511258136021',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 52285,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 63,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b9a419198171460aba516a98e27cac7c.jpg',
'https://m.atcdn.co.uk/a/media/1dc98165b2f44cbab48c7195e1fd5adb.jpg',
'https://m.atcdn.co.uk/a/media/508e620dc10e4e0fa819f9021ef0011b.jpg',
'https://m.atcdn.co.uk/a/media/754973a2f3eb4ba0b0f115d5586c3603.jpg',
'https://m.atcdn.co.uk/a/media/85acac3576df4360ac49f03542824122.jpg',
'https://m.atcdn.co.uk/a/media/e72a0c4d1b414132aa1fe6daa0858e9d.jpg',
'https://m.atcdn.co.uk/a/media/907bfdbfff344040a7eaa8e677f1e61e.jpg',
'https://m.atcdn.co.uk/a/media/575c0f724ef74fbba9b71a915a30a986.jpg',
'https://m.atcdn.co.uk/a/media/f596ae7db1f841e3a9c207dd35390d58.jpg',
'https://m.atcdn.co.uk/a/media/1f2d970a53244d708889298543bfc782.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182232,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9a419198171460aba516a98e27cac7c.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430482,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1dc98165b2f44cbab48c7195e1fd5adb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297078,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/508e620dc10e4e0fa819f9021ef0011b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531478,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/754973a2f3eb4ba0b0f115d5586c3603.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517716,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85acac3576df4360ac49f03542824122.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559199,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e72a0c4d1b414132aa1fe6daa0858e9d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603479,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/907bfdbfff344040a7eaa8e677f1e61e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389549,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/575c0f724ef74fbba9b71a915a30a986.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347196,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f596ae7db1f841e3a9c207dd35390d58.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e26a9ad6-aac0-5269-9c5e-899a19ca5e81/e26a9ad6-aac0-5269-9c5e-899a19ca5e81_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407314,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1f2d970a53244d708889298543bfc782.jpg',
'Width': 2048}],
'price': 10195,
'price_includes_vat': True,
'registration_date': '2019-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2019}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511258136021%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511258136021: {'created_time': 1774883901.377205, 'last_price_update_time': 1774883901.377215}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258136021') HTTP/1.1" 204 0
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3c383a47-975f-548c-84bd-6493bb1fae42 with identifier 202602260251124
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3c383a47-975f-548c-84bd-6493bb1fae42
2026-03-30 15:18:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'Blue',
'currency': 'GBP',
'description': '2010 Honda Jazz 1.2 i-VTEC S Hatchback 5dr Petrol Manual '
',67210 Miles, SERVICE HISTORY, Mot--05/11/26 ,Manual , Low '
'Insurance ,Reverse Parking Sensors, AUX-in Socket , Air con '
',Power Steering ,Central Locking, Immobiliser, CD player '
',MP3, Height adjustable drivers seat.',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.2L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': '3c383a47-975f-548c-84bd-6493bb1fae42',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260251124',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Honda',
'model': 'Jazz',
'odometer': 67200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ab6c48269509424e9d91657c8e1553ce.jpg',
'https://m.atcdn.co.uk/a/media/9f07ecf96277494a8dc61e597cfb35b2.jpg',
'https://m.atcdn.co.uk/a/media/527eeaccb52543f68f0b40ce494e8ec5.jpg',
'https://m.atcdn.co.uk/a/media/ff051e081f494735b4ad015cab119601.jpg',
'https://m.atcdn.co.uk/a/media/0d694f3ac33846e99330ba97ca4fbfe4.jpg',
'https://m.atcdn.co.uk/a/media/6decb8a100aa4a36bb9e745c8d5415bb.jpg',
'https://m.atcdn.co.uk/a/media/322680f1684847d8b57e2b6df7f5cbea.jpg',
'https://m.atcdn.co.uk/a/media/1604bfaa8e6e4909ac2d2dda979d8bbb.jpg',
'https://m.atcdn.co.uk/a/media/6ce219155d8b468ab02a0ae66507a11d.jpg',
'https://m.atcdn.co.uk/a/media/c13a49ef146a404cb033baf02cc54ac6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364913,
'Height': 1362,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab6c48269509424e9d91657c8e1553ce.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350077,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f07ecf96277494a8dc61e597cfb35b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424106,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/527eeaccb52543f68f0b40ce494e8ec5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437088,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ff051e081f494735b4ad015cab119601.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384063,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d694f3ac33846e99330ba97ca4fbfe4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 532405,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6decb8a100aa4a36bb9e745c8d5415bb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422923,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/322680f1684847d8b57e2b6df7f5cbea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441537,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1604bfaa8e6e4909ac2d2dda979d8bbb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474240,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ce219155d8b468ab02a0ae66507a11d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c383a47-975f-548c-84bd-6493bb1fae42/3c383a47-975f-548c-84bd-6493bb1fae42_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541777,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c13a49ef146a404cb033baf02cc54ac6.jpg',
'Width': 2048}],
'price': 3495,
'price_includes_vat': True,
'registration_date': '2010-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Jazz 1.2 i-VTEC S Euro 4 5dr',
'transmission': 'manual',
'trim': 'S',
'year': 2010}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260251124%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260251124: {'created_time': 1774883901.423426, 'last_price_update_time': 1774883901.423437}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260251124') HTTP/1.1" 204 0
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 66138f9c-9212-5a9b-91c8-2d2b99f143dd with identifier: 202602079761897
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66138f9c-9212-5a9b-91c8-2d2b99f143dd
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48b42452aa484e8887e6d9fc0acd7d38.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48b42452aa484e8887e6d9fc0acd7d38.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02496fa07ea6401d9465e6c448ece0fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02496fa07ea6401d9465e6c448ece0fd.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F076d5542db3b48749cb09cd76ff01398.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/076d5542db3b48749cb09cd76ff01398.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F975764413d2c432ba5121e1ed4f63bdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/975764413d2c432ba5121e1ed4f63bdb.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c2996fa5387463088ec3cf4fc496be4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c2996fa5387463088ec3cf4fc496be4.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5043a2db80e4def9ebc0382d347f6cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5043a2db80e4def9ebc0382d347f6cc.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa258b5a1179446a180dd3c37ca278d5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a258b5a1179446a180dd3c37ca278d5f.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F962071f0798c45d292c5185e9a139278.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/962071f0798c45d292c5185e9a139278.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ff1fb57852d4845a43fb589fce6c252.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ff1fb57852d4845a43fb589fce6c252.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F948d108b852248d78954b944d13d478d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/948d108b852248d78954b944d13d478d.jpg already downloaded
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5df4c757-43ab-5e01-a449-f789f8b6c501 with identifier: 202510217323078
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5df4c757-43ab-5e01-a449-f789f8b6c501
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2023e33f431049078243d65d840c3cda.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2023e33f431049078243d65d840c3cda.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9225ae1c779146f681eeaa5b62a73e7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9225ae1c779146f681eeaa5b62a73e7d.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F51c61def16b74e778ab12e585f9d6018.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/51c61def16b74e778ab12e585f9d6018.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf2db0424c9f4735b9c1b2df317cc47c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf2db0424c9f4735b9c1b2df317cc47c.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F92aaa93161d348bf8afdf30cdcb7a1bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/92aaa93161d348bf8afdf30cdcb7a1bc.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b8221bfe8e647119ad1f0390c1a0394.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b8221bfe8e647119ad1f0390c1a0394.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7a4384d08682420993420849b747ccdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7a4384d08682420993420849b747ccdf.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F504a106f7e46403791495c929853203f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/504a106f7e46403791495c929853203f.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F99471e2bb2ed46c78de2651aa4c419b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/99471e2bb2ed46c78de2651aa4c419b2.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad169631e53749b986059dea5e64a940.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad169631e53749b986059dea5e64a940.jpg already downloaded
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 66138f9c-9212-5a9b-91c8-2d2b99f143dd with identifier 202602079761897
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 66138f9c-9212-5a9b-91c8-2d2b99f143dd
2026-03-30 15:18:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2017 Toyota RAV4 VVT-h Business Edition Plus presents an '
'exceptional opportunity with its remarkably low mileage of '
'just 43,942 miles. This Euro 6 compliant 2.5 litre petrol '
'hybrid model offers a sophisticated driving experience, '
'enhanced by desirable features such as a detachable towbar '
'with 13 pin wiring, a Style Pack, and the convenience of a '
'keyless entry system with push button start. Navigating tight '
'spaces is made effortless thanks to front and rear parking '
'sensors, while Bluetooth connectivity ensures you stay '
'connected on the go. 1 Previous Owner ,MOT Till '
'01/11/2026,FULL TOYOTA SERVICE HISTORY ,Heated Seats, Eco '
'Mode ,Sports Mode Driving ,Alloy Wheels ,SAT-NAV ,Reverse '
'Camera and Sensors, Toyota Park Assist, Blue tooth, Cruise '
'Control ,folding Mirrors, Mp3 , Aux Music Ports, DAB Digital '
'Radio, Isofix, All Electric Windows Engine Start/Stop '
'Button,\n'
'\n'
'The RAV4 Business Edition Plus stands out with its impressive '
'fuel economy, achieving an excellent 58 miles per gallon, '
'which is better than many comparable vehicles. Its '
'acceleration is also noteworthy, reaching 0 to 62 miles per '
'hour in a swift 8.4 seconds, demonstrating a strong balance '
'of performance and efficiency. Furthermore, the generous boot '
'space provides ample room for all your luggage or shopping '
'needs, making this RAV4 a practical and capable choice for '
'everyday life and longer journeys.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 194,
'fuel_type': 'Petrol Hybrid',
'id': '66138f9c-9212-5a9b-91c8-2d2b99f143dd',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602079761897',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Toyota',
'model': 'RAV4',
'odometer': 43942,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/48b42452aa484e8887e6d9fc0acd7d38.jpg',
'https://m.atcdn.co.uk/a/media/02496fa07ea6401d9465e6c448ece0fd.jpg',
'https://m.atcdn.co.uk/a/media/076d5542db3b48749cb09cd76ff01398.jpg',
'https://m.atcdn.co.uk/a/media/975764413d2c432ba5121e1ed4f63bdb.jpg',
'https://m.atcdn.co.uk/a/media/2c2996fa5387463088ec3cf4fc496be4.jpg',
'https://m.atcdn.co.uk/a/media/f5043a2db80e4def9ebc0382d347f6cc.jpg',
'https://m.atcdn.co.uk/a/media/a258b5a1179446a180dd3c37ca278d5f.jpg',
'https://m.atcdn.co.uk/a/media/962071f0798c45d292c5185e9a139278.jpg',
'https://m.atcdn.co.uk/a/media/5ff1fb57852d4845a43fb589fce6c252.jpg',
'https://m.atcdn.co.uk/a/media/948d108b852248d78954b944d13d478d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196495,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/48b42452aa484e8887e6d9fc0acd7d38.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403650,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/02496fa07ea6401d9465e6c448ece0fd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323645,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/076d5542db3b48749cb09cd76ff01398.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291941,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/975764413d2c432ba5121e1ed4f63bdb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397742,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c2996fa5387463088ec3cf4fc496be4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413882,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f5043a2db80e4def9ebc0382d347f6cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 468431,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a258b5a1179446a180dd3c37ca278d5f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375692,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/962071f0798c45d292c5185e9a139278.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405242,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5ff1fb57852d4845a43fb589fce6c252.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66138f9c-9212-5a9b-91c8-2d2b99f143dd/66138f9c-9212-5a9b-91c8-2d2b99f143dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458941,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/948d108b852248d78954b944d13d478d.jpg',
'Width': 2048}],
'price': 15750,
'price_includes_vat': True,
'registration_date': '2017-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV4 2.5 VVT-h Business Edition Plus CVT Euro 6 (s/s) 5dr '
'(Safety Sense, Nav)',
'transmission': 'automatic',
'trim': 'Business Edition Plus',
'year': 2017}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079761897%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602079761897: {'created_time': 1774883901.806835, 'last_price_update_time': 1774883901.806844}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079761897') HTTP/1.1" 204 0
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5df4c757-43ab-5e01-a449-f789f8b6c501 with identifier 202510217323078
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5df4c757-43ab-5e01-a449-f789f8b6c501
2026-03-30 15:18:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'White',
'currency': 'GBP',
'description': '2018 Volkswagen T-Roc 1.5 TSI EVO SEL SUV 5dr Petrol Manual '
'Euro 6, FULL SERVICE HISTORY, 1 Previous owner, 70118 Miles , '
'Manual, Front & Rear Parking sensor ,MOT--1 YEAR, Large boot '
'Space , Phone Bluetooth, Apple car play and Android Auto, DAB '
'Digital Radio, AUX-in Socket ,USP Port, Air con ,Power '
'Steering ,Lane Assist, Echo ,dynamic & Sports Mode of '
'Driving, Automatic Headlights, Remote Central Locking, '
'Immobiliser, Car-Net Security and Service including eCall, '
'Height adjustable drivers seat.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '5df4c757-43ab-5e01-a449-f789f8b6c501',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510217323078',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 70118,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 70,
'photo_urls': ['https://m.atcdn.co.uk/a/media/2023e33f431049078243d65d840c3cda.jpg',
'https://m.atcdn.co.uk/a/media/9225ae1c779146f681eeaa5b62a73e7d.jpg',
'https://m.atcdn.co.uk/a/media/51c61def16b74e778ab12e585f9d6018.jpg',
'https://m.atcdn.co.uk/a/media/cf2db0424c9f4735b9c1b2df317cc47c.jpg',
'https://m.atcdn.co.uk/a/media/92aaa93161d348bf8afdf30cdcb7a1bc.jpg',
'https://m.atcdn.co.uk/a/media/6b8221bfe8e647119ad1f0390c1a0394.jpg',
'https://m.atcdn.co.uk/a/media/7a4384d08682420993420849b747ccdf.jpg',
'https://m.atcdn.co.uk/a/media/504a106f7e46403791495c929853203f.jpg',
'https://m.atcdn.co.uk/a/media/99471e2bb2ed46c78de2651aa4c419b2.jpg',
'https://m.atcdn.co.uk/a/media/ad169631e53749b986059dea5e64a940.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357068,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2023e33f431049078243d65d840c3cda.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338388,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/51c61def16b74e778ab12e585f9d6018.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345218,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf2db0424c9f4735b9c1b2df317cc47c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361197,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/92aaa93161d348bf8afdf30cdcb7a1bc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287283,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b8221bfe8e647119ad1f0390c1a0394.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478876,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7a4384d08682420993420849b747ccdf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510664,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9225ae1c779146f681eeaa5b62a73e7d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325879,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/504a106f7e46403791495c929853203f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 531838,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/99471e2bb2ed46c78de2651aa4c419b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5df4c757-43ab-5e01-a449-f789f8b6c501/5df4c757-43ab-5e01-a449-f789f8b6c501_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372695,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad169631e53749b986059dea5e64a940.jpg',
'Width': 2048}],
'price': 11995,
'price_includes_vat': True,
'registration_date': '2018-05-01',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI EVO SEL Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SEL',
'year': 2018}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510217323078%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510217323078: {'created_time': 1774883901.850651, 'last_price_update_time': 1774883901.85066}
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510217323078') HTTP/1.1" 204 0
2026-03-30 15:18:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 32ac3836-a745-5e2c-af0b-943ca9c5ea5a with identifier: 202601289500817
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32ac3836-a745-5e2c-af0b-943ca9c5ea5a
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43172bac6cf747768b04150c15a6ebfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43172bac6cf747768b04150c15a6ebfa.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1cf7e1de51fe4fcb8384c6803ce5a455.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1cf7e1de51fe4fcb8384c6803ce5a455.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0fd82d0836bc4f38b3e17f04817c71c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0fd82d0836bc4f38b3e17f04817c71c5.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19a216037b514a93afe7ac6f3fe2ac45.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19a216037b514a93afe7ac6f3fe2ac45.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13a197df438341819fbcfe5386bc6f3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13a197df438341819fbcfe5386bc6f3b.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1edc72222be9439fa7ed94db0ad85ed2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1edc72222be9439fa7ed94db0ad85ed2.jpg already downloaded
2026-03-30 15:18:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fce059ba8803d47188044ffe500c37112.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ce059ba8803d47188044ffe500c37112.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1581258ae48b45dd82ed97c1c5b0aa37.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1581258ae48b45dd82ed97c1c5b0aa37.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7fcb978f59de4ce49a2819f118e2b619.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7fcb978f59de4ce49a2819f118e2b619.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0fc0a20b6684f519bee3ffea3e1a04d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0fc0a20b6684f519bee3ffea3e1a04d.jpg already downloaded
2026-03-30 15:18:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 32ac3836-a745-5e2c-af0b-943ca9c5ea5a with identifier 202601289500817
2026-03-30 15:18:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 32ac3836-a745-5e2c-af0b-943ca9c5ea5a
2026-03-30 15:18:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'Red',
'currency': 'GBP',
'description': '2014 Toyota Yaris 1.33 Dual VVT-i Icon Hatchback 5dr Petrol '
'Manual ,94882 Miles, 1 Previous owner, Mot --22/12/2026 ,Full '
'Service History With 8 Toyota Services and 3 local garages, '
'Lcd Touch Screen display, Reverse Camera, Sat-Nav, AUX-in '
'Socket ,Phone Blue Tooth, Air con ,Power Steering '
',Immobiliser, MP3, Isofix , USP, Height adjustable drivers '
'seat .',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.33L',
'engine_horse_power': 98,
'fuel_type': 'Petrol',
'id': '32ac3836-a745-5e2c-af0b-943ca9c5ea5a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289500817',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 94882,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 34,
'photo_urls': ['https://m.atcdn.co.uk/a/media/43172bac6cf747768b04150c15a6ebfa.jpg',
'https://m.atcdn.co.uk/a/media/1cf7e1de51fe4fcb8384c6803ce5a455.jpg',
'https://m.atcdn.co.uk/a/media/0fd82d0836bc4f38b3e17f04817c71c5.jpg',
'https://m.atcdn.co.uk/a/media/19a216037b514a93afe7ac6f3fe2ac45.jpg',
'https://m.atcdn.co.uk/a/media/13a197df438341819fbcfe5386bc6f3b.jpg',
'https://m.atcdn.co.uk/a/media/1edc72222be9439fa7ed94db0ad85ed2.jpg',
'https://m.atcdn.co.uk/a/media/ce059ba8803d47188044ffe500c37112.jpg',
'https://m.atcdn.co.uk/a/media/1581258ae48b45dd82ed97c1c5b0aa37.jpg',
'https://m.atcdn.co.uk/a/media/7fcb978f59de4ce49a2819f118e2b619.jpg',
'https://m.atcdn.co.uk/a/media/c0fc0a20b6684f519bee3ffea3e1a04d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305550,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/43172bac6cf747768b04150c15a6ebfa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329985,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1cf7e1de51fe4fcb8384c6803ce5a455.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272056,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0fd82d0836bc4f38b3e17f04817c71c5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419324,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/19a216037b514a93afe7ac6f3fe2ac45.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 491297,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13a197df438341819fbcfe5386bc6f3b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294432,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1edc72222be9439fa7ed94db0ad85ed2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492105,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ce059ba8803d47188044ffe500c37112.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439399,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1581258ae48b45dd82ed97c1c5b0aa37.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402723,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7fcb978f59de4ce49a2819f118e2b619.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32ac3836-a745-5e2c-af0b-943ca9c5ea5a/32ac3836-a745-5e2c-af0b-943ca9c5ea5a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359095,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c0fc0a20b6684f519bee3ffea3e1a04d.jpg',
'Width': 2048}],
'price': 4895,
'price_includes_vat': True,
'registration_date': '2014-12-23',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.33 Dual VVT-i Icon Euro 5 5dr Euro 5',
'transmission': 'manual',
'trim': 'Icon',
'year': 2014}
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289500817%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289500817: {'created_time': 1774883902.095384, 'last_price_update_time': 1774883902.095395}
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289500817') HTTP/1.1" 204 0
2026-03-30 15:18:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 425e0079-c243-5393-a24e-fbf1337a544c with identifier: 202601179229665
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 425e0079-c243-5393-a24e-fbf1337a544c
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F04904cab591249e7a1686fda6c7d4131.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/04904cab591249e7a1686fda6c7d4131.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F549fdb08b7484f82904e938724a6c44d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/549fdb08b7484f82904e938724a6c44d.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c59fc9f4641429795248ed01d2c2621.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c59fc9f4641429795248ed01d2c2621.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3815721d1a540fd81dd01a0e7758e6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3815721d1a540fd81dd01a0e7758e6e.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc59bf075cd444054a512cd43acda953f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c59bf075cd444054a512cd43acda953f.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff03e2c126e964d868d336976f04d0d45.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f03e2c126e964d868d336976f04d0d45.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F42a78090b62346c2b0de9a35fe8430fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/42a78090b62346c2b0de9a35fe8430fb.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fced4069f110143e893c976864f3cf940.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ced4069f110143e893c976864f3cf940.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb4dbd267b900437f9be289feaee4dd4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b4dbd267b900437f9be289feaee4dd4c.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09cf3b47eb0d4e79a8ec05aacea34749.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09cf3b47eb0d4e79a8ec05aacea34749.jpg already downloaded
2026-03-30 15:18:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 425e0079-c243-5393-a24e-fbf1337a544c with identifier 202601179229665
2026-03-30 15:18:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 425e0079-c243-5393-a24e-fbf1337a544c
2026-03-30 15:18:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'White',
'currency': 'GBP',
'description': '2017 Nissan Qashqai 1.6 DIG-T N-Connecta SUV 5dr Petrol '
'Manual,1.6 Petrol, 49630 Miles ,2 Previous owner, Service '
'history ,In built BLUETOOTH FOR PHONES ,USP PORT, SAT-NAV, '
"Reverse Camera & 360' View Camera, Front and Reverse parking "
'sensor, Aux in, air con, 16" alloy wheels, Lumbar support, '
'Immobiliser, Child locks & Isofix system , Cruise control '
',Electric front/rear windows, Radio + CD ,climate control, '
"PAS, Alarm, Driver's lumbar support, 3 Months Warranty ,5 "
'Day Driveway Insurance , HPI Clear , cards accepted, '
'Finance arranged More cars at CHANSCARS.CO.UK .Viewing '
'possible 7 days a week call 07548722574',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 161,
'fuel_type': 'Petrol',
'id': '425e0079-c243-5393-a24e-fbf1337a544c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601179229665',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 49360,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photo_urls': ['https://m.atcdn.co.uk/a/media/04904cab591249e7a1686fda6c7d4131.jpg',
'https://m.atcdn.co.uk/a/media/549fdb08b7484f82904e938724a6c44d.jpg',
'https://m.atcdn.co.uk/a/media/0c59fc9f4641429795248ed01d2c2621.jpg',
'https://m.atcdn.co.uk/a/media/f3815721d1a540fd81dd01a0e7758e6e.jpg',
'https://m.atcdn.co.uk/a/media/c59bf075cd444054a512cd43acda953f.jpg',
'https://m.atcdn.co.uk/a/media/f03e2c126e964d868d336976f04d0d45.jpg',
'https://m.atcdn.co.uk/a/media/42a78090b62346c2b0de9a35fe8430fb.jpg',
'https://m.atcdn.co.uk/a/media/ced4069f110143e893c976864f3cf940.jpg',
'https://m.atcdn.co.uk/a/media/b4dbd267b900437f9be289feaee4dd4c.jpg',
'https://m.atcdn.co.uk/a/media/09cf3b47eb0d4e79a8ec05aacea34749.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168380,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/04904cab591249e7a1686fda6c7d4131.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453346,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/549fdb08b7484f82904e938724a6c44d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339799,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c59fc9f4641429795248ed01d2c2621.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277318,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3815721d1a540fd81dd01a0e7758e6e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429298,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c59bf075cd444054a512cd43acda953f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427449,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f03e2c126e964d868d336976f04d0d45.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390499,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/42a78090b62346c2b0de9a35fe8430fb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433879,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ced4069f110143e893c976864f3cf940.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461773,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b4dbd267b900437f9be289feaee4dd4c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425e0079-c243-5393-a24e-fbf1337a544c/425e0079-c243-5393-a24e-fbf1337a544c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423422,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09cf3b47eb0d4e79a8ec05aacea34749.jpg',
'Width': 2048}],
'price': 9995,
'price_includes_vat': True,
'registration_date': '2017-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 DIG-T N-Connecta Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2017}
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601179229665%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601179229665: {'created_time': 1774883902.316794, 'last_price_update_time': 1774883902.316804}
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601179229665') HTTP/1.1" 204 0
2026-03-30 15:18:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:18:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fd516f73-20a8-5f30-82c6-39a656616066 with identifier: 202601048918383
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd516f73-20a8-5f30-82c6-39a656616066
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2bdccb2b6ac44319bcf4bbb1c80a0c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2bdccb2b6ac44319bcf4bbb1c80a0c1.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F392bd863d37b49608243e8718586dbf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/392bd863d37b49608243e8718586dbf7.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad237edd93674c25b43b104e3b8c3bfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad237edd93674c25b43b104e3b8c3bfe.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6533f0a28cd94e349e857e117f52737f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6533f0a28cd94e349e857e117f52737f.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5d8183da4cfa4df09815a2680d8c1eb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5d8183da4cfa4df09815a2680d8c1eb1.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F76c1a4d0ad5544e5bf3f7664be2e58c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/76c1a4d0ad5544e5bf3f7664be2e58c1.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77457d250686459db7efd424c9846188.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77457d250686459db7efd424c9846188.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fda7540ca5a6146d5b095f6822c02fff0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/da7540ca5a6146d5b095f6822c02fff0.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fadf3b899ff4846e1a711957b53792794.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/adf3b899ff4846e1a711957b53792794.jpg already downloaded
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb788922522134e479ee6d078163266d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b788922522134e479ee6d078163266d7.jpg already downloaded
2026-03-30 15:18:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fd516f73-20a8-5f30-82c6-39a656616066 with identifier 202601048918383
2026-03-30 15:18:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fd516f73-20a8-5f30-82c6-39a656616066
2026-03-30 15:18:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 101,
'color': 'Blue',
'currency': 'GBP',
'description': 'chans cars ltd is pleased to present yourself with this '
'outstanding 2018 Lexus CT 1.8 200h Luxury Hatchback 5dr '
'Petrol Hybrid CVT With 78468 Miles, FULL Lexus Service '
'History,1 Previous Owners .you can be confident this car is '
'in great condition With the Service History, MOT Until '
'26/09/2026 .There are many Great features in this car like '
'Heater Seats, Sat-Nav, Reverse Parking Camera, Front and rear '
'parking sensors, ECO And Sports Mode Driving ,The Blue Tooth '
', lane Assist. We really do care about our customers & in '
'recognition To That we have Received Autotrader "customer '
'choice Award" For 6 Years. We Strive to deliver the best '
'possible customer experience, but don’t take our words for '
'it, read our 229 + great reviews! We present our cars to You '
'with High Standard Preparations. Our commitments to Price '
'And working With Autotrader Means Our Stocks Are Monitored '
'Daily and All Priced At "Good”, “Great" Price. For yours & '
'our Peace of Mind all our cars Are Pre-Inspected And '
'necessary vehicle data checks are Checked',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.8L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': 'fd516f73-20a8-5f30-82c6-39a656616066',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601048918383',
'listing': 'directbuy',
'location': 'Sutton, Surrey',
'make': 'Lexus',
'model': 'CT',
'odometer': 78468,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 69,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d2bdccb2b6ac44319bcf4bbb1c80a0c1.jpg',
'https://m.atcdn.co.uk/a/media/392bd863d37b49608243e8718586dbf7.jpg',
'https://m.atcdn.co.uk/a/media/ad237edd93674c25b43b104e3b8c3bfe.jpg',
'https://m.atcdn.co.uk/a/media/6533f0a28cd94e349e857e117f52737f.jpg',
'https://m.atcdn.co.uk/a/media/5d8183da4cfa4df09815a2680d8c1eb1.jpg',
'https://m.atcdn.co.uk/a/media/76c1a4d0ad5544e5bf3f7664be2e58c1.jpg',
'https://m.atcdn.co.uk/a/media/77457d250686459db7efd424c9846188.jpg',
'https://m.atcdn.co.uk/a/media/da7540ca5a6146d5b095f6822c02fff0.jpg',
'https://m.atcdn.co.uk/a/media/adf3b899ff4846e1a711957b53792794.jpg',
'https://m.atcdn.co.uk/a/media/b788922522134e479ee6d078163266d7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232089,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2bdccb2b6ac44319bcf4bbb1c80a0c1.jpg',
'Width': 1080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486084,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/392bd863d37b49608243e8718586dbf7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341075,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad237edd93674c25b43b104e3b8c3bfe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 528678,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6533f0a28cd94e349e857e117f52737f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552282,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5d8183da4cfa4df09815a2680d8c1eb1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507260,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/76c1a4d0ad5544e5bf3f7664be2e58c1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283740,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/77457d250686459db7efd424c9846188.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385553,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/da7540ca5a6146d5b095f6822c02fff0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396894,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/adf3b899ff4846e1a711957b53792794.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd516f73-20a8-5f30-82c6-39a656616066/fd516f73-20a8-5f30-82c6-39a656616066_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536030,
'Height': 1363,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b788922522134e479ee6d078163266d7.jpg',
'Width': 2048}],
'price': 11595,
'price_includes_vat': True,
'registration_date': '2018-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus CT 1.8 200h Luxury E-CVT Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2018}
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601048918383%27 HTTP/1.1" 200 None
2026-03-30 15:18:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601048918383: {'created_time': 1774883902.531472, 'last_price_update_time': 1774883902.531482}
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601048918383') HTTP/1.1" 204 0
2026-03-30 15:18:22 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:18:22 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:18:22 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:18:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:18:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4afb021a2c1f11f18e133aacc95538c6
2026-03-30 15:18:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:18:22 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:18:22 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:18:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:18:22 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-30 15:18:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:18:22 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587903 HTTP/1.1" 200 None
2026-03-30 15:18:23 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (23 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4afb021a2c1f11f18e133aacc95538c6.jl
2026-03-30 15:18:23 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 179248,
'downloader/request_count': 5,
'downloader/request_method_count/POST': 5,
'downloader/response_bytes': 1090764,
'downloader/response_count': 5,
'downloader/response_status_count/200': 5,
'elapsed_time_seconds': 15.645917,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 15, 18, 23, 253171, tzinfo=datetime.timezone.utc),
'item_scraped_count': 23,
'log_count/DEBUG': 725,
'log_count/ERROR': 4,
'log_count/INFO': 434,
'memusage/max': 149528576,
'memusage/startup': 149528576,
'request_depth_max': 2,
'response_received_count': 5,
'scheduler/dequeued': 5,
'scheduler/dequeued/memory': 5,
'scheduler/enqueued': 5,
'scheduler/enqueued/memory': 5,
'scrape_type/new': 23,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 5,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.7695831011980772,
'scrapy-zyte-api/mean_response_seconds': 2.099335866048932,
'scrapy-zyte-api/processed': 5,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 5,
'scrapy-zyte-api/request_args/experimental.requestCookies': 4,
'scrapy-zyte-api/request_args/experimental.responseCookies': 5,
'scrapy-zyte-api/request_args/httpRequestBody': 5,
'scrapy-zyte-api/request_args/httpRequestMethod': 5,
'scrapy-zyte-api/request_args/httpResponseBody': 5,
'scrapy-zyte-api/request_args/httpResponseHeaders': 5,
'scrapy-zyte-api/request_args/url': 5,
'scrapy-zyte-api/status_codes/200': 5,
'scrapy-zyte-api/success': 5,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 30, 15, 18, 7, 607254, tzinfo=datetime.timezone.utc)}
2026-03-30 15:18:23 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:18:23 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f1cf8963590>
2026-03-30 15:18:23 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f1cf8963e10>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)