PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)

2026-03-30 15:07:47 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:07:47 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:07:47 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:07:47 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:07:47 [auto_selling_autotrader.co.uk] INFO: _job: 4a6c0c222c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:07:47 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:07:47 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:07:47 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:07:47 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:07:47 [scrapy.extensions.telnet] INFO: Telnet Password: 6b38965aec7cdd67
2026-03-30 15:07:47 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:07:47 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4a6c0c222c1f11f18e133aacc95538c6.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 15:07:47 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:47 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:47 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:07:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:07:47 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:07:47 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:07:47 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:07:47 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:07:47 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:07:47 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:07:47 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:07:47 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-30 15:07:47 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 15:07:47 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:47 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:52 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10043893 and multipost_profile_id: 98d77479-08c0-4a06-9ccb-d72382564d78 and job_id: 4a6c0c222c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10043893&sort=price-asc
2026-03-30 15:07:52 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10043893, page: 1
2026-03-30 15:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Page: 1/2, total results: 24
2026-03-30 15:07:54 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-30 15:07:54 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603291111281%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603291111281: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603291111254%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603291111254: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230922297%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230922297: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170762112%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170762112: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160748077%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160748077: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040394065%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040394065: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603010307990%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603010307990: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250207163%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602250207163: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250207140%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602250207140: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602089769952%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602089769952: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309533952%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601309533952: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480371%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289480371: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199258691%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199258691: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199258645%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199258645: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199258635%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199258635: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601189236979%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601189236979: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601119064269%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601119064269: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601068949474%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601068949474: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127838599%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511127838599: 1
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511027593936%27 HTTP/1.1" 200 None
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511027593936: 1
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-30 15:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-30 15:07:54 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10043893, page: 2
2026-03-30 15:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:56 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:56 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c65d70b-7ce1-52ac-8431-14520126796b with identifier: 202601309533952
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c65d70b-7ce1-52ac-8431-14520126796b
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F57ff4ca6190d4294af3b53cc247442be.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/57ff4ca6190d4294af3b53cc247442be.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe39c22f68bb24992b5cfcd07f4a2c9a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e39c22f68bb24992b5cfcd07f4a2c9a5.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd83b0a68902a41cbadf04cd7e5db4e93.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d83b0a68902a41cbadf04cd7e5db4e93.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a1f7f410d2641dcb829d68c0ef40abb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a1f7f410d2641dcb829d68c0ef40abb.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb96e1d608b784ad38975fea9185e0fa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b96e1d608b784ad38975fea9185e0fa1.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb74594588aad46fab9103fb3ab0ac78b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b74594588aad46fab9103fb3ab0ac78b.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa203fc8f8c644e54a43ce1e7f4cefe35.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a203fc8f8c644e54a43ce1e7f4cefe35.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9f24c1bb94849c7ae1cfa1d653d9465.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9f24c1bb94849c7ae1cfa1d653d9465.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa5d17c627356484a9bd66e6f8305ecf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a5d17c627356484a9bd66e6f8305ecf3.jpg already downloaded
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3db28600410748f1af559321f111eced.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3db28600410748f1af559321f111eced.jpg already downloaded
2026-03-30 15:07:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5c65d70b-7ce1-52ac-8431-14520126796b with identifier 202601309533952
2026-03-30 15:07:56 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:07:56 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:07:56 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:07:56 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:07:56 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:07:56 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:56 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:56 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:56 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:56 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:07:56 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:07:56 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:07:56 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:56 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:57 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2029
2026-03-30 15:07:57 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883277
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883277
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:57 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5c65d70b-7ce1-52ac-8431-14520126796b
2026-03-30 15:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 187,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 296,
 'fuel_type': 'Petrol Hybrid',
 'id': '5c65d70b-7ce1-52ac-8431-14520126796b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601309533952',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 105000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/57ff4ca6190d4294af3b53cc247442be.jpg',
                'https://m.atcdn.co.uk/a/media/e39c22f68bb24992b5cfcd07f4a2c9a5.jpg',
                'https://m.atcdn.co.uk/a/media/d83b0a68902a41cbadf04cd7e5db4e93.jpg',
                'https://m.atcdn.co.uk/a/media/6a1f7f410d2641dcb829d68c0ef40abb.jpg',
                'https://m.atcdn.co.uk/a/media/b96e1d608b784ad38975fea9185e0fa1.jpg',
                'https://m.atcdn.co.uk/a/media/b74594588aad46fab9103fb3ab0ac78b.jpg',
                'https://m.atcdn.co.uk/a/media/a203fc8f8c644e54a43ce1e7f4cefe35.jpg',
                'https://m.atcdn.co.uk/a/media/f9f24c1bb94849c7ae1cfa1d653d9465.jpg',
                'https://m.atcdn.co.uk/a/media/a5d17c627356484a9bd66e6f8305ecf3.jpg',
                'https://m.atcdn.co.uk/a/media/3db28600410748f1af559321f111eced.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374255,
             'Height': 1487,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/57ff4ca6190d4294af3b53cc247442be.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230926,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e39c22f68bb24992b5cfcd07f4a2c9a5.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412513,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d83b0a68902a41cbadf04cd7e5db4e93.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400561,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6a1f7f410d2641dcb829d68c0ef40abb.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383932,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b96e1d608b784ad38975fea9185e0fa1.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402480,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b74594588aad46fab9103fb3ab0ac78b.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346904,
             'Height': 1447,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a203fc8f8c644e54a43ce1e7f4cefe35.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378799,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9f24c1bb94849c7ae1cfa1d653d9465.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222390,
             'Height': 1483,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a5d17c627356484a9bd66e6f8305ecf3.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c65d70b-7ce1-52ac-8431-14520126796b/5c65d70b-7ce1-52ac-8431-14520126796b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213717,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3db28600410748f1af559321f111eced.jpg',
             'Width': 1920}],
 'price': 16695,
 'price_includes_vat': True,
 'registration_date': '2022-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 B6 MHEV Estate 5dr Petrol Hybrid Auto '
          'AWD Euro 6 (s/s) (300 ps)',
 'transmission': 'automatic',
 'year': 2022}
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309533952%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601309533952: {'created_time': 1774883277.497622, 'last_price_update_time': 1774883277.497637}
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309533952') HTTP/1.1" 204 0
2026-03-30 15:07:57 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: dc44f8d4-b591-59bc-86da-dd4e058ec586 with identifier: 202601289480371
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc44f8d4-b591-59bc-86da-dd4e058ec586
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff7c088a723d84d798b12ef0a6b414322.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f7c088a723d84d798b12ef0a6b414322.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2ff6a4c1d75439882bc2d511f5d8714.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2ff6a4c1d75439882bc2d511f5d8714.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F08ea3477322e460c86a2e75c63571082.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/08ea3477322e460c86a2e75c63571082.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45bd93f39dae4a66b5968e8c255140e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45bd93f39dae4a66b5968e8c255140e8.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1482760ddee74649a4056384b7b47382.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1482760ddee74649a4056384b7b47382.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85a6473cc4734543a2e829c2da3387a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85a6473cc4734543a2e829c2da3387a0.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98a9fe5b28634508bedb9b2badee13f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98a9fe5b28634508bedb9b2badee13f1.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb13a65967da4970abe3f08cc658dfdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb13a65967da4970abe3f08cc658dfdf.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faf5a556307e84980accc3b5536320205.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/af5a556307e84980accc3b5536320205.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F184f1150f44e4d709861dbdd38d1618e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/184f1150f44e4d709861dbdd38d1618e.jpg already downloaded
2026-03-30 15:07:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: dc44f8d4-b591-59bc-86da-dd4e058ec586 with identifier 202601289480371
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item dc44f8d4-b591-59bc-86da-dd4e058ec586
2026-03-30 15:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.2L',
 'engine_horse_power': 199,
 'fuel_type': 'Diesel',
 'id': 'dc44f8d4-b591-59bc-86da-dd4e058ec586',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289480371',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 48000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 24,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/f7c088a723d84d798b12ef0a6b414322.jpg',
                'https://m.atcdn.co.uk/a/media/a2ff6a4c1d75439882bc2d511f5d8714.jpg',
                'https://m.atcdn.co.uk/a/media/08ea3477322e460c86a2e75c63571082.jpg',
                'https://m.atcdn.co.uk/a/media/45bd93f39dae4a66b5968e8c255140e8.jpg',
                'https://m.atcdn.co.uk/a/media/1482760ddee74649a4056384b7b47382.jpg',
                'https://m.atcdn.co.uk/a/media/85a6473cc4734543a2e829c2da3387a0.jpg',
                'https://m.atcdn.co.uk/a/media/98a9fe5b28634508bedb9b2badee13f1.jpg',
                'https://m.atcdn.co.uk/a/media/bb13a65967da4970abe3f08cc658dfdf.jpg',
                'https://m.atcdn.co.uk/a/media/af5a556307e84980accc3b5536320205.jpg',
                'https://m.atcdn.co.uk/a/media/184f1150f44e4d709861dbdd38d1618e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380649,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f7c088a723d84d798b12ef0a6b414322.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346899,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2ff6a4c1d75439882bc2d511f5d8714.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238688,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/08ea3477322e460c86a2e75c63571082.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389858,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/45bd93f39dae4a66b5968e8c255140e8.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371012,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1482760ddee74649a4056384b7b47382.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347224,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/85a6473cc4734543a2e829c2da3387a0.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369412,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/98a9fe5b28634508bedb9b2badee13f1.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335508,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb13a65967da4970abe3f08cc658dfdf.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236135,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/af5a556307e84980accc3b5536320205.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc44f8d4-b591-59bc-86da-dd4e058ec586/dc44f8d4-b591-59bc-86da-dd4e058ec586_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223058,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/184f1150f44e4d709861dbdd38d1618e.jpg',
             'Width': 1920}],
 'price': 26795,
 'price_includes_vat': True,
 'registration_date': '2021-09-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'KIA 2.2 Sorento 3 CRDi AWD Semi-Auto 4WD 5dr',
 'transmission': 'automatic',
 'trim': '3',
 'year': 2021}
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480371%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289480371: {'created_time': 1774883277.87011, 'last_price_update_time': 1774883277.870124}
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289480371') HTTP/1.1" 204 0
2026-03-30 15:07:57 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 303fcffb-95c9-586b-89f2-3a9131631851 with identifier: 202601199258691
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 303fcffb-95c9-586b-89f2-3a9131631851
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2bd329aea6841ecb33e4745b6318cdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2bd329aea6841ecb33e4745b6318cdb.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6a53a50c97849708f41f7ce22580086.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6a53a50c97849708f41f7ce22580086.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdcdbab04caa84014bfe00b2c843d789f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dcdbab04caa84014bfe00b2c843d789f.jpg already downloaded
2026-03-30 15:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1c869548413d4ac89e0dd74a317e8d4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1c869548413d4ac89e0dd74a317e8d4a.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07e3223c3e3c4c3ca321a878ad7a5253.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07e3223c3e3c4c3ca321a878ad7a5253.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb1d83bc7db34be486ac578e2bde27c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db1d83bc7db34be486ac578e2bde27c1.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F700ef52504ac460ebfe226f9a050b8ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/700ef52504ac460ebfe226f9a050b8ce.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F41f4ce4556254e38b88d6cdd87136df5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/41f4ce4556254e38b88d6cdd87136df5.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a3293ad6c844839b71c5dffd3e18633.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a3293ad6c844839b71c5dffd3e18633.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0eed155fe9c464a92231fa7482341ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0eed155fe9c464a92231fa7482341ae.jpg already downloaded
2026-03-30 15:07:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 303fcffb-95c9-586b-89f2-3a9131631851 with identifier 202601199258691
2026-03-30 15:07:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 303fcffb-95c9-586b-89f2-3a9131631851
2026-03-30 15:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 36,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 323,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '303fcffb-95c9-586b-89f2-3a9131631851',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199258691',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Mazda',
 'model': 'CX-80',
 'odometer': 12350,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/d2bd329aea6841ecb33e4745b6318cdb.jpg',
                'https://m.atcdn.co.uk/a/media/c6a53a50c97849708f41f7ce22580086.jpg',
                'https://m.atcdn.co.uk/a/media/dcdbab04caa84014bfe00b2c843d789f.jpg',
                'https://m.atcdn.co.uk/a/media/1c869548413d4ac89e0dd74a317e8d4a.jpg',
                'https://m.atcdn.co.uk/a/media/07e3223c3e3c4c3ca321a878ad7a5253.jpg',
                'https://m.atcdn.co.uk/a/media/db1d83bc7db34be486ac578e2bde27c1.jpg',
                'https://m.atcdn.co.uk/a/media/700ef52504ac460ebfe226f9a050b8ce.jpg',
                'https://m.atcdn.co.uk/a/media/41f4ce4556254e38b88d6cdd87136df5.jpg',
                'https://m.atcdn.co.uk/a/media/0a3293ad6c844839b71c5dffd3e18633.jpg',
                'https://m.atcdn.co.uk/a/media/e0eed155fe9c464a92231fa7482341ae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360216,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2bd329aea6841ecb33e4745b6318cdb.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236936,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6a53a50c97849708f41f7ce22580086.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 445707,
             'Height': 1441,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dcdbab04caa84014bfe00b2c843d789f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377099,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1c869548413d4ac89e0dd74a317e8d4a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365862,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/07e3223c3e3c4c3ca321a878ad7a5253.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406039,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/db1d83bc7db34be486ac578e2bde27c1.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555673,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/700ef52504ac460ebfe226f9a050b8ce.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459893,
             'Height': 1441,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/41f4ce4556254e38b88d6cdd87136df5.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365582,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a3293ad6c844839b71c5dffd3e18633.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_303fcffb-95c9-586b-89f2-3a9131631851/303fcffb-95c9-586b-89f2-3a9131631851_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279240,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0eed155fe9c464a92231fa7482341ae.jpg',
             'Width': 1920}],
 'price': 37490,
 'price_includes_vat': True,
 'registration_date': '2025-03-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mazda 2.5 CX-80 Homura Plus PHEV Auto 4WD 5dr',
 'transmission': 'automatic',
 'trim': 'Homura Plus',
 'year': 2025}
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199258691%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199258691: {'created_time': 1774883278.221146, 'last_price_update_time': 1774883278.221158}
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199258691') HTTP/1.1" 204 0
2026-03-30 15:07:58 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_engine_horse_power: Unknown power unit: None
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 337, in _extract_engine_horse_power
    raise ValueError("Unknown power unit: %s" % unit)
ValueError: Unknown power unit: None
2026-03-30 15:07:58 [common.utils.decorators] ERROR: Payload: {"id": "202601199258645", "stockItemId": "8a42889d9bd60b39019bd6efff751497", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Toyota Estima 2.4 8 SEATER 5dr", "excludePreviousOwners": false, "advertisedLocations": ["at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Toyota Estima", "subtitle": "2.4 8 SEATER 5dr", "__typename": "Heading"}, "attentionGrabber": null, "rrp": null, "price": 11995, "priceGBX": 1199500, "priceExcludingFees": 11995, "priceExcludingFeesGBX": 1199500, "suppliedPrice": 11995, "suppliedPriceGBX": 1199500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2012-09-20", "homeDeliveryRegionCodes": null, "priceExcludingVat": 11995, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": true, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "N*RE", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": false, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "1200", "__typename": "FinanceDefaults"}, "hasFinanceInformation": false, "retailerId": "10043893", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10043893", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 21, "van": 1, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418361442", "__typename": "AssignedNumber"}, "atAwards": [], "branding": {"accreditations": [], "brands": [], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418361442", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.6", "__typename": "Reviews"}, "location": {"addressOne": "71 Clapton Common", "addressTwo": null, "town": "Clapton", "county": "Middlesex", "postcode": "E5 9AA", "latLong": "51.5690476,-0.0626137", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.keecars.co.uk/", "__typename": "Link"}, "phoneNumber1": "(020) 8166 4022", "phoneNumber2": null, "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Keecars", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 13, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/04019ca7b3734496ba160eea1705aa54.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/930d575f4fe94ef0a4a091d7f0ea0b9e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2f88bda8edf8489eaf5ef575ffdcf701.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/044f06d41b1e4df7ba05f0da637f77d8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fec3ccc0ac5c4a8b81c5f442c22d4fbc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7e1987c9597240c6bef981dc955724a7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/11f8673391584af2820400002039bffc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f36b0b4e5ae14b068c88f0b1b13bf720.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b2da550db63546eea7c10222e05a604c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8eee364219a34696afd6e0000f77d91e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/28e498115df8408782ae0f33f3382519.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9d76a413ec6646b8a27488edcaaaa226.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/40c002c8f97f4c1cb3cda307195cfb41.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 59000, "unit": "MILE", "__typename": "Mileage"}, "plate": "62", "year": 2012, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "Keecars", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "CLAPTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(020) 8166 4022", "phoneNumberTwo": null, "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "INCREDIBLE EXAMPLE", "colour": "White", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 1, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": null, "sizeCC": 2, "manufacturerEngineSize": 0, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 8, "axleConfig": null, "ulezCompliant": false, "doors": 5, "bodyType": "Unlisted", "cabType": "Unlisted", "rawBodyType": "Unlisted", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Toyota", "model": "Estima", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "White exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}
2026-03-30 15:07:58 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_co2_emission_value: 'NoneType' object is not subscriptable
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 390, in _extract_co2_emission_value
    return data["specification"]["co2Emissions"]["co2Emission"]
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable
2026-03-30 15:07:58 [common.utils.decorators] ERROR: Payload: {"id": "202601199258645", "stockItemId": "8a42889d9bd60b39019bd6efff751497", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Toyota Estima 2.4 8 SEATER 5dr", "excludePreviousOwners": false, "advertisedLocations": ["at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Toyota Estima", "subtitle": "2.4 8 SEATER 5dr", "__typename": "Heading"}, "attentionGrabber": null, "rrp": null, "price": 11995, "priceGBX": 1199500, "priceExcludingFees": 11995, "priceExcludingFeesGBX": 1199500, "suppliedPrice": 11995, "suppliedPriceGBX": 1199500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2012-09-20", "homeDeliveryRegionCodes": null, "priceExcludingVat": 11995, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": true, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "N*RE", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": false, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "1200", "__typename": "FinanceDefaults"}, "hasFinanceInformation": false, "retailerId": "10043893", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10043893", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 21, "van": 1, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418361442", "__typename": "AssignedNumber"}, "atAwards": [], "branding": {"accreditations": [], "brands": [], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418361442", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.6", "__typename": "Reviews"}, "location": {"addressOne": "71 Clapton Common", "addressTwo": null, "town": "Clapton", "county": "Middlesex", "postcode": "E5 9AA", "latLong": "51.5690476,-0.0626137", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.keecars.co.uk/", "__typename": "Link"}, "phoneNumber1": "(020) 8166 4022", "phoneNumber2": null, "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Keecars", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 13, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/04019ca7b3734496ba160eea1705aa54.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/930d575f4fe94ef0a4a091d7f0ea0b9e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2f88bda8edf8489eaf5ef575ffdcf701.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/044f06d41b1e4df7ba05f0da637f77d8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/fec3ccc0ac5c4a8b81c5f442c22d4fbc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7e1987c9597240c6bef981dc955724a7.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/11f8673391584af2820400002039bffc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f36b0b4e5ae14b068c88f0b1b13bf720.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b2da550db63546eea7c10222e05a604c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/8eee364219a34696afd6e0000f77d91e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Boot", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/28e498115df8408782ae0f33f3382519.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/9d76a413ec6646b8a27488edcaaaa226.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Wheel", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/40c002c8f97f4c1cb3cda307195cfb41.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 59000, "unit": "MILE", "__typename": "Mileage"}, "plate": "62", "year": 2012, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "Keecars", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "CLAPTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(020) 8166 4022", "phoneNumberTwo": null, "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "INCREDIBLE EXAMPLE", "colour": "White", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 1, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": null, "sizeCC": 2, "manufacturerEngineSize": 0, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 8, "axleConfig": null, "ulezCompliant": false, "doors": 5, "bodyType": "Unlisted", "cabType": "Unlisted", "rawBodyType": "Unlisted", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Toyota", "model": "Estima", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "White exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}
2026-03-30 15:07:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 96d89b19-6567-589c-9e58-5cf54d75d01c with identifier: 202601199258645
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96d89b19-6567-589c-9e58-5cf54d75d01c
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F04019ca7b3734496ba160eea1705aa54.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/04019ca7b3734496ba160eea1705aa54.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F930d575f4fe94ef0a4a091d7f0ea0b9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/930d575f4fe94ef0a4a091d7f0ea0b9e.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2f88bda8edf8489eaf5ef575ffdcf701.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2f88bda8edf8489eaf5ef575ffdcf701.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F044f06d41b1e4df7ba05f0da637f77d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/044f06d41b1e4df7ba05f0da637f77d8.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffec3ccc0ac5c4a8b81c5f442c22d4fbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fec3ccc0ac5c4a8b81c5f442c22d4fbc.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7e1987c9597240c6bef981dc955724a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7e1987c9597240c6bef981dc955724a7.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11f8673391584af2820400002039bffc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11f8673391584af2820400002039bffc.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff36b0b4e5ae14b068c88f0b1b13bf720.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f36b0b4e5ae14b068c88f0b1b13bf720.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb2da550db63546eea7c10222e05a604c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b2da550db63546eea7c10222e05a604c.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8eee364219a34696afd6e0000f77d91e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8eee364219a34696afd6e0000f77d91e.jpg already downloaded
2026-03-30 15:07:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 96d89b19-6567-589c-9e58-5cf54d75d01c with identifier 202601199258645
2026-03-30 15:07:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 96d89b19-6567-589c-9e58-5cf54d75d01c
2026-03-30 15:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'color': 'White',
 'currency': 'GBP',
 'description': 'INCREDIBLE EXAMPLE',
 'doors_number': 5,
 'fuel_type': 'Petrol',
 'id': '96d89b19-6567-589c-9e58-5cf54d75d01c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199258645',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Toyota',
 'model': 'Estima',
 'odometer': 59000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 13,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/04019ca7b3734496ba160eea1705aa54.jpg',
                'https://m.atcdn.co.uk/a/media/930d575f4fe94ef0a4a091d7f0ea0b9e.jpg',
                'https://m.atcdn.co.uk/a/media/2f88bda8edf8489eaf5ef575ffdcf701.jpg',
                'https://m.atcdn.co.uk/a/media/044f06d41b1e4df7ba05f0da637f77d8.jpg',
                'https://m.atcdn.co.uk/a/media/fec3ccc0ac5c4a8b81c5f442c22d4fbc.jpg',
                'https://m.atcdn.co.uk/a/media/7e1987c9597240c6bef981dc955724a7.jpg',
                'https://m.atcdn.co.uk/a/media/11f8673391584af2820400002039bffc.jpg',
                'https://m.atcdn.co.uk/a/media/f36b0b4e5ae14b068c88f0b1b13bf720.jpg',
                'https://m.atcdn.co.uk/a/media/b2da550db63546eea7c10222e05a604c.jpg',
                'https://m.atcdn.co.uk/a/media/8eee364219a34696afd6e0000f77d91e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246416,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/04019ca7b3734496ba160eea1705aa54.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238950,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/930d575f4fe94ef0a4a091d7f0ea0b9e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347029,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2f88bda8edf8489eaf5ef575ffdcf701.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282787,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/044f06d41b1e4df7ba05f0da637f77d8.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253004,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fec3ccc0ac5c4a8b81c5f442c22d4fbc.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 214185,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/11f8673391584af2820400002039bffc.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146978,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b2da550db63546eea7c10222e05a604c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231169,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8eee364219a34696afd6e0000f77d91e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218910,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7e1987c9597240c6bef981dc955724a7.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a60b3d4a-00ad-512b-ba72-fcef46fec8e4/a60b3d4a-00ad-512b-ba72-fcef46fec8e4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217512,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f36b0b4e5ae14b068c88f0b1b13bf720.jpg',
             'Width': 1920}],
 'price': 11995,
 'price_includes_vat': True,
 'registration_date': '2012-09-20',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Toyota Estima 2.4 8 SEATER 5dr',
 'transmission': 'automatic',
 'year': 2012}
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199258645%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199258645: {'created_time': 1774883278.507709, 'last_price_update_time': 1774883278.50772}
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199258645') HTTP/1.1" 204 0
2026-03-30 15:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:58 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_engine_horse_power: Unknown power unit: None
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 337, in _extract_engine_horse_power
    raise ValueError("Unknown power unit: %s" % unit)
ValueError: Unknown power unit: None
2026-03-30 15:07:58 [common.utils.decorators] ERROR: Payload: {"id": "202601199258635", "stockItemId": "8a42969a9bd6181b019bd6efa68105d6", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Toyota Estima 2.4 5dr", "excludePreviousOwners": false, "advertisedLocations": ["at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Toyota Estima", "subtitle": "2.4 5dr", "__typename": "Heading"}, "attentionGrabber": null, "rrp": null, "price": 15495, "priceGBX": 1549500, "priceExcludingFees": 15495, "priceExcludingFeesGBX": 1549500, "suppliedPrice": 15495, "suppliedPriceGBX": 1549500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2015-09-01", "homeDeliveryRegionCodes": null, "priceExcludingVat": 15495, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": true, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "N**EG", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": false, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "1550", "__typename": "FinanceDefaults"}, "hasFinanceInformation": false, "retailerId": "10043893", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10043893", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 21, "van": 1, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418361442", "__typename": "AssignedNumber"}, "atAwards": [], "branding": {"accreditations": [], "brands": [], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418361442", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.6", "__typename": "Reviews"}, "location": {"addressOne": "71 Clapton Common", "addressTwo": null, "town": "Clapton", "county": "Middlesex", "postcode": "E5 9AA", "latLong": "51.5690476,-0.0626137", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.keecars.co.uk/", "__typename": "Link"}, "phoneNumber1": "(020) 8166 4022", "phoneNumber2": null, "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Keecars", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 26, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/4af1417109324b5f981b62af3cf424c8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/bd216f86f9b343d69dedcf18d4f1f663.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/49835a24d184402682e039c6561f5312.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/83d7f764aad54895a480cacc69a71dd8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/05df6bf34aff4a4c977ac1b3e11e617d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c87d7544a8704e3890e6da471def8c50.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b0e487003665496e9ed624b3cbd6cd4f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/482671c943364690abdfa7b64a2b62f9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1b5f5eba7198407995df32387b3f6541.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7ec3f9cfa629476cb9cddfd942847840.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/70a269c7ff4f4347810ddbfd342b4a59.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2ecb7f3486544bc1b2e75da0db866f2e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/708a8e6278354659830efe4c310f0bca.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0fc4d175f06245d1abe636197ba0986a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f79cd2d5c1ca4e63b8c3116beb2e848f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/34c59061baec46f0ba644cdc84e951a0.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/925cd7833907439b93b4e7392d93fcdc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d2033a19b1a04288a031d7741591774d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cb9307651c8e42a596ffa45790379031.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/20413f9391824b848aa6b98ec4e1373e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cb3cd74e55ac472694d9ce19becd5f4c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c6bd54f1261245d9b8ff65e551539a04.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/805e4277c63447dc8005ebe5ca02747f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Driver Instruments", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/279596080b6e470cb53e185e0e0a7366.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f5020750276448d4b5f69f5d4e68ad0e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/df47db89598e4c5ab9bf05de595b8ae3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 30000, "unit": "MILE", "__typename": "Mileage"}, "plate": "65", "year": 2015, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "Keecars", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "CLAPTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(020) 8166 4022", "phoneNumberTwo": null, "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "INCREDIBLE EXAMPLE\nLOOKS LIKE ITS NEVER BEEN USED", "colour": "Silver", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 1, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": null, "sizeCC": 2, "manufacturerEngineSize": 0, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 8, "axleConfig": null, "ulezCompliant": false, "doors": 5, "bodyType": "Unlisted", "cabType": "Unlisted", "rawBodyType": "Unlisted", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Toyota", "model": "Estima", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "Silver exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}
2026-03-30 15:07:58 [common.utils.decorators] ERROR: DefaultOnExceptionError in _extract_co2_emission_value: 'NoneType' object is not subscriptable
Traceback (most recent call last):
  File "/usr/src/app/common/utils/decorators.py", line 16, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/autotrader_details_extractor.py", line 390, in _extract_co2_emission_value
    return data["specification"]["co2Emissions"]["co2Emission"]
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not subscriptable
2026-03-30 15:07:58 [common.utils.decorators] ERROR: Payload: {"id": "202601199258635", "stockItemId": "8a42969a9bd6181b019bd6efa68105d6", "isAuction": false, "hoursUsed": null, "serviceHistory": null, "title": "Toyota Estima 2.4 5dr", "excludePreviousOwners": false, "advertisedLocations": ["at_profile", "at_profile_cars", "at_stock_cars", "trade_advertiser_stock"], "dueAtSeller": null, "motExpiry": null, "motInsurance": null, "lastServiceOdometerReadingMiles": null, "lastServiceDate": null, "warrantyMonthsOnPurchase": null, "twelveMonthsMotIncluded": false, "preReg": false, "heading": {"title": "Toyota Estima", "subtitle": "2.4 5dr", "__typename": "Heading"}, "attentionGrabber": null, "rrp": null, "price": 15495, "priceGBX": 1549500, "priceExcludingFees": 15495, "priceExcludingFeesGBX": 1549500, "suppliedPrice": 15495, "suppliedPriceGBX": 1549500, "priceOnApplication": false, "plusVatIndicated": false, "vatStatus": null, "saving": null, "noAdminFees": true, "adminFee": null, "adminFeeInfoDescription": null, "dateOfRegistration": "2015-09-01", "homeDeliveryRegionCodes": null, "priceExcludingVat": 15495, "vatToBePaidUpfront": 0, "capabilities": {"marketExtensionHomeDelivery": null, "marketExtensionClickAndCollect": null, "marketExtensionCentrallyHeld": null, "marketExtensionOem": null, "digitalRetailing": {"enabled": true, "__typename": "DigitalRetailingCapability"}, "__typename": "Capabilities"}, "registration": "N**EG", "generation": {"generationId": "", "name": "coming soon", "review": {"expertReviewSummary": null, "__typename": "GenerationReviewData"}, "__typename": "Generation"}, "hasShowroomProductCode": false, "isPartExAvailable": false, "isFinanceAvailable": true, "isFinanceFullApplicationAvailable": false, "financeProvider": "DEALER", "financeDefaults": {"term": "48", "mileage": "10000", "depositAmount": "1550", "__typename": "FinanceDefaults"}, "hasFinanceInformation": false, "retailerId": "10043893", "privateAdvertiser": null, "advertiserSegment": "Independent", "dealer": {"dealerId": "10043893", "description": "", "distance": null, "stockLevels": {"atStockCounts": {"car": 21, "van": 1, "__typename": "AtStockCounts"}, "__typename": "DealerStockLevels"}, "assignedNumber": {"number": "+447418361442", "__typename": "AssignedNumber"}, "atAwards": [], "branding": {"accreditations": [], "brands": [], "__typename": "DealerBranding"}, "capabilities": {"instantMessagingChat": {"enabled": true, "provider": "VisitorChat", "__typename": "InstantMessagingChatCapability"}, "instantMessagingText": {"enabled": true, "provider": "VisitorChat", "overrideSmsNumber": "+447418361442", "__typename": "InstantMessagingTextCapability"}, "__typename": "Capabilities"}, "reviews": {"overallReviewRating": "4.6", "__typename": "Reviews"}, "location": {"addressOne": "71 Clapton Common", "addressTwo": null, "town": "Clapton", "county": "Middlesex", "postcode": "E5 9AA", "latLong": "51.5690476,-0.0626137", "__typename": "Location"}, "marketing": {"profile": null, "strapline": null, "__typename": "Marketing"}, "media": {"email": "yes", "dealerWebsite": {"href": "https://www.keecars.co.uk/", "__typename": "Link"}, "phoneNumber1": "(020) 8166 4022", "phoneNumber2": null, "protectedNumber": false, "__typename": "DealerMedia"}, "name": "Keecars", "servicesOffered": {"sellerPromise": null, "services": null, "products": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "safeSelling": null, "videoWalkAround": null, "nccApproved": false, "isHomeDeliveryProductEnabled": false, "isPartExAvailable": true, "hasSafeSelling": false, "hasHomeDelivery": false, "hasVideoWalkAround": false, "__typename": "ServicesOffered"}, "__typename": "Dealer"}, "video": null, "spin": null, "imageList": {"nextCursor": null, "size": 26, "images": [{"url": "https://m.atcdn.co.uk/a/media/{resize}/4af1417109324b5f981b62af3cf424c8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/bd216f86f9b343d69dedcf18d4f1f663.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/49835a24d184402682e039c6561f5312.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/83d7f764aad54895a480cacc69a71dd8.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Front Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/05df6bf34aff4a4c977ac1b3e11e617d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c87d7544a8704e3890e6da471def8c50.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Left", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/b0e487003665496e9ed624b3cbd6cd4f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Rear", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/482671c943364690abdfa7b64a2b62f9.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Side Right", "category": "Exterior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/1b5f5eba7198407995df32387b3f6541.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/7ec3f9cfa629476cb9cddfd942847840.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/70a269c7ff4f4347810ddbfd342b4a59.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/2ecb7f3486544bc1b2e75da0db866f2e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Driver", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/708a8e6278354659830efe4c310f0bca.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seat Front Passenger", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/0fc4d175f06245d1abe636197ba0986a.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f79cd2d5c1ca4e63b8c3116beb2e848f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/34c59061baec46f0ba644cdc84e951a0.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Seats Rear", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/925cd7833907439b93b4e7392d93fcdc.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/d2033a19b1a04288a031d7741591774d.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cb9307651c8e42a596ffa45790379031.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Interior Front", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/20413f9391824b848aa6b98ec4e1373e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/cb3cd74e55ac472694d9ce19becd5f4c.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Inconclusive", "category": null, "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/c6bd54f1261245d9b8ff65e551539a04.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/805e4277c63447dc8005ebe5ca02747f.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Driver Instruments", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/279596080b6e470cb53e185e0e0a7366.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Infotainment System", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/f5020750276448d4b5f69f5d4e68ad0e.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Door Interior", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}, {"url": "https://m.atcdn.co.uk/a/media/{resize}/df47db89598e4c5ab9bf05de595b8ae3.jpg", "templated": true, "autotraderAllocated": false, "classificationTags": [{"label": "Misc Controls", "category": "Interior", "__typename": "ImageClassificationTag"}], "__typename": "ImageUrl"}], "__typename": "ImageList"}, "priceIndicatorRating": "NOANALYSIS", "priceIndicatorRatingLabel": "", "priceDeviation": null, "mileageDeviation": null, "mileage": {"mileage": 30000, "unit": "MILE", "__typename": "Mileage"}, "plate": "65", "year": 2015, "vehicleCheckId": null, "vehicleCheckStatus": "UNAVAILABLE", "vehicleCheckSummary": {"type": "MISSING", "title": "Unavailable", "performed": null, "writeOffCategory": null, "checks": [], "__typename": "VehicleCheckSummary"}, "sellerName": "Keecars", "sellerType": "Trade", "sellerProducts": ["APXV", "AT18FINANCECUST", "AT18SELLCUST", "ATCRTLCHK", "ATCVVAL", "ATMOVES", "BOOST", "CHATVISITOR", "CODRIVER", "DEAL", "DFIN", "DIGITALRETAIL", "DVID", "FCS", "FINPROPOSALS", "FPBARGAIN", "FPBONUS", "FPS", "FULLRESERVATIONS", "ISP3VC", "ISSCUST", "ISS_PRODCAT", "PPI_3_STANDARD", "PROFILE", "RTLCHKPLUS", "STEX", "STOCKMANAGER", "VCHECKS", "VEHICLELOOKUP", "WATC", "WAV", "WDEW", "WDSV", "WIMT", "WKSP", "WLGE", "WMPS", "WSL"], "sellerLocation": "CLAPTON", "sellerLocationDistance": null, "sellerContact": {"phoneNumberOne": "(020) 8166 4022", "phoneNumberTwo": null, "protectedNumber": null, "byEmail": true, "__typename": "SellerContact"}, "description": "INCREDIBLE EXAMPLE\nLOOKS LIKE ITS NEVER BEEN USED", "colour": "Silver", "manufacturerApproved": false, "insuranceWriteOffCategory": null, "owners": 1, "keys": null, "vehicleCondition": null, "specification": {"driverPosition": "Unlisted", "isCrossover": false, "operatingType": null, "emissionClass": null, "co2Emissions": null, "topSpeed": {"topSpeed": null, "__typename": "Speed"}, "minimumKerbWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "endLayout": null, "trailerAxleNumber": null, "bedroomLayout": null, "grossVehicleWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "capacityWeight": {"weight": null, "unit": null, "__typename": "Weight"}, "liftingCapacity": {"weight": null, "unit": null, "__typename": "LiftingCapacity"}, "operatingWidth": {"width": null, "unit": null, "__typename": "OperatingWidth"}, "maxReach": {"length": null, "unit": null, "__typename": "MaxReach"}, "wheelbase": null, "berth": null, "bedrooms": null, "engine": {"power": {"enginePower": null, "unit": null, "__typename": "Power"}, "sizeLitres": null, "sizeCC": 2, "manufacturerEngineSize": 0, "__typename": "Engine"}, "exteriorWidth": {"width": null, "unit": null, "__typename": "ExteriorWidth"}, "exteriorLength": {"length": null, "unit": null, "__typename": "ExteriorLength"}, "exteriorHeight": {"height": null, "unit": null, "__typename": "ExteriorHeight"}, "capacityWidth": {"width": null, "unit": null, "__typename": "CapacityWidth"}, "capacityLength": {"length": null, "unit": null, "__typename": "CapacityLength"}, "capacityHeight": {"height": null, "unit": null, "__typename": "CapacityHeight"}, "seats": 8, "axleConfig": null, "ulezCompliant": false, "doors": 5, "bodyType": "Unlisted", "cabType": "Unlisted", "rawBodyType": "Unlisted", "fuel": "Petrol", "transmission": "Automatic", "style": null, "subStyle": null, "make": "Toyota", "model": "Estima", "trim": null, "optionalFeatures": null, "standardFeatures": null, "features": [], "battery": null, "techData": null, "annualTax": {"standardRate": null, "__typename": "AnnualTax"}, "oemDrivetrain": null, "bikeLicenceType": null, "derivativeId": null, "frameSizeCM": null, "frameMaterial": null, "frameStyle": null, "suspensionType": null, "gearShifter": null, "brakeType": null, "motorMake": null, "chargeTimeMinutes": null, "numberOfGears": null, "tyreDiameterInches": null, "driveTrain": null, "torque": null, "range": null, "interiorDescription": null, "exteriorDescription": "Silver exterior colour", "__typename": "Specification"}, "stockType": "physical-stock", "condition": "Used", "finance": null, "locationArea": null, "reservation": {"status": null, "eligibility": "ELIGIBLE", "feeCurrency": "GBP", "feeInFractionalUnits": 9900, "__typename": "AdvertReservation"}, "__typename": "Advert"}
2026-03-30 15:07:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 30cf52c0-d95d-5036-b1ce-056998032cf2 with identifier: 202601199258635
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30cf52c0-d95d-5036-b1ce-056998032cf2
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4af1417109324b5f981b62af3cf424c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4af1417109324b5f981b62af3cf424c8.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbd216f86f9b343d69dedcf18d4f1f663.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bd216f86f9b343d69dedcf18d4f1f663.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49835a24d184402682e039c6561f5312.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49835a24d184402682e039c6561f5312.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83d7f764aad54895a480cacc69a71dd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83d7f764aad54895a480cacc69a71dd8.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F05df6bf34aff4a4c977ac1b3e11e617d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/05df6bf34aff4a4c977ac1b3e11e617d.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc87d7544a8704e3890e6da471def8c50.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c87d7544a8704e3890e6da471def8c50.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0e487003665496e9ed624b3cbd6cd4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0e487003665496e9ed624b3cbd6cd4f.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F482671c943364690abdfa7b64a2b62f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/482671c943364690abdfa7b64a2b62f9.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b5f5eba7198407995df32387b3f6541.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b5f5eba7198407995df32387b3f6541.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7ec3f9cfa629476cb9cddfd942847840.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7ec3f9cfa629476cb9cddfd942847840.jpg already downloaded
2026-03-30 15:07:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 30cf52c0-d95d-5036-b1ce-056998032cf2 with identifier 202601199258635
2026-03-30 15:07:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 30cf52c0-d95d-5036-b1ce-056998032cf2
2026-03-30 15:07:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'INCREDIBLE EXAMPLE\nLOOKS LIKE ITS NEVER BEEN USED',
 'doors_number': 5,
 'fuel_type': 'Petrol',
 'id': '30cf52c0-d95d-5036-b1ce-056998032cf2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199258635',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Toyota',
 'model': 'Estima',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/4af1417109324b5f981b62af3cf424c8.jpg',
                'https://m.atcdn.co.uk/a/media/bd216f86f9b343d69dedcf18d4f1f663.jpg',
                'https://m.atcdn.co.uk/a/media/49835a24d184402682e039c6561f5312.jpg',
                'https://m.atcdn.co.uk/a/media/83d7f764aad54895a480cacc69a71dd8.jpg',
                'https://m.atcdn.co.uk/a/media/05df6bf34aff4a4c977ac1b3e11e617d.jpg',
                'https://m.atcdn.co.uk/a/media/c87d7544a8704e3890e6da471def8c50.jpg',
                'https://m.atcdn.co.uk/a/media/b0e487003665496e9ed624b3cbd6cd4f.jpg',
                'https://m.atcdn.co.uk/a/media/482671c943364690abdfa7b64a2b62f9.jpg',
                'https://m.atcdn.co.uk/a/media/1b5f5eba7198407995df32387b3f6541.jpg',
                'https://m.atcdn.co.uk/a/media/7ec3f9cfa629476cb9cddfd942847840.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307777,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4af1417109324b5f981b62af3cf424c8.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239035,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bd216f86f9b343d69dedcf18d4f1f663.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 417298,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/49835a24d184402682e039c6561f5312.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570949,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/83d7f764aad54895a480cacc69a71dd8.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 318701,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/05df6bf34aff4a4c977ac1b3e11e617d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 540474,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c87d7544a8704e3890e6da471def8c50.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414542,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0e487003665496e9ed624b3cbd6cd4f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 551161,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/482671c943364690abdfa7b64a2b62f9.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 497416,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b5f5eba7198407995df32387b3f6541.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30cf52c0-d95d-5036-b1ce-056998032cf2/30cf52c0-d95d-5036-b1ce-056998032cf2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228211,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7ec3f9cfa629476cb9cddfd942847840.jpg',
             'Width': 1920}],
 'price': 15495,
 'price_includes_vat': True,
 'registration_date': '2015-09-01',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Toyota Estima 2.4 5dr',
 'transmission': 'automatic',
 'year': 2015}
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199258635%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199258635: {'created_time': 1774883278.750059, 'last_price_update_time': 1774883278.750069}
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199258635') HTTP/1.1" 204 0
2026-03-30 15:07:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 012bcff8-44b3-5fb0-ab48-ad05369f716e with identifier: 202601189236979
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 012bcff8-44b3-5fb0-ab48-ad05369f716e
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc144e9606b4a43b4824d18f79ce5052f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c144e9606b4a43b4824d18f79ce5052f.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6cf8901a01ae43a7a7814c8253b3160f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6cf8901a01ae43a7a7814c8253b3160f.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0dd44a9280d44498aee6bc31ee99739.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0dd44a9280d44498aee6bc31ee99739.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fecc019a4eed94b7a967e31f64451f7e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ecc019a4eed94b7a967e31f64451f7e8.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53319d6e4f2b4feaa6b82dcec92a4b19.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53319d6e4f2b4feaa6b82dcec92a4b19.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8405bcc6196a4cd4b563f2f886da4878.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8405bcc6196a4cd4b563f2f886da4878.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77492b74d94a485884d645b208d23f94.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77492b74d94a485884d645b208d23f94.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7ee99c4e07af4a3da716172d9be5e4ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7ee99c4e07af4a3da716172d9be5e4ad.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00894937344b4899a7c03d1b8a7af748.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00894937344b4899a7c03d1b8a7af748.jpg already downloaded
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6c8dd687e9e9453fa8d98935436397e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6c8dd687e9e9453fa8d98935436397e7.jpg already downloaded
2026-03-30 15:07:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 012bcff8-44b3-5fb0-ab48-ad05369f716e with identifier 202601189236979
2026-03-30 15:07:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 012bcff8-44b3-5fb0-ab48-ad05369f716e
2026-03-30 15:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'FINANCE AVAILABLE \n'
                '\n'
                'Here we have for sale a 2020 Audi A6 Avant 3.0 TDI V6 50 '
                'Sport Estate 5dr Diesel Tiptronic quattro Euro 6 (s/s) (286 '
                'ps), This car has had just 2 owners from new (1 former '
                'keeper) and benefits from a full Audi service history, 2 keys '
                'and fantastic specification including a Panoramic Roof, '
                'Adaptive Cruise Control, Technology Package,  Apple Carplay, '
                'Beige Leather and more All our Cars Benefit From A Free 12 '
                'Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 282,
 'fuel_type': 'Diesel',
 'id': '012bcff8-44b3-5fb0-ab48-ad05369f716e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601189236979',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Audi',
 'model': 'A6 Avant',
 'odometer': 71180,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 36,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/c144e9606b4a43b4824d18f79ce5052f.jpg',
                'https://m.atcdn.co.uk/a/media/6cf8901a01ae43a7a7814c8253b3160f.jpg',
                'https://m.atcdn.co.uk/a/media/b0dd44a9280d44498aee6bc31ee99739.jpg',
                'https://m.atcdn.co.uk/a/media/ecc019a4eed94b7a967e31f64451f7e8.jpg',
                'https://m.atcdn.co.uk/a/media/53319d6e4f2b4feaa6b82dcec92a4b19.jpg',
                'https://m.atcdn.co.uk/a/media/8405bcc6196a4cd4b563f2f886da4878.jpg',
                'https://m.atcdn.co.uk/a/media/77492b74d94a485884d645b208d23f94.jpg',
                'https://m.atcdn.co.uk/a/media/7ee99c4e07af4a3da716172d9be5e4ad.jpg',
                'https://m.atcdn.co.uk/a/media/00894937344b4899a7c03d1b8a7af748.jpg',
                'https://m.atcdn.co.uk/a/media/6c8dd687e9e9453fa8d98935436397e7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 416259,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c144e9606b4a43b4824d18f79ce5052f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449205,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0dd44a9280d44498aee6bc31ee99739.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 562814,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ecc019a4eed94b7a967e31f64451f7e8.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 510838,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/53319d6e4f2b4feaa6b82dcec92a4b19.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 555261,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8405bcc6196a4cd4b563f2f886da4878.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 159199,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7ee99c4e07af4a3da716172d9be5e4ad.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 513549,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/77492b74d94a485884d645b208d23f94.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285488,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/00894937344b4899a7c03d1b8a7af748.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194511,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6c8dd687e9e9453fa8d98935436397e7.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012bcff8-44b3-5fb0-ab48-ad05369f716e/012bcff8-44b3-5fb0-ab48-ad05369f716e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274487,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6cf8901a01ae43a7a7814c8253b3160f.jpg',
             'Width': 1920}],
 'price': 22495,
 'price_includes_vat': True,
 'registration_date': '2020-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi 3.0 A6 Sport 50 TDI Quattro Semi-Auto 4WD 5dr',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601189236979%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601189236979: {'created_time': 1774883279.074678, 'last_price_update_time': 1774883279.074692}
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601189236979') HTTP/1.1" 204 0
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb with identifier: 202603291111281
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9ab64cbe9e054f098f0ca1f8ea316471.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9ab64cbe9e054f098f0ca1f8ea316471.jpg not downloaded yet
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff88b1d-2a6f-5090-a718-4189a30d0f29 with identifier: 202601119064269
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ff88b1d-2a6f-5090-a718-4189a30d0f29
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd3bce4242467481a9a064673380e8a72.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d3bce4242467481a9a064673380e8a72.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fecda36bb9f644f29950d32193a076164.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ecda36bb9f644f29950d32193a076164.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa01ad2d1a0c4021bf4c1c1fe43c2e97.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa01ad2d1a0c4021bf4c1c1fe43c2e97.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa850cb031eca43d780f6ec8199b38648.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a850cb031eca43d780f6ec8199b38648.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0200f11793fe444d8e7667c3673b004e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0200f11793fe444d8e7667c3673b004e.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F607530c7964942949c55ac4d2b1a2a1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/607530c7964942949c55ac4d2b1a2a1e.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd7ed6ca1b7f14380ac30b5750c68fec8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d7ed6ca1b7f14380ac30b5750c68fec8.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbe030b566b2043fea353f3fefeb2559b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/be030b566b2043fea353f3fefeb2559b.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b2bde2290854385b1dd5307bca1414f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b2bde2290854385b1dd5307bca1414f.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2a609ddb492f46eebce7959573079273.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2a609ddb492f46eebce7959573079273.jpg already downloaded
2026-03-30 15:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1ff88b1d-2a6f-5090-a718-4189a30d0f29 with identifier 202601119064269
2026-03-30 15:07:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1ff88b1d-2a6f-5090-a718-4189a30d0f29
2026-03-30 15:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'All our Cars Benefit From A Free 12 Month AA Break Down '
                'Cover  \r\n'
                '\r\n'
                ' All Major Debit Cards Accepted and Part Exchange '
                'Welcome  \r\n'
                '\r\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \r\n'
                '\r\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.\n'
                '\n'
                'All our Cars Benefit From A Free 12 Month AA Break Down '
                'Cover  \r\n'
                '\r\n'
                ' All Major Debit Cards Accepted and Part Exchange '
                'Welcome  \r\n'
                '\r\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \r\n'
                '\r\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '1ff88b1d-2a6f-5090-a718-4189a30d0f29',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601119064269',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 15334,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/d3bce4242467481a9a064673380e8a72.jpg',
                'https://m.atcdn.co.uk/a/media/ecda36bb9f644f29950d32193a076164.jpg',
                'https://m.atcdn.co.uk/a/media/fa01ad2d1a0c4021bf4c1c1fe43c2e97.jpg',
                'https://m.atcdn.co.uk/a/media/a850cb031eca43d780f6ec8199b38648.jpg',
                'https://m.atcdn.co.uk/a/media/0200f11793fe444d8e7667c3673b004e.jpg',
                'https://m.atcdn.co.uk/a/media/607530c7964942949c55ac4d2b1a2a1e.jpg',
                'https://m.atcdn.co.uk/a/media/d7ed6ca1b7f14380ac30b5750c68fec8.jpg',
                'https://m.atcdn.co.uk/a/media/be030b566b2043fea353f3fefeb2559b.jpg',
                'https://m.atcdn.co.uk/a/media/7b2bde2290854385b1dd5307bca1414f.jpg',
                'https://m.atcdn.co.uk/a/media/2a609ddb492f46eebce7959573079273.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281871,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d3bce4242467481a9a064673380e8a72.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179649,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ecda36bb9f644f29950d32193a076164.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299101,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa01ad2d1a0c4021bf4c1c1fe43c2e97.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434481,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a850cb031eca43d780f6ec8199b38648.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253741,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0200f11793fe444d8e7667c3673b004e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 401958,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/607530c7964942949c55ac4d2b1a2a1e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383470,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d7ed6ca1b7f14380ac30b5750c68fec8.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 392956,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/be030b566b2043fea353f3fefeb2559b.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147719,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7b2bde2290854385b1dd5307bca1414f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ff88b1d-2a6f-5090-a718-4189a30d0f29/1ff88b1d-2a6f-5090-a718-4189a30d0f29_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 149442,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2a609ddb492f46eebce7959573079273.jpg',
             'Width': 1920}],
 'price': 9995,
 'price_includes_vat': True,
 'registration_date': '2015-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Titanium Hatchback 5dr Petrol Powershift Euro 6 (125 '
          'ps)',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601119064269%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601119064269: {'created_time': 1774883279.378912, 'last_price_update_time': 1774883279.378926}
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601119064269') HTTP/1.1" 204 0
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8e1a2e974b44e29b4d808cb360ee06a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8e1a2e974b44e29b4d808cb360ee06a.jpg not downloaded yet
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 046dbaa0-e796-52c0-a503-27956b0f06f3 with identifier: 202601068949474
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 046dbaa0-e796-52c0-a503-27956b0f06f3
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49af15b9be1d4591a8f0b8e39a20a33f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49af15b9be1d4591a8f0b8e39a20a33f.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7dd3e8b76af4b02bfebb727965cfb17.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7dd3e8b76af4b02bfebb727965cfb17.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1c0ee38731140a29ee1aa927cd8c75d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1c0ee38731140a29ee1aa927cd8c75d.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde1eaf8b93a5427c8a900e4a872fc873.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de1eaf8b93a5427c8a900e4a872fc873.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F057d311a0aac42c8941226f0c0f16a0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/057d311a0aac42c8941226f0c0f16a0c.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6d7143f64294a3686c99bb480fd46ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6d7143f64294a3686c99bb480fd46ee.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb846ce12a3349ea85067f4d587bf754.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db846ce12a3349ea85067f4d587bf754.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdaeb552c3dd4a7889260c731a66dd5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdaeb552c3dd4a7889260c731a66dd5a.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F31ce6b29c8f94ac497cca14733db1ed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/31ce6b29c8f94ac497cca14733db1ed1.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa41c3ecc80b74a679a159d63a49b6330.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a41c3ecc80b74a679a159d63a49b6330.jpg already downloaded
2026-03-30 15:07:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 046dbaa0-e796-52c0-a503-27956b0f06f3 with identifier 202601068949474
2026-03-30 15:07:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 046dbaa0-e796-52c0-a503-27956b0f06f3
2026-03-30 15:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a 2022 GENESIS GV80 3.0D Luxury SUV 5dr '
                'Diesel Auto 4WD Euro 6 (7 Seat)  278 ps\n'
                '\n'
                'This genesis is in lovely condition throughout and benefits '
                'from incredible specification including the Innovation Pack, '
                'Comfort Seat Pack, Panoramic Roof, Nappa Leather, Panoramic '
                'Roof and more \n'
                '\n'
                ' All our Cars Benefit From A Free 12 Month AA Break Down '
                'Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.\n'
                '\n'
                'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a 2022 GENESIS GV80 3.0D Luxury SUV 5dr '
                'Diesel Auto 4WD Euro 6 (7 Seat)  278 ps\n'
                '\n'
                'This genesis is in lovely condition throughout and benefits '
                'from incredible specification including the Innovation Pack, '
                'Comfort Seat Pack, Panoramic Roof, Nappa Leather, Panoramic '
                'Roof and more \n'
                '\n'
                ' All our Cars Benefit From A Free 12 Month AA Break Down '
                'Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 274,
 'fuel_type': 'Diesel',
 'id': '046dbaa0-e796-52c0-a503-27956b0f06f3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601068949474',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Genesis',
 'model': 'GV80',
 'odometer': 22000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/49af15b9be1d4591a8f0b8e39a20a33f.jpg',
                'https://m.atcdn.co.uk/a/media/c7dd3e8b76af4b02bfebb727965cfb17.jpg',
                'https://m.atcdn.co.uk/a/media/c1c0ee38731140a29ee1aa927cd8c75d.jpg',
                'https://m.atcdn.co.uk/a/media/de1eaf8b93a5427c8a900e4a872fc873.jpg',
                'https://m.atcdn.co.uk/a/media/057d311a0aac42c8941226f0c0f16a0c.jpg',
                'https://m.atcdn.co.uk/a/media/c6d7143f64294a3686c99bb480fd46ee.jpg',
                'https://m.atcdn.co.uk/a/media/db846ce12a3349ea85067f4d587bf754.jpg',
                'https://m.atcdn.co.uk/a/media/cdaeb552c3dd4a7889260c731a66dd5a.jpg',
                'https://m.atcdn.co.uk/a/media/31ce6b29c8f94ac497cca14733db1ed1.jpg',
                'https://m.atcdn.co.uk/a/media/a41c3ecc80b74a679a159d63a49b6330.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249082,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/49af15b9be1d4591a8f0b8e39a20a33f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191899,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7dd3e8b76af4b02bfebb727965cfb17.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353658,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c1c0ee38731140a29ee1aa927cd8c75d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368035,
             'Height': 1438,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/de1eaf8b93a5427c8a900e4a872fc873.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385077,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/057d311a0aac42c8941226f0c0f16a0c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374099,
             'Height': 1438,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6d7143f64294a3686c99bb480fd46ee.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360462,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/db846ce12a3349ea85067f4d587bf754.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293196,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cdaeb552c3dd4a7889260c731a66dd5a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316997,
             'Height': 1438,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/31ce6b29c8f94ac497cca14733db1ed1.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_046dbaa0-e796-52c0-a503-27956b0f06f3/046dbaa0-e796-52c0-a503-27956b0f06f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158055,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a41c3ecc80b74a679a159d63a49b6330.jpg',
             'Width': 1920}],
 'price': 39220,
 'price_includes_vat': True,
 'registration_date': '2022-03-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Genesis GV80 3.0D Luxury SUV 5dr Diesel Auto 4WD Euro 6 (s/s) (7 '
          'Seat) (278 ps)',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2022}
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601068949474%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601068949474: {'created_time': 1774883279.655764, 'last_price_update_time': 1774883279.655778}
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601068949474') HTTP/1.1" 204 0
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98d81feabfcc4e41bd8cd4a1fc47a80a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98d81feabfcc4e41bd8cd4a1fc47a80a.jpg not downloaded yet
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 580c88e3-e1b5-5c7d-8a18-89d8cf842195 with identifier: 202511127838599
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 580c88e3-e1b5-5c7d-8a18-89d8cf842195
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F310aa1b617274b2981887602f643f82b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/310aa1b617274b2981887602f643f82b.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff22212c27cb14dcbaa711612c8ba3611.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f22212c27cb14dcbaa711612c8ba3611.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80fcec0ba40d4a628ca9646401ae2e5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80fcec0ba40d4a628ca9646401ae2e5e.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a2661289d864bc1939068f10d7998a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a2661289d864bc1939068f10d7998a4.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f4c4fab2fc24ea1872f99f4650cb256.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f4c4fab2fc24ea1872f99f4650cb256.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9072064882e248fd80d873a97779dea3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9072064882e248fd80d873a97779dea3.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ab36059b45c415aa191d2d3f0c045db.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ab36059b45c415aa191d2d3f0c045db.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F055eca8bf00c4e9d8239333db962fc6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/055eca8bf00c4e9d8239333db962fc6d.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00ddcf3bc17642ceab35642eb054b2c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00ddcf3bc17642ceab35642eb054b2c9.jpg already downloaded
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0701818eea742209040f10a244b8d4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0701818eea742209040f10a244b8d4e.jpg already downloaded
2026-03-30 15:07:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 580c88e3-e1b5-5c7d-8a18-89d8cf842195 with identifier 202511127838599
2026-03-30 15:07:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 580c88e3-e1b5-5c7d-8a18-89d8cf842195
2026-03-30 15:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 259,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Here we have for sale a 2005 (55) Toyota Previa 2.4 VVT-i T '
                'Spirit MPV 5dr Petrol Automatic (7 Seats) (259 g/km, 154 '
                'bhp)\n'
                ' All our Cars Benefit From A Free 12 Month AA Break Down '
                'Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.\n'
                '\n'
                'Here we have for sale a 2005 (55) Toyota Previa 2.4 VVT-i T '
                'Spirit MPV 5dr Petrol Automatic (7 Seats) (259 g/km, 154 '
                'bhp)\n'
                ' All our Cars Benefit From A Free 12 Month AA Break Down '
                'Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 5,
 'emission_standard': 'Euro 4',
 'engine': '2.4L',
 'engine_horse_power': 154,
 'fuel_type': 'Petrol',
 'id': '580c88e3-e1b5-5c7d-8a18-89d8cf842195',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511127838599',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Toyota',
 'model': 'Previa',
 'odometer': 72000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 29,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/310aa1b617274b2981887602f643f82b.jpg',
                'https://m.atcdn.co.uk/a/media/f22212c27cb14dcbaa711612c8ba3611.jpg',
                'https://m.atcdn.co.uk/a/media/80fcec0ba40d4a628ca9646401ae2e5e.jpg',
                'https://m.atcdn.co.uk/a/media/9a2661289d864bc1939068f10d7998a4.jpg',
                'https://m.atcdn.co.uk/a/media/0f4c4fab2fc24ea1872f99f4650cb256.jpg',
                'https://m.atcdn.co.uk/a/media/9072064882e248fd80d873a97779dea3.jpg',
                'https://m.atcdn.co.uk/a/media/4ab36059b45c415aa191d2d3f0c045db.jpg',
                'https://m.atcdn.co.uk/a/media/055eca8bf00c4e9d8239333db962fc6d.jpg',
                'https://m.atcdn.co.uk/a/media/00ddcf3bc17642ceab35642eb054b2c9.jpg',
                'https://m.atcdn.co.uk/a/media/f0701818eea742209040f10a244b8d4e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 348120,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/310aa1b617274b2981887602f643f82b.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235816,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f22212c27cb14dcbaa711612c8ba3611.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384962,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/80fcec0ba40d4a628ca9646401ae2e5e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360251,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9a2661289d864bc1939068f10d7998a4.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304409,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f4c4fab2fc24ea1872f99f4650cb256.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387431,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9072064882e248fd80d873a97779dea3.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 406832,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ab36059b45c415aa191d2d3f0c045db.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370867,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/055eca8bf00c4e9d8239333db962fc6d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333566,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/00ddcf3bc17642ceab35642eb054b2c9.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580c88e3-e1b5-5c7d-8a18-89d8cf842195/580c88e3-e1b5-5c7d-8a18-89d8cf842195_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244287,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f0701818eea742209040f10a244b8d4e.jpg',
             'Width': 1920}],
 'price': 4795,
 'price_includes_vat': True,
 'registration_date': '2005-09-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Toyota Previa 2.4 VVT-i T Spirit MPV 5dr Petrol Automatic (7 Seats) '
          '(259 g/km, 154 bhp)',
 'transmission': 'automatic',
 'trim': 'T Spirit',
 'year': 2005}
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127838599%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511127838599: {'created_time': 1774883279.93038, 'last_price_update_time': 1774883279.930395}
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511127838599') HTTP/1.1" 204 0
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F243c1243ef354338b098b20247aeb190.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/243c1243ef354338b098b20247aeb190.jpg not downloaded yet
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 95020af7-bda2-5e22-aa90-d1cbc5c78f3c with identifier: 202511027593936
2026-03-30 15:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95020af7-bda2-5e22-aa90-d1cbc5c78f3c
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffb70e6daec834ccda1dd1f648cad7065.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fb70e6daec834ccda1dd1f648cad7065.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc461a008a47a4150821e482a295bbdfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c461a008a47a4150821e482a295bbdfb.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F72bfd6534541487fbdab469692d6d104.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/72bfd6534541487fbdab469692d6d104.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2271820410649fa811eb5589d2d9219.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2271820410649fa811eb5589d2d9219.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa71cf5889f9f4359bdfff0b0e8979832.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a71cf5889f9f4359bdfff0b0e8979832.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2d220e093e8644d08629a6d48bf988d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2d220e093e8644d08629a6d48bf988d0.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F18e08839b0d74fd3860542bf10e401fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/18e08839b0d74fd3860542bf10e401fb.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91b548fee47f4cb2aa41a7fca55d9195.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91b548fee47f4cb2aa41a7fca55d9195.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3fea102e0d104aa7ab966abea790824c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3fea102e0d104aa7ab966abea790824c.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68210d76b35d45579660da31e53efc8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68210d76b35d45579660da31e53efc8a.jpg already downloaded
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Page: 2/2, total results: 24
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511027593892%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511027593892: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509286705433%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509286705433: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509096185810%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509096185810: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508075233145%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508075233145: 1
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 4 detail requests (batch 1)
2026-03-30 15:08:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 95020af7-bda2-5e22-aa90-d1cbc5c78f3c with identifier 202511027593936
2026-03-30 15:08:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:00 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 95020af7-bda2-5e22-aa90-d1cbc5c78f3c
2026-03-30 15:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a 2018 TESLA MODEL S 75D (Dual Motor) '
                'Hatchback 5dr Electric Auto 4WD \n'
                '\n'
                'This car has had just 1 owner from new and benefits from a '
                'full service history, 2 keys and huge specification \n'
                '\n'
                'This 2018 Tesla Model S 75D stands out with its single owner '
                'from new and a remarkably low mileage of just 60,000 miles. '
                'As an all electric vehicle, it offers a smooth and quiet '
                'driving experience, powered by a 75 kWh battery that provided '
                'an impressive maximum range of 304 miles when new. This Four '
                'Wheel Drive model features a Premium Engineered Material in '
                'Cream, automatic LED headlights, and front and rear parking '
                "sensors for enhanced convenience. You'll also appreciate the "
                'high definition backup camera and the expansive glass roof, '
                'which adds to the sense of space within the cabin.\n'
                '\n'
                'The performance of this Model S is truly noteworthy, '
                'achieving 0-60mph in a swift 5.2 seconds, demonstrating its '
                'dynamic capability. Charging is flexible, with a full charge '
                'at home taking approximately 12 hours using a 7kW charger, '
                'while rapid public charging can replenish the battery from '
                'empty to 80% in just 45 minutes. This indicates a superior '
                'charging efficiency compared to many other electric vehicles. '
                'Furthermore, the MOT is valid until February 2026, offering '
                'peace of mind for the new owner. All our Cars Benefit From A '
                'Free 12 Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.\n'
                '\n'
                'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a 2018 TESLA MODEL S 75D (Dual Motor) '
                'Hatchback 5dr Electric Auto 4WD \n'
                '\n'
                'This car has had just 1 owner from new and benefits from a '
                'full service history, 2 keys and huge specification \n'
                '\n'
                'This 2018 Tesla Model S 75D stands out with its single owner '
                'from new and a remarkably low mileage of just 60,000 miles. '
                'As an all electric vehicle, it offers a smooth and quiet '
                'driving experience, powered by a 75 kWh battery that provided '
                'an impressive maximum range of 304 miles when new. This Four '
                'Wheel Drive model features a Premium Engineered Material in '
                'Cream, automatic LED headlights, and front and rear parking '
                "sensors for enhanced convenience. You'll also appreciate the "
                'high definition backup camera and the expansive glass roof, '
                'which adds to the sense of space within the cabin.\n'
                '\n'
                'The performance of this Model S is truly noteworthy, '
                'achieving 0-60mph in a swift 5.2 seconds, demonstrating its '
                'dynamic capability. Charging is flexible, with a full charge '
                'at home taking approximately 12 hours using a 7kW charger, '
                'while rapid public charging can replenish the battery from '
                'empty to 80% in just 45 minutes. This indicates a superior '
                'charging efficiency compared to many other electric vehicles. '
                'Furthermore, the MOT is valid until February 2026, offering '
                'peace of mind for the new owner. All our Cars Benefit From A '
                'Free 12 Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 5,
 'engine_horse_power': 328,
 'fuel_type': 'Electric',
 'id': '95020af7-bda2-5e22-aa90-d1cbc5c78f3c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511027593936',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Tesla',
 'model': 'Model S',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/fb70e6daec834ccda1dd1f648cad7065.jpg',
                'https://m.atcdn.co.uk/a/media/c461a008a47a4150821e482a295bbdfb.jpg',
                'https://m.atcdn.co.uk/a/media/72bfd6534541487fbdab469692d6d104.jpg',
                'https://m.atcdn.co.uk/a/media/a2271820410649fa811eb5589d2d9219.jpg',
                'https://m.atcdn.co.uk/a/media/a71cf5889f9f4359bdfff0b0e8979832.jpg',
                'https://m.atcdn.co.uk/a/media/2d220e093e8644d08629a6d48bf988d0.jpg',
                'https://m.atcdn.co.uk/a/media/18e08839b0d74fd3860542bf10e401fb.jpg',
                'https://m.atcdn.co.uk/a/media/91b548fee47f4cb2aa41a7fca55d9195.jpg',
                'https://m.atcdn.co.uk/a/media/3fea102e0d104aa7ab966abea790824c.jpg',
                'https://m.atcdn.co.uk/a/media/68210d76b35d45579660da31e53efc8a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347972,
             'Height': 1438,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fb70e6daec834ccda1dd1f648cad7065.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 166872,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c461a008a47a4150821e482a295bbdfb.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 358176,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/72bfd6534541487fbdab469692d6d104.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373608,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2271820410649fa811eb5589d2d9219.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328937,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a71cf5889f9f4359bdfff0b0e8979832.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383197,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2d220e093e8644d08629a6d48bf988d0.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332798,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/18e08839b0d74fd3860542bf10e401fb.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369883,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/91b548fee47f4cb2aa41a7fca55d9195.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157460,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3fea102e0d104aa7ab966abea790824c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95020af7-bda2-5e22-aa90-d1cbc5c78f3c/95020af7-bda2-5e22-aa90-d1cbc5c78f3c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123405,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/68210d76b35d45579660da31e53efc8a.jpg',
             'Width': 1920}],
 'price': 15295,
 'price_includes_vat': True,
 'registration_date': '2018-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model S 75D (Dual Motor) Hatchback 5dr Electric Auto 4WD (328 '
          'bhp)',
 'transmission': 'automatic',
 'year': 2018}
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511027593936%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511027593936: {'created_time': 1774883280.399314, 'last_price_update_time': 1774883280.399325}
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511027593936') HTTP/1.1" 204 0
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19f9de6320094b7884d9fe8aa17a54c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19f9de6320094b7884d9fe8aa17a54c6.jpg not downloaded yet
2026-03-30 15:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ec45e38ab624962bc9f9c616cebb454.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ec45e38ab624962bc9f9c616cebb454.jpg not downloaded yet
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80559f1e5a1c4fae926da58f77ad333f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80559f1e5a1c4fae926da58f77ad333f.jpg not downloaded yet
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c4502e6547a4da4b54585f1afcc8234.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c4502e6547a4da4b54585f1afcc8234.jpg not downloaded yet
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78b788981db748bb851f4d7754981a83.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78b788981db748bb851f4d7754981a83.jpg not downloaded yet
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7e9c9abc9e914a63aa5dea4548cceaab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7e9c9abc9e914a63aa5dea4548cceaab.jpg not downloaded yet
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fd714d00-90bc-57fd-983c-45d65e559bdb with identifier: 202603291111254
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item fd714d00-90bc-57fd-983c-45d65e559bdb
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0337db769ea4421a94eeb3f6845daa41.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0337db769ea4421a94eeb3f6845daa41.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2e3954e5e924d0ab011334b3dd57e22.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2e3954e5e924d0ab011334b3dd57e22.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff90b7938dd67406c8be2d9d9a652498d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f90b7938dd67406c8be2d9d9a652498d.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F031a63c1f85b4100adc83a9e3a2be5ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/031a63c1f85b4100adc83a9e3a2be5ea.jpg already downloaded
2026-03-30 15:08:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fd714d00-90bc-57fd-983c-45d65e559bdb with identifier 202603291111254
2026-03-30 15:08:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:00 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fd714d00-90bc-57fd-983c-45d65e559bdb
2026-03-30 15:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'Here we have for sale a 2017 Volvo XC60 2.0 T5 SE Nav SUV 5dr '
                'Petrol Auto Euro 6 (s/s) (245 ps)\n'
                '\n'
                'This wonderful example has had just 2 owners from new (1 '
                'former keeper) and benefits from a full service history, 2 '
                'keys and great specification',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 242,
 'fuel_type': 'Petrol',
 'id': 'fd714d00-90bc-57fd-983c-45d65e559bdb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603291111254',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 67847,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/0337db769ea4421a94eeb3f6845daa41.jpg',
                'https://m.atcdn.co.uk/a/media/f2e3954e5e924d0ab011334b3dd57e22.jpg',
                'https://m.atcdn.co.uk/a/media/f90b7938dd67406c8be2d9d9a652498d.jpg',
                'https://m.atcdn.co.uk/a/media/031a63c1f85b4100adc83a9e3a2be5ea.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd714d00-90bc-57fd-983c-45d65e559bdb/fd714d00-90bc-57fd-983c-45d65e559bdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308467,
             'Height': 1442,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0337db769ea4421a94eeb3f6845daa41.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd714d00-90bc-57fd-983c-45d65e559bdb/fd714d00-90bc-57fd-983c-45d65e559bdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271411,
             'Height': 1234,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2e3954e5e924d0ab011334b3dd57e22.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd714d00-90bc-57fd-983c-45d65e559bdb/fd714d00-90bc-57fd-983c-45d65e559bdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315375,
             'Height': 1359,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f90b7938dd67406c8be2d9d9a652498d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd714d00-90bc-57fd-983c-45d65e559bdb/fd714d00-90bc-57fd-983c-45d65e559bdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301035,
             'Height': 1343,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/031a63c1f85b4100adc83a9e3a2be5ea.jpg',
             'Width': 1920}],
 'price': 14750,
 'price_includes_vat': True,
 'registration_date': '2017-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo 2.0 XC60 SE Nav T5 Auto 5dr',
 'transmission': 'automatic',
 'trim': 'SE Nav',
 'year': 2017}
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603291111254%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603291111254: {'created_time': 1774883280.683979, 'last_price_update_time': 1774883280.683989}
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603291111254') HTTP/1.1" 204 0
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ed3a7a-0fe6-598f-890b-fb57c24cb4f2 with identifier: 202603230922297
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25ed3a7a-0fe6-598f-890b-fb57c24cb4f2
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78806f4604cd47ddae88fc436685b098.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78806f4604cd47ddae88fc436685b098.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5420f443b20847c19c135d2a95321622.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5420f443b20847c19c135d2a95321622.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd5ce7acefb54aec966165daeb6d500f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd5ce7acefb54aec966165daeb6d500f.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1218ecae879a428e90612393cd24a091.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1218ecae879a428e90612393cd24a091.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F87bb2b0594114bbb839857eae4df7e62.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/87bb2b0594114bbb839857eae4df7e62.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faae585bc9937462f8986a74c0b3a0441.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aae585bc9937462f8986a74c0b3a0441.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F10c375d5bc774a75b38c89c50ca1446e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/10c375d5bc774a75b38c89c50ca1446e.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fda1c3ef2f41e4821b87533c36ed0c49a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/da1c3ef2f41e4821b87533c36ed0c49a.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36678b9d92854d48b79139dc9573aac0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36678b9d92854d48b79139dc9573aac0.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc77035cb858c4e6ba7dc91acdd2a54f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c77035cb858c4e6ba7dc91acdd2a54f5.jpg already downloaded
2026-03-30 15:08:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 25ed3a7a-0fe6-598f-890b-fb57c24cb4f2 with identifier 202603230922297
2026-03-30 15:08:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:00 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 25ed3a7a-0fe6-598f-890b-fb57c24cb4f2
2026-03-30 15:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'Introducing the prestigious Mercedes-benz Vito 2.1 Vito 116 '
                'Premium CDi Auto. This exceptional vehicle exudes luxury and '
                'performance, making it the perfect choice for those who '
                'demand the best.\n'
                '\n'
                'With only 2 previous owners, this Mercedes-benz Vito has been '
                'meticulously cared for and is in impeccable condition. '
                'Finished in a stunning Blue colour, this van is sure to turn '
                'heads wherever you go.\n'
                '\n'
                'Equipped with 18-inch Alloy Wheels - 5-Spoke, this '
                'Mercedes-benz Vito not only looks the part but also delivers '
                "a smooth and comfortable ride. Whether you're cruising "
                'through the city streets or embarking on a long journey, this '
                'van will provide a driving experience like no other.\n'
                '\n'
                "Don't miss your chance to own this exceptional Mercedes-benz "
                'Vito. Contact us today to schedule a test drive',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 161,
 'fuel_type': 'Diesel',
 'id': '25ed3a7a-0fe6-598f-890b-fb57c24cb4f2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230922297',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 136174,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/78806f4604cd47ddae88fc436685b098.jpg',
                'https://m.atcdn.co.uk/a/media/5420f443b20847c19c135d2a95321622.jpg',
                'https://m.atcdn.co.uk/a/media/cd5ce7acefb54aec966165daeb6d500f.jpg',
                'https://m.atcdn.co.uk/a/media/1218ecae879a428e90612393cd24a091.jpg',
                'https://m.atcdn.co.uk/a/media/87bb2b0594114bbb839857eae4df7e62.jpg',
                'https://m.atcdn.co.uk/a/media/aae585bc9937462f8986a74c0b3a0441.jpg',
                'https://m.atcdn.co.uk/a/media/10c375d5bc774a75b38c89c50ca1446e.jpg',
                'https://m.atcdn.co.uk/a/media/da1c3ef2f41e4821b87533c36ed0c49a.jpg',
                'https://m.atcdn.co.uk/a/media/36678b9d92854d48b79139dc9573aac0.jpg',
                'https://m.atcdn.co.uk/a/media/c77035cb858c4e6ba7dc91acdd2a54f5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255873,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/78806f4604cd47ddae88fc436685b098.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232527,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5420f443b20847c19c135d2a95321622.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409237,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd5ce7acefb54aec966165daeb6d500f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212546,
             'Height': 1279,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1218ecae879a428e90612393cd24a091.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 424911,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/87bb2b0594114bbb839857eae4df7e62.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223237,
             'Height': 1441,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/aae585bc9937462f8986a74c0b3a0441.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380096,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/10c375d5bc774a75b38c89c50ca1446e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267821,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/da1c3ef2f41e4821b87533c36ed0c49a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383278,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/36678b9d92854d48b79139dc9573aac0.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25ed3a7a-0fe6-598f-890b-fb57c24cb4f2/25ed3a7a-0fe6-598f-890b-fb57c24cb4f2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 191498,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c77035cb858c4e6ba7dc91acdd2a54f5.jpg',
             'Width': 1920}],
 'price': 14995,
 'price_includes_vat': True,
 'registration_date': '2019-08-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz 2.1 Vito 116 Premium CDi Auto',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2019}
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230922297%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230922297: {'created_time': 1774883280.931277, 'last_price_update_time': 1774883280.931288}
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230922297') HTTP/1.1" 204 0
2026-03-30 15:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9ab64cbe9e054f098f0ca1f8ea316471.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d7fca188-e3d2-5de7-92ab-d4aebe54c4cf with identifier: 202603170762112
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7fca188-e3d2-5de7-92ab-d4aebe54c4cf
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4f4b2716ada144d3a412c9f243555495.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4f4b2716ada144d3a412c9f243555495.jpg already downloaded
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe75f7c8482be4d78b58fc629adbb3640.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e75f7c8482be4d78b58fc629adbb3640.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e4e96b3788640e3b89a2e5939688aba.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e4e96b3788640e3b89a2e5939688aba.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb384856475644b759edb406698198a05.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b384856475644b759edb406698198a05.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85ee6a563fe2490482c509427637d65a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85ee6a563fe2490482c509427637d65a.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7544375fd885405c93c0073e363d5e9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7544375fd885405c93c0073e363d5e9d.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ab4bd5caf074b8b800ee4ad0308513d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ab4bd5caf074b8b800ee4ad0308513d.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F273b3cb70c1c4f0a823bf9a65cefc166.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/273b3cb70c1c4f0a823bf9a65cefc166.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7f5290a8a7347d88e6a7780acf5c246.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7f5290a8a7347d88e6a7780acf5c246.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcac2179acd654140a1020201e33b44c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cac2179acd654140a1020201e33b44c8.jpg already downloaded
2026-03-30 15:08:01 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d7fca188-e3d2-5de7-92ab-d4aebe54c4cf with identifier 202603170762112
2026-03-30 15:08:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d7fca188-e3d2-5de7-92ab-d4aebe54c4cf
2026-03-30 15:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': 'd7fca188-e3d2-5de7-92ab-d4aebe54c4cf',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170762112',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'SEAT',
 'model': 'Tarraco',
 'odometer': 80000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/4f4b2716ada144d3a412c9f243555495.jpg',
                'https://m.atcdn.co.uk/a/media/e75f7c8482be4d78b58fc629adbb3640.jpg',
                'https://m.atcdn.co.uk/a/media/5e4e96b3788640e3b89a2e5939688aba.jpg',
                'https://m.atcdn.co.uk/a/media/b384856475644b759edb406698198a05.jpg',
                'https://m.atcdn.co.uk/a/media/85ee6a563fe2490482c509427637d65a.jpg',
                'https://m.atcdn.co.uk/a/media/7544375fd885405c93c0073e363d5e9d.jpg',
                'https://m.atcdn.co.uk/a/media/2ab4bd5caf074b8b800ee4ad0308513d.jpg',
                'https://m.atcdn.co.uk/a/media/273b3cb70c1c4f0a823bf9a65cefc166.jpg',
                'https://m.atcdn.co.uk/a/media/c7f5290a8a7347d88e6a7780acf5c246.jpg',
                'https://m.atcdn.co.uk/a/media/cac2179acd654140a1020201e33b44c8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385358,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4f4b2716ada144d3a412c9f243555495.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216109,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e75f7c8482be4d78b58fc629adbb3640.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 461984,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e4e96b3788640e3b89a2e5939688aba.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 426979,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b384856475644b759edb406698198a05.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 553621,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/85ee6a563fe2490482c509427637d65a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375703,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7544375fd885405c93c0073e363d5e9d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 570466,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ab4bd5caf074b8b800ee4ad0308513d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235763,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/273b3cb70c1c4f0a823bf9a65cefc166.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190564,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7f5290a8a7347d88e6a7780acf5c246.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7fca188-e3d2-5de7-92ab-d4aebe54c4cf/d7fca188-e3d2-5de7-92ab-d4aebe54c4cf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237544,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cac2179acd654140a1020201e33b44c8.jpg',
             'Width': 1920}],
 'price': 15995,
 'price_includes_vat': True,
 'registration_date': '2021-01-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SEAT Tarraco 1.5 Taracco Xcellence Luxury TSi Evo Semi-Auto 5dr',
 'transmission': 'automatic',
 'trim': 'XCELLENCE Lux',
 'year': 2021}
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170762112%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170762112: {'created_time': 1774883281.205351, 'last_price_update_time': 1774883281.205364}
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170762112') HTTP/1.1" 204 0
2026-03-30 15:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b8e1a2e974b44e29b4d808cb360ee06a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf23487-4af6-513b-b37b-c475b7cb5581 with identifier: 202603160748077
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcf23487-4af6-513b-b37b-c475b7cb5581
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2003e2da97b3413797b7c2aebe8eae2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2003e2da97b3413797b7c2aebe8eae2c.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcb2b58e61af4430da6a90eb206a3afaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cb2b58e61af4430da6a90eb206a3afaf.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38c41d1f6e6f42fa9101c4ea6964ef5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38c41d1f6e6f42fa9101c4ea6964ef5d.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20d0e3d0f8134373aebba12542a30718.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20d0e3d0f8134373aebba12542a30718.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e22a9682e1a4b879ce6c2526f6edb65.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e22a9682e1a4b879ce6c2526f6edb65.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde2298bf2ace4e3eb0b50690e5d97eda.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de2298bf2ace4e3eb0b50690e5d97eda.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8cc36f7c9dc04cf0b1fb382871127990.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8cc36f7c9dc04cf0b1fb382871127990.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28da8e2446664f959e051d2739937d5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28da8e2446664f959e051d2739937d5f.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b174d88b32f4688bb556370a6156270.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b174d88b32f4688bb556370a6156270.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F330d07abdbc243ba9b5ac60b2df5650b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/330d07abdbc243ba9b5ac60b2df5650b.jpg already downloaded
2026-03-30 15:08:01 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fcf23487-4af6-513b-b37b-c475b7cb5581 with identifier 202603160748077
2026-03-30 15:08:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fcf23487-4af6-513b-b37b-c475b7cb5581
2026-03-30 15:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Green',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 449,
 'fuel_type': 'Petrol Hybrid',
 'id': 'fcf23487-4af6-513b-b37b-c475b7cb5581',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160748077',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 22000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/2003e2da97b3413797b7c2aebe8eae2c.jpg',
                'https://m.atcdn.co.uk/a/media/cb2b58e61af4430da6a90eb206a3afaf.jpg',
                'https://m.atcdn.co.uk/a/media/38c41d1f6e6f42fa9101c4ea6964ef5d.jpg',
                'https://m.atcdn.co.uk/a/media/20d0e3d0f8134373aebba12542a30718.jpg',
                'https://m.atcdn.co.uk/a/media/3e22a9682e1a4b879ce6c2526f6edb65.jpg',
                'https://m.atcdn.co.uk/a/media/de2298bf2ace4e3eb0b50690e5d97eda.jpg',
                'https://m.atcdn.co.uk/a/media/8cc36f7c9dc04cf0b1fb382871127990.jpg',
                'https://m.atcdn.co.uk/a/media/28da8e2446664f959e051d2739937d5f.jpg',
                'https://m.atcdn.co.uk/a/media/2b174d88b32f4688bb556370a6156270.jpg',
                'https://m.atcdn.co.uk/a/media/330d07abdbc243ba9b5ac60b2df5650b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334042,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2003e2da97b3413797b7c2aebe8eae2c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213113,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cb2b58e61af4430da6a90eb206a3afaf.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440692,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/38c41d1f6e6f42fa9101c4ea6964ef5d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375820,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/20d0e3d0f8134373aebba12542a30718.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 349268,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e22a9682e1a4b879ce6c2526f6edb65.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 448028,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/de2298bf2ace4e3eb0b50690e5d97eda.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383915,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8cc36f7c9dc04cf0b1fb382871127990.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368484,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/28da8e2446664f959e051d2739937d5f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 423319,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b174d88b32f4688bb556370a6156270.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcf23487-4af6-513b-b37b-c475b7cb5581/fcf23487-4af6-513b-b37b-c475b7cb5581_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176857,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/330d07abdbc243ba9b5ac60b2df5650b.jpg',
             'Width': 1920}],
 'price': 31250,
 'price_includes_vat': True,
 'registration_date': '2023-04-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Hyundai 1.6 Santa Fe Ultimate HEV Auto 4WD 5dr',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2023}
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160748077%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160748077: {'created_time': 1774883281.50409, 'last_price_update_time': 1774883281.504101}
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160748077') HTTP/1.1" 204 0
2026-03-30 15:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 15:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 15:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd8d88cd0>
2026-03-30 15:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_0.jpg HTTP/1.1" 201 0
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9ab64cbe9e054f098f0ca1f8ea316471.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9ab64cbe9e054f098f0ca1f8ea316471.jpg saved to cache
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/98d81feabfcc4e41bd8cd4a1fc47a80a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/19f9de6320094b7884d9fe8aa17a54c6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e34585-2707-52fe-96c6-24614cf14513 with identifier: 202603040394065
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7e34585-2707-52fe-96c6-24614cf14513
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffebe2659ab87479b84b2af6f5e0e0570.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/febe2659ab87479b84b2af6f5e0e0570.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3eb2b2511d6a45b4b5f1ea377081a2aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3eb2b2511d6a45b4b5f1ea377081a2aa.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a02a9de7fb5430a9061aa278c179d90.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a02a9de7fb5430a9061aa278c179d90.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b8e81b67b664248a245254b84993f02.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b8e81b67b664248a245254b84993f02.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2f1fd171321e48648eb8c3fa80c00d49.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2f1fd171321e48648eb8c3fa80c00d49.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F653903daa39f4013b488892f41cebf1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/653903daa39f4013b488892f41cebf1b.jpg already downloaded
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd02cd61e513747afa611496f46315406.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d02cd61e513747afa611496f46315406.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff1f4a826b41e4bdf96460be3a75f5864.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f1f4a826b41e4bdf96460be3a75f5864.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdcd783cbf6d34258bc6dc1ac4bc7003c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dcd783cbf6d34258bc6dc1ac4bc7003c.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb4681e228daf4081904561bebb188d64.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b4681e228daf4081904561bebb188d64.jpg already downloaded
2026-03-30 15:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/243c1243ef354338b098b20247aeb190.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f7e34585-2707-52fe-96c6-24614cf14513 with identifier 202603040394065
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f7e34585-2707-52fe-96c6-24614cf14513
2026-03-30 15:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 136,
 'fuel_type': 'Diesel',
 'id': 'f7e34585-2707-52fe-96c6-24614cf14513',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040394065',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 65000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 33,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/febe2659ab87479b84b2af6f5e0e0570.jpg',
                'https://m.atcdn.co.uk/a/media/3eb2b2511d6a45b4b5f1ea377081a2aa.jpg',
                'https://m.atcdn.co.uk/a/media/9a02a9de7fb5430a9061aa278c179d90.jpg',
                'https://m.atcdn.co.uk/a/media/6b8e81b67b664248a245254b84993f02.jpg',
                'https://m.atcdn.co.uk/a/media/2f1fd171321e48648eb8c3fa80c00d49.jpg',
                'https://m.atcdn.co.uk/a/media/653903daa39f4013b488892f41cebf1b.jpg',
                'https://m.atcdn.co.uk/a/media/d02cd61e513747afa611496f46315406.jpg',
                'https://m.atcdn.co.uk/a/media/f1f4a826b41e4bdf96460be3a75f5864.jpg',
                'https://m.atcdn.co.uk/a/media/dcd783cbf6d34258bc6dc1ac4bc7003c.jpg',
                'https://m.atcdn.co.uk/a/media/b4681e228daf4081904561bebb188d64.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463507,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/febe2659ab87479b84b2af6f5e0e0570.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277563,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3eb2b2511d6a45b4b5f1ea377081a2aa.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367211,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9a02a9de7fb5430a9061aa278c179d90.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 440445,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b8e81b67b664248a245254b84993f02.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 414729,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2f1fd171321e48648eb8c3fa80c00d49.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376557,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/653903daa39f4013b488892f41cebf1b.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307728,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d02cd61e513747afa611496f46315406.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 387601,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f1f4a826b41e4bdf96460be3a75f5864.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261706,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dcd783cbf6d34258bc6dc1ac4bc7003c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7e34585-2707-52fe-96c6-24614cf14513/f7e34585-2707-52fe-96c6-24614cf14513_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236144,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b4681e228daf4081904561bebb188d64.jpg',
             'Width': 1920}],
 'price': 11295,
 'price_includes_vat': True,
 'registration_date': '2016-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA 2.0 Sportage KX-3 CRDi Auto 4WD 5dr',
 'transmission': 'automatic',
 'trim': 'KX-3',
 'year': 2016}
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040394065%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040394065: {'created_time': 1774883282.109387, 'last_price_update_time': 1774883282.109398}
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040394065') HTTP/1.1" 204 0
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd8d78b90>
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_1.jpg HTTP/1.1" 201 0
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8e1a2e974b44e29b4d808cb360ee06a.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8e1a2e974b44e29b4d808cb360ee06a.jpg saved to cache
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8ec45e38ab624962bc9f9c616cebb454.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/80559f1e5a1c4fae926da58f77ad333f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/78b788981db748bb851f4d7754981a83.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e2e96b-82c5-500e-bb1b-27ccc2b628cb with identifier: 202603010307990
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b1e2e96b-82c5-500e-bb1b-27ccc2b628cb
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3329f64b91984c2eb8ed2d3aff6b1898.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3329f64b91984c2eb8ed2d3aff6b1898.jpg already downloaded
2026-03-30 15:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0c4502e6547a4da4b54585f1afcc8234.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b1e2e96b-82c5-500e-bb1b-27ccc2b628cb with identifier 202603010307990
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b1e2e96b-82c5-500e-bb1b-27ccc2b628cb
2026-03-30 15:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 168,
 'fuel_type': 'Diesel',
 'id': 'b1e2e96b-82c5-500e-bb1b-27ccc2b628cb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603010307990',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 53170,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/3329f64b91984c2eb8ed2d3aff6b1898.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b1e2e96b-82c5-500e-bb1b-27ccc2b628cb/b1e2e96b-82c5-500e-bb1b-27ccc2b628cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127257,
             'Height': 1279,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3329f64b91984c2eb8ed2d3aff6b1898.jpg',
             'Width': 1920}],
 'price': 18000,
 'price_includes_vat': True,
 'registration_date': '2019-12-03',
 'seats_number': 17,
 'seller_name': None,
 'title': 'Ford 2.0 Transit 460 Trend EcoBlue',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2019}
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603010307990%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603010307990: {'created_time': 1774883282.274904, 'last_price_update_time': 1774883282.274913}
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603010307990') HTTP/1.1" 204 0
2026-03-30 15:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7e9c9abc9e914a63aa5dea4548cceaab.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9 with identifier: 202602250207163
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F988cbe5dce134bfe8fd47ded308de33e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/988cbe5dce134bfe8fd47ded308de33e.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa9cc12da7b04a3e859f96476ddf6850.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa9cc12da7b04a3e859f96476ddf6850.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec7ec6425bda40419250b57bb6c320ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec7ec6425bda40419250b57bb6c320ac.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5cfd021647644d1ba3c938f254b29990.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5cfd021647644d1ba3c938f254b29990.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faf05e0349a50415886d131eba0f5bd9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/af05e0349a50415886d131eba0f5bd9d.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5fb5636fb3749a4b3c255c14748e704.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5fb5636fb3749a4b3c255c14748e704.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7c427fe6419f42e9899c2058cb7aff45.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7c427fe6419f42e9899c2058cb7aff45.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2052d54803b4c6286dca0d583e4a5f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2052d54803b4c6286dca0d583e4a5f7.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff47001b2c4ec403cbb70e608abc20e23.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f47001b2c4ec403cbb70e608abc20e23.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F06177b6c69bd4bcda0cc8cf2bf8cb8f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/06177b6c69bd4bcda0cc8cf2bf8cb8f8.jpg already downloaded
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd8103810>
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_2.jpg HTTP/1.1" 201 0
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98d81feabfcc4e41bd8cd4a1fc47a80a.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98d81feabfcc4e41bd8cd4a1fc47a80a.jpg saved to cache
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd829f210>
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_4.jpg HTTP/1.1" 201 0
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19f9de6320094b7884d9fe8aa17a54c6.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19f9de6320094b7884d9fe8aa17a54c6.jpg saved to cache
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd82e67d0>
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_3.jpg HTTP/1.1" 201 0
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F243c1243ef354338b098b20247aeb190.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/243c1243ef354338b098b20247aeb190.jpg saved to cache
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9 with identifier 202602250207163
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9
2026-03-30 15:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a 2021 SEAT Tarraco 1.5 Taracco '
                'Xcellence Luxury TSi Evo Semi-Auto 5dr\n'
                '\n'
                'A nice looking and driving car with 2 keys and huge '
                'specification but with a few age related marks on the body',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': 'cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602250207163',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'SEAT',
 'model': 'Tarraco',
 'odometer': 58000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/988cbe5dce134bfe8fd47ded308de33e.jpg',
                'https://m.atcdn.co.uk/a/media/aa9cc12da7b04a3e859f96476ddf6850.jpg',
                'https://m.atcdn.co.uk/a/media/ec7ec6425bda40419250b57bb6c320ac.jpg',
                'https://m.atcdn.co.uk/a/media/5cfd021647644d1ba3c938f254b29990.jpg',
                'https://m.atcdn.co.uk/a/media/af05e0349a50415886d131eba0f5bd9d.jpg',
                'https://m.atcdn.co.uk/a/media/c5fb5636fb3749a4b3c255c14748e704.jpg',
                'https://m.atcdn.co.uk/a/media/7c427fe6419f42e9899c2058cb7aff45.jpg',
                'https://m.atcdn.co.uk/a/media/f2052d54803b4c6286dca0d583e4a5f7.jpg',
                'https://m.atcdn.co.uk/a/media/f47001b2c4ec403cbb70e608abc20e23.jpg',
                'https://m.atcdn.co.uk/a/media/06177b6c69bd4bcda0cc8cf2bf8cb8f8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 404039,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/988cbe5dce134bfe8fd47ded308de33e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195246,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa9cc12da7b04a3e859f96476ddf6850.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360847,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec7ec6425bda40419250b57bb6c320ac.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 443397,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5cfd021647644d1ba3c938f254b29990.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 397510,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/af05e0349a50415886d131eba0f5bd9d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413627,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c5fb5636fb3749a4b3c255c14748e704.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 463234,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7c427fe6419f42e9899c2058cb7aff45.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449675,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2052d54803b4c6286dca0d583e4a5f7.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146454,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f47001b2c4ec403cbb70e608abc20e23.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9/cfacd98a-f4a1-5ce5-bca7-e7cb91de20a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154779,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/06177b6c69bd4bcda0cc8cf2bf8cb8f8.jpg',
             'Width': 1920}],
 'price': 17795,
 'price_includes_vat': True,
 'registration_date': '2021-01-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SEAT Tarraco 1.5 Taracco Xcellence Luxury TSi Evo Semi-Auto 5dr',
 'transmission': 'automatic',
 'trim': 'XCELLENCE Lux',
 'year': 2021}
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250207163%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602250207163: {'created_time': 1774883282.687892, 'last_price_update_time': 1774883282.687903}
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250207163') HTTP/1.1" 204 0
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ef74f3a-154f-523d-ab65-b4194fb99545 with identifier: 202602250207140
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ef74f3a-154f-523d-ab65-b4194fb99545
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5bbae8b19ad4f6796ed64558068f62d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5bbae8b19ad4f6796ed64558068f62d.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9c6cfdb335f64a3d9ec9c8f41fb27481.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9c6cfdb335f64a3d9ec9c8f41fb27481.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa3adfb5060b549fabc3832d76a43db15.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a3adfb5060b549fabc3832d76a43db15.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fafc810304d3d499998ce1be2e93c2506.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/afc810304d3d499998ce1be2e93c2506.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F96277a68a84f4ca68faa95a6a818808c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/96277a68a84f4ca68faa95a6a818808c.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9a9c36a8fbc46d18db32bbf7c0af320.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9a9c36a8fbc46d18db32bbf7c0af320.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9c272bc7ef17479f95588fb99154071f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9c272bc7ef17479f95588fb99154071f.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe8b50a85dc61446abc1408852b7c184b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e8b50a85dc61446abc1408852b7c184b.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F080156b6d1214329a9faff8ea048c997.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/080156b6d1214329a9faff8ea048c997.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f26c815b89d49ac9659ece05b092cc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f26c815b89d49ac9659ece05b092cc7.jpg already downloaded
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8ef74f3a-154f-523d-ab65-b4194fb99545 with identifier 202602250207140
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8ef74f3a-154f-523d-ab65-b4194fb99545
2026-03-30 15:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 93,
 'fuel_type': 'Petrol',
 'id': '8ef74f3a-154f-523d-ab65-b4194fb99545',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602250207140',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 13000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/c5bbae8b19ad4f6796ed64558068f62d.jpg',
                'https://m.atcdn.co.uk/a/media/9c6cfdb335f64a3d9ec9c8f41fb27481.jpg',
                'https://m.atcdn.co.uk/a/media/a3adfb5060b549fabc3832d76a43db15.jpg',
                'https://m.atcdn.co.uk/a/media/afc810304d3d499998ce1be2e93c2506.jpg',
                'https://m.atcdn.co.uk/a/media/96277a68a84f4ca68faa95a6a818808c.jpg',
                'https://m.atcdn.co.uk/a/media/b9a9c36a8fbc46d18db32bbf7c0af320.jpg',
                'https://m.atcdn.co.uk/a/media/9c272bc7ef17479f95588fb99154071f.jpg',
                'https://m.atcdn.co.uk/a/media/e8b50a85dc61446abc1408852b7c184b.jpg',
                'https://m.atcdn.co.uk/a/media/080156b6d1214329a9faff8ea048c997.jpg',
                'https://m.atcdn.co.uk/a/media/3f26c815b89d49ac9659ece05b092cc7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 352648,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c5bbae8b19ad4f6796ed64558068f62d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 433942,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a3adfb5060b549fabc3832d76a43db15.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364835,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/afc810304d3d499998ce1be2e93c2506.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 384415,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/96277a68a84f4ca68faa95a6a818808c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400620,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9a9c36a8fbc46d18db32bbf7c0af320.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 383156,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9c272bc7ef17479f95588fb99154071f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 374075,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e8b50a85dc61446abc1408852b7c184b.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288546,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9c6cfdb335f64a3d9ec9c8f41fb27481.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 400477,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/080156b6d1214329a9faff8ea048c997.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ef74f3a-154f-523d-ab65-b4194fb99545/8ef74f3a-154f-523d-ab65-b4194fb99545_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 471435,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f26c815b89d49ac9659ece05b092cc7.jpg',
             'Width': 1920}],
 'price': 10795,
 'price_includes_vat': True,
 'registration_date': '2016-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki 1.2 Swift SZ4 Auto 5dr',
 'transmission': 'automatic',
 'trim': 'SZ4',
 'year': 2016}
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602250207140%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602250207140: {'created_time': 1774883282.950049, 'last_price_update_time': 1774883282.95006}
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250207140') HTTP/1.1" 204 0
2026-03-30 15:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 103cb10f-96f2-5ced-b5b0-4b3ca2af31a6 with identifier: 202602089769952
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 103cb10f-96f2-5ced-b5b0-4b3ca2af31a6
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4909afbd1ce34d509c4410d05a624d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4909afbd1ce34d509c4410d05a624d44.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d94b466f8f64daaa27679cfd0c2d4cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d94b466f8f64daaa27679cfd0c2d4cc.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F61d95c6acae7422ba4209e378ce23883.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/61d95c6acae7422ba4209e378ce23883.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdd62e362ed84470f96c4cc912d7bd081.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dd62e362ed84470f96c4cc912d7bd081.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9c06780f574e4652812c55539c51670c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9c06780f574e4652812c55539c51670c.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd905636e67e448a2bce26f6a0da95eb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d905636e67e448a2bce26f6a0da95eb7.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa40128a2ec7a464eb521eeae24a583d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a40128a2ec7a464eb521eeae24a583d4.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5b40d8810a824346a567375d0f6ace8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5b40d8810a824346a567375d0f6ace8c.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F601ae5e3abc34e4b9342eada49f1e420.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/601ae5e3abc34e4b9342eada49f1e420.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1262843fe7684b708fe26b2cb4eac833.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1262843fe7684b708fe26b2cb4eac833.jpg already downloaded
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd8d39890>
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_5.jpg HTTP/1.1" 201 0
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ec45e38ab624962bc9f9c616cebb454.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ec45e38ab624962bc9f9c616cebb454.jpg saved to cache
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd81c3010>
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_6.jpg HTTP/1.1" 201 0
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80559f1e5a1c4fae926da58f77ad333f.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80559f1e5a1c4fae926da58f77ad333f.jpg saved to cache
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd81c2a50>
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_8.jpg HTTP/1.1" 201 0
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78b788981db748bb851f4d7754981a83.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78b788981db748bb851f4d7754981a83.jpg saved to cache
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd81cac50>
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_7.jpg HTTP/1.1" 201 0
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c4502e6547a4da4b54585f1afcc8234.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c4502e6547a4da4b54585f1afcc8234.jpg saved to cache
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdbd81c3690>
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 15:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_9.jpg HTTP/1.1" 201 0
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7e9c9abc9e914a63aa5dea4548cceaab.jpg') HTTP/1.1" 204 0
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7e9c9abc9e914a63aa5dea4548cceaab.jpg saved to cache
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb sending to next pipeline
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 103cb10f-96f2-5ced-b5b0-4b3ca2af31a6 with identifier 202602089769952
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 103cb10f-96f2-5ced-b5b0-4b3ca2af31a6
2026-03-30 15:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'Introducing the stunning Genesis Gv70 2.5 GV70 Sport Line T '
                'AWD Auto 4WD 5dr, a true masterpiece on wheels. With only '
                '9714 miles on the clock and 2 owners from new, this vehicle '
                'is in impeccable condition and ready to hit the road in '
                'style.\n'
                '\n'
                'Finished in a striking Red colour, this Genesis Gv70 is sure '
                "to turn heads wherever you go. But that's not all - this "
                'beauty comes loaded with extras, including the Innovation '
                'Pack and luxurious Mauna Red Leather interior with Sevilla '
                'Red-Obsidian Black accents.\n'
                '\n'
                'Experience the ultimate in luxury and performance with the '
                "Genesis Gv70. Don't miss your chance to own this exceptional "
                'vehicle. Visit us today and take it for a test drive!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 300,
 'fuel_type': 'Petrol',
 'id': '103cb10f-96f2-5ced-b5b0-4b3ca2af31a6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602089769952',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Genesis',
 'model': 'GV70',
 'odometer': 9714,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/4909afbd1ce34d509c4410d05a624d44.jpg',
                'https://m.atcdn.co.uk/a/media/6d94b466f8f64daaa27679cfd0c2d4cc.jpg',
                'https://m.atcdn.co.uk/a/media/61d95c6acae7422ba4209e378ce23883.jpg',
                'https://m.atcdn.co.uk/a/media/dd62e362ed84470f96c4cc912d7bd081.jpg',
                'https://m.atcdn.co.uk/a/media/9c06780f574e4652812c55539c51670c.jpg',
                'https://m.atcdn.co.uk/a/media/d905636e67e448a2bce26f6a0da95eb7.jpg',
                'https://m.atcdn.co.uk/a/media/a40128a2ec7a464eb521eeae24a583d4.jpg',
                'https://m.atcdn.co.uk/a/media/5b40d8810a824346a567375d0f6ace8c.jpg',
                'https://m.atcdn.co.uk/a/media/601ae5e3abc34e4b9342eada49f1e420.jpg',
                'https://m.atcdn.co.uk/a/media/1262843fe7684b708fe26b2cb4eac833.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 412072,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4909afbd1ce34d509c4410d05a624d44.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290596,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d94b466f8f64daaa27679cfd0c2d4cc.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609925,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/61d95c6acae7422ba4209e378ce23883.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 517757,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dd62e362ed84470f96c4cc912d7bd081.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 533452,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9c06780f574e4652812c55539c51670c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 511397,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d905636e67e448a2bce26f6a0da95eb7.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 509374,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a40128a2ec7a464eb521eeae24a583d4.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468740,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5b40d8810a824346a567375d0f6ace8c.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 409461,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/601ae5e3abc34e4b9342eada49f1e420.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_103cb10f-96f2-5ced-b5b0-4b3ca2af31a6/103cb10f-96f2-5ced-b5b0-4b3ca2af31a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215218,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1262843fe7684b708fe26b2cb4eac833.jpg',
             'Width': 1920}],
 'price': 32995,
 'price_includes_vat': True,
 'registration_date': '2021-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Genesis 2.5 GV70 Sport Line T AWD Auto 4WD 5dr',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602089769952%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602089769952: {'created_time': 1774883283.462052, 'last_price_update_time': 1774883283.462066}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602089769952') HTTP/1.1" 204 0
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb with identifier 202603291111281
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 202f8a89-3701-5ef9-bb3a-f0d1f0166cfb
2026-03-30 15:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7e9c9abc9e914a63aa5dea4548cceaab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 181,
 'fuel_type': 'Petrol',
 'id': '202f8a89-3701-5ef9-bb3a-f0d1f0166cfb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603291111281',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'BMW',
 'model': '4 Series',
 'odometer': 17823,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 42,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190153,
             'Height': 1446,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9ab64cbe9e054f098f0ca1f8ea316471.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185293,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b8e1a2e974b44e29b4d808cb360ee06a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174376,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/98d81feabfcc4e41bd8cd4a1fc47a80a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230500,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/243c1243ef354338b098b20247aeb190.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177275,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/19f9de6320094b7884d9fe8aa17a54c6.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145246,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8ec45e38ab624962bc9f9c616cebb454.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 177792,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/80559f1e5a1c4fae926da58f77ad333f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170480,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c4502e6547a4da4b54585f1afcc8234.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 170314,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/78b788981db748bb851f4d7754981a83.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_202f8a89-3701-5ef9-bb3a-f0d1f0166cfb/202f8a89-3701-5ef9-bb3a-f0d1f0166cfb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174607,
             'Height': 1445,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7e9c9abc9e914a63aa5dea4548cceaab.jpg',
             'Width': 1920}],
 'price': 26995,
 'price_includes_vat': True,
 'registration_date': '2021-06-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4 SERIES 2.0 420i M Sport Auto 2dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603291111281%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603291111281: {'created_time': 1774883283.521318, 'last_price_update_time': 1774883283.52133}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603291111281') HTTP/1.1" 204 0
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7acf02c7-bd58-5175-a07e-74aaa5e38daf with identifier: 202511027593892
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7acf02c7-bd58-5175-a07e-74aaa5e38daf
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fee5993e07f5d47c6be7a2cbdbfe21425.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ee5993e07f5d47c6be7a2cbdbfe21425.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01f0fb1e9355446ca8db3dd7ade5b671.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01f0fb1e9355446ca8db3dd7ade5b671.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd31f758e2fb74f2fbbc4bdcba864b519.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d31f758e2fb74f2fbbc4bdcba864b519.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F501fcafb3ba549edbef27d3fdd9489a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/501fcafb3ba549edbef27d3fdd9489a4.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24123e3440bd4d52b2c28f521fb3eba2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24123e3440bd4d52b2c28f521fb3eba2.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F744571af09ee4dd490bc6d7b1c0b5d90.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/744571af09ee4dd490bc6d7b1c0b5d90.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8d123386b8a343cc8dd8b1636f9f73e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8d123386b8a343cc8dd8b1636f9f73e2.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85c2abaacda9455fb4c4e7f2cf86aad6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85c2abaacda9455fb4c4e7f2cf86aad6.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ff2aa4566504f1ea87238d80109084a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ff2aa4566504f1ea87238d80109084a.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F522ce53f4d3649fb8b70633ffdbd079f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/522ce53f4d3649fb8b70633ffdbd079f.jpg already downloaded
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7acf02c7-bd58-5175-a07e-74aaa5e38daf with identifier 202511027593892
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7acf02c7-bd58-5175-a07e-74aaa5e38daf
2026-03-30 15:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'With only one owner from new, benefiting from a full Lexus '
                'service history and the remainder of the 10 year "Lexus relax '
                'warranty", this 2022 Lexus RX L 450h L Takumi is a superb '
                'example of a well-maintained vehicle. The top of the range '
                'Takumi trim complements the smooth and efficient 3.5L Petrol '
                'Hybrid engine, coupled with a Four Wheel Drive drivetrain for '
                'confident handling in various conditions. The vehicle meets '
                "Euro 6 emission standards. Inside, you'll find a spacious "
                'seven-seat configuration, perfect for families or those '
                'needing extra passenger space. The cabin is equipped with a 3 '
                'Zone Climate Control Air Conditioning System featuring S Flow '
                'and Nanoe Technology, ensuring a comfortable environment for '
                'all occupants. Stay connected and entertained with Apple '
                'CarPlay and Android Auto, and enjoy enhanced safety features '
                'from the Tech and Safety Pack, including Blind Spot '
                'Assistance, a Head Up Display, 360 Degree Cameras, and a '
                'Sunroof. The Mark Levinson Premium Surround Sound System with '
                '15 Speakers provides an immersive audio experience. All our '
                'Cars Benefit From A Free 12 Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.\n'
                '\n'
                'With only one owner from new, benefiting from a full Lexus '
                'service history and the remainder of the 10 year "Lexus relax '
                'warranty", this 2022 Lexus RX L 450h L Takumi is a superb '
                'example of a well-maintained vehicle. The top of the range '
                'Takumi trim complements the smooth and efficient 3.5L Petrol '
                'Hybrid engine, coupled with a Four Wheel Drive drivetrain for '
                'confident handling in various conditions. The vehicle meets '
                "Euro 6 emission standards. Inside, you'll find a spacious "
                'seven-seat configuration, perfect for families or those '
                'needing extra passenger space. The cabin is equipped with a 3 '
                'Zone Climate Control Air Conditioning System featuring S Flow '
                'and Nanoe Technology, ensuring a comfortable environment for '
                'all occupants. Stay connected and entertained with Apple '
                'CarPlay and Android Auto, and enjoy enhanced safety features '
                'from the Tech and Safety Pack, including Blind Spot '
                'Assistance, a Head Up Display, 360 Degree Cameras, and a '
                'Sunroof. The Mark Levinson Premium Surround Sound System with '
                '15 Speakers provides an immersive audio experience. All our '
                'Cars Benefit From A Free 12 Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3.5L',
 'engine_horse_power': 309,
 'fuel_type': 'Petrol Hybrid',
 'id': '7acf02c7-bd58-5175-a07e-74aaa5e38daf',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511027593892',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Lexus',
 'model': 'RX L',
 'odometer': 39000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/ee5993e07f5d47c6be7a2cbdbfe21425.jpg',
                'https://m.atcdn.co.uk/a/media/01f0fb1e9355446ca8db3dd7ade5b671.jpg',
                'https://m.atcdn.co.uk/a/media/d31f758e2fb74f2fbbc4bdcba864b519.jpg',
                'https://m.atcdn.co.uk/a/media/501fcafb3ba549edbef27d3fdd9489a4.jpg',
                'https://m.atcdn.co.uk/a/media/24123e3440bd4d52b2c28f521fb3eba2.jpg',
                'https://m.atcdn.co.uk/a/media/744571af09ee4dd490bc6d7b1c0b5d90.jpg',
                'https://m.atcdn.co.uk/a/media/8d123386b8a343cc8dd8b1636f9f73e2.jpg',
                'https://m.atcdn.co.uk/a/media/85c2abaacda9455fb4c4e7f2cf86aad6.jpg',
                'https://m.atcdn.co.uk/a/media/2ff2aa4566504f1ea87238d80109084a.jpg',
                'https://m.atcdn.co.uk/a/media/522ce53f4d3649fb8b70633ffdbd079f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 364884,
             'Height': 1438,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee5993e07f5d47c6be7a2cbdbfe21425.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160105,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/01f0fb1e9355446ca8db3dd7ade5b671.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 347575,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d31f758e2fb74f2fbbc4bdcba864b519.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 328903,
             'Height': 1441,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/501fcafb3ba549edbef27d3fdd9489a4.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 357693,
             'Height': 1441,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/24123e3440bd4d52b2c28f521fb3eba2.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 331969,
             'Height': 1437,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/744571af09ee4dd490bc6d7b1c0b5d90.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 321355,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8d123386b8a343cc8dd8b1636f9f73e2.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325759,
             'Height': 1435,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/85c2abaacda9455fb4c4e7f2cf86aad6.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351926,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ff2aa4566504f1ea87238d80109084a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf02c7-bd58-5175-a07e-74aaa5e38daf/7acf02c7-bd58-5175-a07e-74aaa5e38daf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190242,
             'Height': 1442,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/522ce53f4d3649fb8b70633ffdbd079f.jpg',
             'Width': 1920}],
 'price': 35990,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Lexus RX L 3.5 450h L V6 Takumi SUV 5dr Petrol Hybrid E-CVT 4WD '
          'Euro 6 (s/s) (313 ps)',
 'transmission': 'automatic',
 'trim': 'Takumi',
 'year': 2022}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511027593892%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511027593892: {'created_time': 1774883283.803851, 'last_price_update_time': 1774883283.803863}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511027593892') HTTP/1.1" 204 0
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b33aabf-5181-5322-a586-f12c7de6c2bd with identifier: 202509286705433
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b33aabf-5181-5322-a586-f12c7de6c2bd
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F16850e52c5b94c47ad885317ccd54869.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/16850e52c5b94c47ad885317ccd54869.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b9bc0030ea04e9f8f80b4e21bbfd0d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b9bc0030ea04e9f8f80b4e21bbfd0d0.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdfd553d95e5d4987933f10520456998e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dfd553d95e5d4987933f10520456998e.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29c5b7f01b6e4dfaa2356267082540c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29c5b7f01b6e4dfaa2356267082540c2.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F315d3991a75741248d552f860a83b240.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/315d3991a75741248d552f860a83b240.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13de3bdc4685414eb4472a9ef3cfdeb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13de3bdc4685414eb4472a9ef3cfdeb2.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19dbceb0cec749ffb9c4c445ab3260d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19dbceb0cec749ffb9c4c445ab3260d5.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7113b06046934a3289afc7095d026824.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7113b06046934a3289afc7095d026824.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a1f9ba948a44f3787f2e8fe5f2ad978.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a1f9ba948a44f3787f2e8fe5f2ad978.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3febef65efb44f53b79fdaad9d256969.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3febef65efb44f53b79fdaad9d256969.jpg already downloaded
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5b33aabf-5181-5322-a586-f12c7de6c2bd with identifier 202509286705433
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5b33aabf-5181-5322-a586-f12c7de6c2bd
2026-03-30 15:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a 2017 (67)  BMW I3 33kWh Hatchback 5dr '
                'Electric Auto (170 ps)\n'
                '\n'
                'A lovely example with only 2 former keepers and benefiting '
                'from service history, 2 keys and great specification All our '
                'Cars Benefit From A Free 12 Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.\n'
                '\n'
                'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a 2017 (67)  BMW I3 33kWh Hatchback 5dr '
                'Electric Auto (170 ps)\n'
                '\n'
                'A lovely example with only 2 former keepers and benefiting '
                'from service history, 2 keys and great specification All our '
                'Cars Benefit From A Free 12 Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 5,
 'engine_horse_power': 168,
 'fuel_type': 'Electric',
 'id': '5b33aabf-5181-5322-a586-f12c7de6c2bd',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509286705433',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'BMW',
 'model': 'i3',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 36,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/16850e52c5b94c47ad885317ccd54869.jpg',
                'https://m.atcdn.co.uk/a/media/6b9bc0030ea04e9f8f80b4e21bbfd0d0.jpg',
                'https://m.atcdn.co.uk/a/media/dfd553d95e5d4987933f10520456998e.jpg',
                'https://m.atcdn.co.uk/a/media/29c5b7f01b6e4dfaa2356267082540c2.jpg',
                'https://m.atcdn.co.uk/a/media/315d3991a75741248d552f860a83b240.jpg',
                'https://m.atcdn.co.uk/a/media/13de3bdc4685414eb4472a9ef3cfdeb2.jpg',
                'https://m.atcdn.co.uk/a/media/19dbceb0cec749ffb9c4c445ab3260d5.jpg',
                'https://m.atcdn.co.uk/a/media/7113b06046934a3289afc7095d026824.jpg',
                'https://m.atcdn.co.uk/a/media/4a1f9ba948a44f3787f2e8fe5f2ad978.jpg',
                'https://m.atcdn.co.uk/a/media/3febef65efb44f53b79fdaad9d256969.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 439497,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/16850e52c5b94c47ad885317ccd54869.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270205,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b9bc0030ea04e9f8f80b4e21bbfd0d0.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 399398,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dfd553d95e5d4987933f10520456998e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365817,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/29c5b7f01b6e4dfaa2356267082540c2.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 371564,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/315d3991a75741248d552f860a83b240.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382778,
             'Height': 1439,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/13de3bdc4685414eb4472a9ef3cfdeb2.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 300259,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/19dbceb0cec749ffb9c4c445ab3260d5.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370280,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7113b06046934a3289afc7095d026824.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304538,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a1f9ba948a44f3787f2e8fe5f2ad978.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b33aabf-5181-5322-a586-f12c7de6c2bd/5b33aabf-5181-5322-a586-f12c7de6c2bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230408,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3febef65efb44f53b79fdaad9d256969.jpg',
             'Width': 1920}],
 'price': 8295,
 'price_includes_vat': True,
 'registration_date': '2017-11-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW I3 33kWh Hatchback 5dr Electric Auto (170 ps)',
 'transmission': 'automatic',
 'year': 2017}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509286705433%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509286705433: {'created_time': 1774883284.109201, 'last_price_update_time': 1774883284.10921}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509286705433') HTTP/1.1" 204 0
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 855acec2-c05b-5035-a900-75ca32744e6e with identifier: 202509096185810
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 855acec2-c05b-5035-a900-75ca32744e6e
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F031985ac581644edab82fd460b383eb5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/031985ac581644edab82fd460b383eb5.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9134061177274e64bc8e46983372ae7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9134061177274e64bc8e46983372ae7f.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ded64a990fc42178674b9dbe98da440.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ded64a990fc42178674b9dbe98da440.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F14e3f456aede41b1916f22c0d83e74ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/14e3f456aede41b1916f22c0d83e74ca.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55f35f0af170437f9a4a7a0d0cfc825d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55f35f0af170437f9a4a7a0d0cfc825d.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F46142febba1a4d2f849dab36c092fc94.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/46142febba1a4d2f849dab36c092fc94.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77d4a0d18b3442e89ece7372824d946a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77d4a0d18b3442e89ece7372824d946a.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3919737ae82c47cb892c224a9e60ec95.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3919737ae82c47cb892c224a9e60ec95.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F826cd49ac9154196b63b9dddb4976808.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/826cd49ac9154196b63b9dddb4976808.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde883695a0144607b45aa2eac3b36b5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de883695a0144607b45aa2eac3b36b5f.jpg already downloaded
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 855acec2-c05b-5035-a900-75ca32744e6e with identifier 202509096185810
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 855acec2-c05b-5035-a900-75ca32744e6e
2026-03-30 15:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Finance Available, Here we have for sale a LAND ROVER RANGE '
                'ROVER SPORT 3.0 P400 MHEV HST SUV 5dr Petrol Auto 4WD Euro 6 '
                '(s/s) (400 ps).\n'
                'This car finished in a stunning Polaris White has had just 1 '
                'former keeper, is ULEZ Compliant and benefits from a full '
                'Land Rover service history, 2 keys and great specification '
                'including:\n'
                'Panoramic glass roof, 360 Camera, Meridian Sound System, '
                'Heated and ventilated seats, Blind Spot indicators and a Head '
                'up Display. All our Cars Benefit From A Free 12 Month AA '
                'Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.\n'
                '\n'
                'Finance Available, Here we have for sale a LAND ROVER RANGE '
                'ROVER SPORT 3.0 P400 MHEV HST SUV 5dr Petrol Auto 4WD Euro 6 '
                '(s/s) (400 ps).\n'
                'This car finished in a stunning Polaris White has had just 1 '
                'former keeper, is ULEZ Compliant and benefits from a full '
                'Land Rover service history, 2 keys and great specification '
                'including:\n'
                'Panoramic glass roof, 360 Camera, Meridian Sound System, '
                'Heated and ventilated seats, Blind Spot indicators and a Head '
                'up Display. All our Cars Benefit From A Free 12 Month AA '
                'Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 395,
 'fuel_type': 'Petrol',
 'id': '855acec2-c05b-5035-a900-75ca32744e6e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509096185810',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 37000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/031985ac581644edab82fd460b383eb5.jpg',
                'https://m.atcdn.co.uk/a/media/9134061177274e64bc8e46983372ae7f.jpg',
                'https://m.atcdn.co.uk/a/media/3ded64a990fc42178674b9dbe98da440.jpg',
                'https://m.atcdn.co.uk/a/media/14e3f456aede41b1916f22c0d83e74ca.jpg',
                'https://m.atcdn.co.uk/a/media/55f35f0af170437f9a4a7a0d0cfc825d.jpg',
                'https://m.atcdn.co.uk/a/media/46142febba1a4d2f849dab36c092fc94.jpg',
                'https://m.atcdn.co.uk/a/media/77d4a0d18b3442e89ece7372824d946a.jpg',
                'https://m.atcdn.co.uk/a/media/3919737ae82c47cb892c224a9e60ec95.jpg',
                'https://m.atcdn.co.uk/a/media/826cd49ac9154196b63b9dddb4976808.jpg',
                'https://m.atcdn.co.uk/a/media/de883695a0144607b45aa2eac3b36b5f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389144,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/031985ac581644edab82fd460b383eb5.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 293389,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9134061177274e64bc8e46983372ae7f.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 394371,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ded64a990fc42178674b9dbe98da440.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 411079,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/14e3f456aede41b1916f22c0d83e74ca.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 434484,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/55f35f0af170437f9a4a7a0d0cfc825d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 378553,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/46142febba1a4d2f849dab36c092fc94.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380805,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/77d4a0d18b3442e89ece7372824d946a.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402989,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3919737ae82c47cb892c224a9e60ec95.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449263,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/826cd49ac9154196b63b9dddb4976808.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_855acec2-c05b-5035-a900-75ca32744e6e/855acec2-c05b-5035-a900-75ca32744e6e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 229725,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/de883695a0144607b45aa2eac3b36b5f.jpg',
             'Width': 1920}],
 'price': 33995,
 'price_includes_vat': True,
 'registration_date': '2019-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 P400 MHEV HST SUV 5dr Petrol Auto '
          '4WD Euro 6 (s/s) (400 ps) ONLY 1 FORMER KEEPER FSH ULEZ FREE',
 'transmission': 'automatic',
 'trim': 'HST',
 'year': 2019}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509096185810%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509096185810: {'created_time': 1774883284.496387, 'last_price_update_time': 1774883284.4964}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509096185810') HTTP/1.1" 204 0
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bff212a-16b1-5336-84b1-aa840d479369 with identifier: 202508075233145
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bff212a-16b1-5336-84b1-aa840d479369
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9474b9165b74e04b6b31c79b22957c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9474b9165b74e04b6b31c79b22957c7.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe75572aa07494d2880e5c3e6f1e6eb8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e75572aa07494d2880e5c3e6f1e6eb8e.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F961e94b0aa3c4a9f9cc7bce950aa8867.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/961e94b0aa3c4a9f9cc7bce950aa8867.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb036cb958dc4437a1debab147205d2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb036cb958dc4437a1debab147205d2d.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fead1084955c84d62b9707a9721407e3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ead1084955c84d62b9707a9721407e3d.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffbc5ca8e65c140e18d1ea538d46c41a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fbc5ca8e65c140e18d1ea538d46c41a7.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fef5838f7b0f3440e8cb45f7d16c44337.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ef5838f7b0f3440e8cb45f7d16c44337.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26a6de83b4764ae2a7bd719efcf8d395.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26a6de83b4764ae2a7bd719efcf8d395.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc30f0cf1e63417a8cc848e9606be78e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc30f0cf1e63417a8cc848e9606be78e.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F50c5ca702cbd4a09b404d2b1332bd233.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/50c5ca702cbd4a09b404d2b1332bd233.jpg already downloaded
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8bff212a-16b1-5336-84b1-aa840d479369 with identifier 202508075233145
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8bff212a-16b1-5336-84b1-aa840d479369
2026-03-30 15:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a VOLVO S60 2.0 T5 Inscription Plus '
                'Saloon 4dr Petrol Auto Euro 6 (s/s) (250 ps).\n'
                '\n'
                'This car has had just one owner from new and has covered only '
                '15000 miles, benefits from a full Volvo service history, 2 '
                'Keys and huge specification. All our Cars Benefit From A Free '
                '12 Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.\n'
                '\n'
                'FINANCE AVAILABLE\n'
                '\n'
                'Here we have for sale a VOLVO S60 2.0 T5 Inscription Plus '
                'Saloon 4dr Petrol Auto Euro 6 (s/s) (250 ps).\n'
                '\n'
                'This car has had just one owner from new and has covered only '
                '15000 miles, benefits from a full Volvo service history, 2 '
                'Keys and huge specification. All our Cars Benefit From A Free '
                '12 Month AA Break Down Cover  \n'
                '\n'
                ' All Major Debit Cards Accepted and Part Exchange Welcome  \n'
                '\n'
                'We Are Open Monday - Thursday 09:30 - 18:00 Friday 09:30 - '
                '13:00 Saturday Closed Sunday 10:30 - 17:00  \n'
                '\n'
                'Please Call KeeCars Today On 020 8806 2277 for More Details '
                'Or to Arrange a Viewing.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 247,
 'fuel_type': 'Petrol',
 'id': '8bff212a-16b1-5336-84b1-aa840d479369',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508075233145',
 'listing': 'directbuy',
 'location': 'Clapton, Middlesex',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/f9474b9165b74e04b6b31c79b22957c7.jpg',
                'https://m.atcdn.co.uk/a/media/e75572aa07494d2880e5c3e6f1e6eb8e.jpg',
                'https://m.atcdn.co.uk/a/media/961e94b0aa3c4a9f9cc7bce950aa8867.jpg',
                'https://m.atcdn.co.uk/a/media/bb036cb958dc4437a1debab147205d2d.jpg',
                'https://m.atcdn.co.uk/a/media/ead1084955c84d62b9707a9721407e3d.jpg',
                'https://m.atcdn.co.uk/a/media/fbc5ca8e65c140e18d1ea538d46c41a7.jpg',
                'https://m.atcdn.co.uk/a/media/ef5838f7b0f3440e8cb45f7d16c44337.jpg',
                'https://m.atcdn.co.uk/a/media/26a6de83b4764ae2a7bd719efcf8d395.jpg',
                'https://m.atcdn.co.uk/a/media/bc30f0cf1e63417a8cc848e9606be78e.jpg',
                'https://m.atcdn.co.uk/a/media/50c5ca702cbd4a09b404d2b1332bd233.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326002,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9474b9165b74e04b6b31c79b22957c7.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253360,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e75572aa07494d2880e5c3e6f1e6eb8e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 351631,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/961e94b0aa3c4a9f9cc7bce950aa8867.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 524141,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb036cb958dc4437a1debab147205d2d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 526421,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ead1084955c84d62b9707a9721407e3d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451293,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fbc5ca8e65c140e18d1ea538d46c41a7.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449468,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ef5838f7b0f3440e8cb45f7d16c44337.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 435798,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/26a6de83b4764ae2a7bd719efcf8d395.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319305,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc30f0cf1e63417a8cc848e9606be78e.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bff212a-16b1-5336-84b1-aa840d479369/8bff212a-16b1-5336-84b1-aa840d479369_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219096,
             'Height': 1440,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/50c5ca702cbd4a09b404d2b1332bd233.jpg',
             'Width': 1920}],
 'price': 21490,
 'price_includes_vat': True,
 'registration_date': '2020-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S60 2.0 T5 Inscription Plus Saloon 4dr Petrol Auto Euro 6 '
          '(s/s) (250 ps) 1 OWNER FROM NEW, FDSH',
 'transmission': 'automatic',
 'trim': 'Inscription Plus',
 'year': 2020}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508075233145%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508075233145: {'created_time': 1774883284.768194, 'last_price_update_time': 1774883284.768206}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508075233145') HTTP/1.1" 204 0
2026-03-30 15:08:04 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:08:04 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:08:04 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4a6c0c222c1f11f18e133aacc95538c6
2026-03-30 15:08:04 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:08:04 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:08:04 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:04 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 4, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587285 HTTP/1.1" 200 None
2026-03-30 15:08:05 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (24 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4a6c0c222c1f11f18e133aacc95538c6.jl
2026-03-30 15:08:05 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 190285,
 'downloader/request_count': 15,
 'downloader/request_method_count/GET': 10,
 'downloader/request_method_count/POST': 5,
 'downloader/response_bytes': 2953049,
 'downloader/response_count': 15,
 'downloader/response_status_count/200': 15,
 'elapsed_time_seconds': 17.813507,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 15, 8, 5, 644254, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 24,
 'log_count/DEBUG': 777,
 'log_count/ERROR': 8,
 'log_count/INFO': 498,
 'memusage/max': 147574784,
 'memusage/startup': 147574784,
 'photo_download_count': 10,
 'request_depth_max': 2,
 'response_received_count': 5,
 'scheduler/dequeued': 15,
 'scheduler/dequeued/memory': 15,
 'scheduler/enqueued': 15,
 'scheduler/enqueued/memory': 15,
 'scrape_type/new': 24,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 5,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.4764956053346396,
 'scrapy-zyte-api/mean_response_seconds': 2.6630573578178884,
 'scrapy-zyte-api/processed': 5,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 5,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 4,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 5,
 'scrapy-zyte-api/request_args/httpRequestBody': 5,
 'scrapy-zyte-api/request_args/httpRequestMethod': 5,
 'scrapy-zyte-api/request_args/httpResponseBody': 5,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 5,
 'scrapy-zyte-api/request_args/url': 5,
 'scrapy-zyte-api/status_codes/200': 5,
 'scrapy-zyte-api/success': 5,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 30, 15, 7, 47, 830747, tzinfo=datetime.timezone.utc)}
2026-03-30 15:08:05 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:08:05 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdbdc19b210>
2026-03-30 15:08:05 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdbdc19ba50>

PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)