PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2026-03-30 15:14:57 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:14:57 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:14:57 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:14:57 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:14:57 [auto_selling_autotrader.co.uk] INFO: _job: 4ac6603c2c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:14:57 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:14:57 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:14:57 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:14:57 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:14:57 [scrapy.extensions.telnet] INFO: Telnet Password: d689833afe597098
2026-03-30 15:14:57 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:14:57 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4ac6603c2c1f11f18e133aacc95538c6.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 15:14:57 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:14:57 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:14:57 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:14:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:14:57 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:14:57 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:14:57 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:14:57 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:14:57 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:14:57 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:14:57 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:14:57 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 15:14:57 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 15:14:57 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:14:57 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:15:02 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10032279 and multipost_profile_id: 0c817721-ca7c-4e0e-8638-45e93b307da6 and job_id: 4ac6603c2c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10032279&sort=price-asc
2026-03-30 15:15:02 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10032279, page: 1
2026-03-30 15:15:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:15:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 13
2026-03-30 15:15:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2119
2026-03-30 15:15:04 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602280298361%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602280298361: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240184132%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240184132: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299506942%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299506942: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299505810%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299505810: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299505787%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299505787: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601169212373%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601169212373: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149148866%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149148866: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149148806%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149148806: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268159390%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268159390: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268150261%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268150261: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509216511059%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509216511059: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508295874056%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508295874056: 1
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507144467527%27 HTTP/1.1" 200 None
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202507144467527: 1
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:15:04 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 3 detail requests (batch 2)
2026-03-30 15:15:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:15:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:15:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:15:06 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:06 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ecee1b-e9e1-57dd-a2aa-8f5340a577f2 with identifier: 202509216511059
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77ecee1b-e9e1-57dd-a2aa-8f5340a577f2
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd54f7cf0f4ac4722acbdd5bae6eec9d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d54f7cf0f4ac4722acbdd5bae6eec9d3.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dde0d5190c844bba89c2e268d07dc5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dde0d5190c844bba89c2e268d07dc5f.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c1076e8b55a4912b6722a29cdf86aec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c1076e8b55a4912b6722a29cdf86aec.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe2f7c4cd74af479082667bc31da03a4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e2f7c4cd74af479082667bc31da03a4c.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F228f85c73b044b17907b504d0300e095.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/228f85c73b044b17907b504d0300e095.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fddc3e605c69c4621b7ea3036805e4302.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ddc3e605c69c4621b7ea3036805e4302.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62750839133c4f76a50a8fcd187939d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62750839133c4f76a50a8fcd187939d5.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40eb172218914ddb8fd100f677a6d760.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40eb172218914ddb8fd100f677a6d760.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F99699dc602ab44c99c10ec726b0c7aab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/99699dc602ab44c99c10ec726b0c7aab.jpg already downloaded
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F571db78fb4bb4d6d9ce4d7919459432a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/571db78fb4bb4d6d9ce4d7919459432a.jpg already downloaded
2026-03-30 15:15:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 77ecee1b-e9e1-57dd-a2aa-8f5340a577f2 with identifier 202509216511059
2026-03-30 15:15:06 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:15:06 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:15:06 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:15:06 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:06 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:15:06 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2013
2026-03-30 15:15:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883706
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883706
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:06 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 77ecee1b-e9e1-57dd-a2aa-8f5340a577f2
2026-03-30 15:15:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Black',
'currency': 'GBP',
'description': 'Discover this 2013 Ford Focus Zetec T with remarkably low '
'mileage for its age, having covered just 65,961 miles. This '
'well maintained example boasts a 1.0L petrol engine and comes '
'equipped with desirable features such as air conditioning for '
'your comfort and Bluetooth handsfree with voice control, '
'allowing for safe and convenient connectivity on the go.\n'
'\n'
'The Ford Focus Zetec T offers excellent efficiency, achieving '
'an impressive 60 miles per gallon, which is a significant '
'advantage over many similar vehicles. Its low CO2 emissions '
"further contribute to its economical running costs. You'll "
'also appreciate the generous boot space, making it a '
'practical choice for families or those who need ample room '
'for luggage or shopping.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': '77ecee1b-e9e1-57dd-a2aa-8f5340a577f2',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509216511059',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Ford',
'model': 'Focus',
'odometer': 65961,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d54f7cf0f4ac4722acbdd5bae6eec9d3.jpg',
'https://m.atcdn.co.uk/a/media/0dde0d5190c844bba89c2e268d07dc5f.jpg',
'https://m.atcdn.co.uk/a/media/8c1076e8b55a4912b6722a29cdf86aec.jpg',
'https://m.atcdn.co.uk/a/media/e2f7c4cd74af479082667bc31da03a4c.jpg',
'https://m.atcdn.co.uk/a/media/228f85c73b044b17907b504d0300e095.jpg',
'https://m.atcdn.co.uk/a/media/ddc3e605c69c4621b7ea3036805e4302.jpg',
'https://m.atcdn.co.uk/a/media/62750839133c4f76a50a8fcd187939d5.jpg',
'https://m.atcdn.co.uk/a/media/40eb172218914ddb8fd100f677a6d760.jpg',
'https://m.atcdn.co.uk/a/media/99699dc602ab44c99c10ec726b0c7aab.jpg',
'https://m.atcdn.co.uk/a/media/571db78fb4bb4d6d9ce4d7919459432a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462313,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d54f7cf0f4ac4722acbdd5bae6eec9d3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513739,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dde0d5190c844bba89c2e268d07dc5f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332170,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c1076e8b55a4912b6722a29cdf86aec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394348,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e2f7c4cd74af479082667bc31da03a4c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423179,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/228f85c73b044b17907b504d0300e095.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332921,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ddc3e605c69c4621b7ea3036805e4302.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375945,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62750839133c4f76a50a8fcd187939d5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398905,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/40eb172218914ddb8fd100f677a6d760.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298922,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/99699dc602ab44c99c10ec726b0c7aab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c968a216-5605-54ef-a4a3-d682ec91f038/c968a216-5605-54ef-a4a3-d682ec91f038_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313703,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/571db78fb4bb4d6d9ce4d7919459432a.jpg',
'Width': 2048}],
'price': 3495,
'price_includes_vat': True,
'registration_date': '2013-09-04',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost Zetec Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2013}
2026-03-30 15:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509216511059%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509216511059: {'created_time': 1774883707.004497, 'last_price_update_time': 1774883707.004509}
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509216511059') HTTP/1.1" 204 0
2026-03-30 15:15:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f9243db-85f5-5a6e-9e4f-9dd86700d210 with identifier: 202508295874056
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f9243db-85f5-5a6e-9e4f-9dd86700d210
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3b4eef28565408d8048f3ad34d01804.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3b4eef28565408d8048f3ad34d01804.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1f43b0842b7f4ba2b3c5049087a5ec67.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1f43b0842b7f4ba2b3c5049087a5ec67.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e31fb5a508e414e829702493d49edaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e31fb5a508e414e829702493d49edaa.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3d6769ac8858468db4e0dce4d9b52d9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3d6769ac8858468db4e0dce4d9b52d9d.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb60d997436ad4f629601b80edbdfd270.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b60d997436ad4f629601b80edbdfd270.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F61d7ba0760b1416ab85f0838f936a494.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/61d7ba0760b1416ab85f0838f936a494.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb16b39cbb0a446b599b713a89035c76d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b16b39cbb0a446b599b713a89035c76d.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe59cf6c54ffc427c80f933c35785ed32.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e59cf6c54ffc427c80f933c35785ed32.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e3554b167994a7b9c30a0af5c85ba4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e3554b167994a7b9c30a0af5c85ba4f.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b778016ea6141c79a5fa1d228c32b85.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b778016ea6141c79a5fa1d228c32b85.jpg already downloaded
2026-03-30 15:15:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4f9243db-85f5-5a6e-9e4f-9dd86700d210 with identifier 202508295874056
2026-03-30 15:15:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4f9243db-85f5-5a6e-9e4f-9dd86700d210
2026-03-30 15:15:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2015 Nissan Qashqai DIG-T n-tec+ is a truly exceptional '
'find, boasting remarkably low mileage for its age at just '
'46,800 miles. This popular family SUV is powered by an '
'efficient 1.2L petrol engine and meets the Euro 6 emission '
'standards. The n-tec+ trim level offers a host of desirable '
'features, including Bluetooth integration for seamless phone '
'connectivity, a fixed panoramic glass roof that floods the '
'cabin with natural light, and automatic headlights for '
"enhanced visibility. You'll also appreciate the convenience "
'of intelligent keyless entry and front parking sensors to aid '
'manoeuvring.\n'
'\n'
'This Qashqai stands out with its impressive fuel economy, '
'achieving an excellent 49 miles per gallon, which is a '
'significant advantage for everyday driving costs. '
'Furthermore, its low CO2 emissions contribute to a more '
'environmentally friendly driving experience. The vehicle also '
'benefits from a low insurance group, making it an affordable '
'choice for many drivers. These highlights demonstrate how '
'this Nissan Qashqai offers a compelling combination of '
'efficiency, practicality, and cost effectiveness compared to '
'other vehicles in its class.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 113,
'fuel_type': 'Petrol',
'id': '4f9243db-85f5-5a6e-9e4f-9dd86700d210',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508295874056',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 46800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f3b4eef28565408d8048f3ad34d01804.jpg',
'https://m.atcdn.co.uk/a/media/1f43b0842b7f4ba2b3c5049087a5ec67.jpg',
'https://m.atcdn.co.uk/a/media/0e31fb5a508e414e829702493d49edaa.jpg',
'https://m.atcdn.co.uk/a/media/3d6769ac8858468db4e0dce4d9b52d9d.jpg',
'https://m.atcdn.co.uk/a/media/b60d997436ad4f629601b80edbdfd270.jpg',
'https://m.atcdn.co.uk/a/media/61d7ba0760b1416ab85f0838f936a494.jpg',
'https://m.atcdn.co.uk/a/media/b16b39cbb0a446b599b713a89035c76d.jpg',
'https://m.atcdn.co.uk/a/media/e59cf6c54ffc427c80f933c35785ed32.jpg',
'https://m.atcdn.co.uk/a/media/4e3554b167994a7b9c30a0af5c85ba4f.jpg',
'https://m.atcdn.co.uk/a/media/3b778016ea6141c79a5fa1d228c32b85.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448071,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3b4eef28565408d8048f3ad34d01804.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460388,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1f43b0842b7f4ba2b3c5049087a5ec67.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394301,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0e31fb5a508e414e829702493d49edaa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336546,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3d6769ac8858468db4e0dce4d9b52d9d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364843,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b60d997436ad4f629601b80edbdfd270.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299237,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/61d7ba0760b1416ab85f0838f936a494.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348889,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b16b39cbb0a446b599b713a89035c76d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290957,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e59cf6c54ffc427c80f933c35785ed32.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374846,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e3554b167994a7b9c30a0af5c85ba4f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d293130-3b89-5149-8a5c-79c9cf617c11/1d293130-3b89-5149-8a5c-79c9cf617c11_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343678,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b778016ea6141c79a5fa1d228c32b85.jpg',
'Width': 2048}],
'price': 8695,
'price_includes_vat': True,
'registration_date': '2015-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.2 DIG-T n-tec+ XTRON 2WD Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'n-tec+',
'year': 2015}
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508295874056%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508295874056: {'created_time': 1774883707.383834, 'last_price_update_time': 1774883707.383845}
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508295874056') HTTP/1.1" 204 0
2026-03-30 15:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:15:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 362afeab-8d2c-55ad-beb5-cc2701bd3af9 with identifier: 202507144467527
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 362afeab-8d2c-55ad-beb5-cc2701bd3af9
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3a5ae2c913f477dab0f88ddaeb9f634.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3a5ae2c913f477dab0f88ddaeb9f634.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa020843ef2c84f0f8b697a73a0425430.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a020843ef2c84f0f8b697a73a0425430.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc95de0a14b6f4c5eb73eaefe59336830.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c95de0a14b6f4c5eb73eaefe59336830.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5497356f1f524af880722b9ace0970a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5497356f1f524af880722b9ace0970a4.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe7cbdd672c954d55b46a2d44b87867a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e7cbdd672c954d55b46a2d44b87867a9.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7050d1563124037a807f30b0612a29d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7050d1563124037a807f30b0612a29d.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1c10e2309cd54967a4201c946a79f764.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1c10e2309cd54967a4201c946a79f764.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55000b96ffb947e0af976d625e9399de.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55000b96ffb947e0af976d625e9399de.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa07b28c44b9f4bd0b68c5620a3c14e77.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a07b28c44b9f4bd0b68c5620a3c14e77.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2812ce713c6c49c2b45bcec44e2e357b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2812ce713c6c49c2b45bcec44e2e357b.jpg already downloaded
2026-03-30 15:15:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 362afeab-8d2c-55ad-beb5-cc2701bd3af9 with identifier 202507144467527
2026-03-30 15:15:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 362afeab-8d2c-55ad-beb5-cc2701bd3af9
2026-03-30 15:15:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'Silver',
'currency': 'GBP',
'description': 'Experience the road in this 2019 Ford Focus ST-Line, a '
'stylish hatchback that combines practicality with modern '
"technology. The ST-Line trim enhances the Focus's sporty "
'appeal, making it a pleasure to drive. Equipped with a '
'responsive 1.0L petrol engine and compliant with Euro 6 '
'emission standards, this Focus delivers a balance of '
'performance and efficiency.\n'
'\n'
"Inside, you'll find the Ford SYNC3 DAB Radio system, complete "
'with a floating 6.5-inch touchscreen that includes Android '
'Auto and Apple CarPlay, ensuring you stay connected on the '
'go. The automatic headlights add convenience, turning on '
'automatically when needed. The Focus also boasts a large boot '
'space, making it ideal for everything from weekly shopping '
'trips to family holidays. With low CO2 emissions, this car is '
'kinder to the environment than similar vehicles. It also '
'accelerates from 0-62mph in just 10.0 seconds, demonstrating '
'its responsive performance.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '362afeab-8d2c-55ad-beb5-cc2701bd3af9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202507144467527',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Ford',
'model': 'Focus',
'odometer': 79600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f3a5ae2c913f477dab0f88ddaeb9f634.jpg',
'https://m.atcdn.co.uk/a/media/a020843ef2c84f0f8b697a73a0425430.jpg',
'https://m.atcdn.co.uk/a/media/c95de0a14b6f4c5eb73eaefe59336830.jpg',
'https://m.atcdn.co.uk/a/media/5497356f1f524af880722b9ace0970a4.jpg',
'https://m.atcdn.co.uk/a/media/e7cbdd672c954d55b46a2d44b87867a9.jpg',
'https://m.atcdn.co.uk/a/media/b7050d1563124037a807f30b0612a29d.jpg',
'https://m.atcdn.co.uk/a/media/1c10e2309cd54967a4201c946a79f764.jpg',
'https://m.atcdn.co.uk/a/media/55000b96ffb947e0af976d625e9399de.jpg',
'https://m.atcdn.co.uk/a/media/a07b28c44b9f4bd0b68c5620a3c14e77.jpg',
'https://m.atcdn.co.uk/a/media/2812ce713c6c49c2b45bcec44e2e357b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 517808,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3a5ae2c913f477dab0f88ddaeb9f634.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516191,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a020843ef2c84f0f8b697a73a0425430.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465585,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c95de0a14b6f4c5eb73eaefe59336830.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 472900,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5497356f1f524af880722b9ace0970a4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571010,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e7cbdd672c954d55b46a2d44b87867a9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509732,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7050d1563124037a807f30b0612a29d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 497523,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1c10e2309cd54967a4201c946a79f764.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509107,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55000b96ffb947e0af976d625e9399de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359413,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a07b28c44b9f4bd0b68c5620a3c14e77.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f95dd43-8db9-5601-a94d-39f8367794c7/3f95dd43-8db9-5601-a94d-39f8367794c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381651,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2812ce713c6c49c2b45bcec44e2e357b.jpg',
'Width': 2048}],
'price': 7495,
'price_includes_vat': True,
'registration_date': '2019-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost ST-Line Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2019}
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507144467527%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202507144467527: {'created_time': 1774883707.633567, 'last_price_update_time': 1774883707.633577}
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202507144467527') HTTP/1.1" 204 0
2026-03-30 15:15:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412 with identifier: 202602280298361
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe40236bffe1c46789ab7b8042646f796.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e40236bffe1c46789ab7b8042646f796.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85f162a3068142b1b049af5bbf3718e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85f162a3068142b1b049af5bbf3718e5.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c5e328f78894060ba503143c76128a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c5e328f78894060ba503143c76128a6.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa99c6ef4f5e14fea97f8a2415ad3a370.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a99c6ef4f5e14fea97f8a2415ad3a370.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20c619a02a6146aab6a63337b2cc1f74.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20c619a02a6146aab6a63337b2cc1f74.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4cfabd0176d4719a6866b7bc1190136.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4cfabd0176d4719a6866b7bc1190136.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3dedc46edad43078ec873bd5b22b012.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3dedc46edad43078ec873bd5b22b012.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e03cdafbaa74ad6b0f39b8240c58643.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e03cdafbaa74ad6b0f39b8240c58643.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff890935ac9ea4da3beb2712c42e7c268.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f890935ac9ea4da3beb2712c42e7c268.jpg already downloaded
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F802e3b1ca47c4a6d882e8b755887d2f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/802e3b1ca47c4a6d882e8b755887d2f0.jpg already downloaded
2026-03-30 15:15:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412 with identifier 202602280298361
2026-03-30 15:15:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412
2026-03-30 15:15:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2015 Nissan Qashqai DIG-T n-tec presents a remarkable '
'opportunity with its exceptionally low mileage of just 69,100 '
'miles for its age. This well appointed n-tec trim features a '
'responsive 1.2 litre petrol engine and comes equipped with a '
"suite of advanced parking assistance technologies. You'll "
'benefit from the Around View Monitor, offering a 360 degree '
"bird's eye view of your surroundings, complemented by front "
'and rear parking sensors and a rear parking camera. '
'Convenience is further enhanced with Intelligent Key for '
'keyless entry and Bluetooth integration for seamless '
'telephone connectivity.\n'
'\n'
'This Nissan Qashqai stands out with its impressive fuel '
'economy, achieving up to 50 miles per gallon, which indicates '
'it is more economical than many similar vehicles. '
'Furthermore, its low insurance group rating suggests that '
'running costs will be more affordable. The vehicle also '
'boasts low CO2 emissions, highlighting its efficiency and '
'environmental consideration compared to other cars in its '
'class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.2L',
'engine_horse_power': 113,
'fuel_type': 'Petrol',
'id': 'a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602280298361',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 69100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/e40236bffe1c46789ab7b8042646f796.jpg',
'https://m.atcdn.co.uk/a/media/85f162a3068142b1b049af5bbf3718e5.jpg',
'https://m.atcdn.co.uk/a/media/8c5e328f78894060ba503143c76128a6.jpg',
'https://m.atcdn.co.uk/a/media/a99c6ef4f5e14fea97f8a2415ad3a370.jpg',
'https://m.atcdn.co.uk/a/media/20c619a02a6146aab6a63337b2cc1f74.jpg',
'https://m.atcdn.co.uk/a/media/c4cfabd0176d4719a6866b7bc1190136.jpg',
'https://m.atcdn.co.uk/a/media/f3dedc46edad43078ec873bd5b22b012.jpg',
'https://m.atcdn.co.uk/a/media/4e03cdafbaa74ad6b0f39b8240c58643.jpg',
'https://m.atcdn.co.uk/a/media/f890935ac9ea4da3beb2712c42e7c268.jpg',
'https://m.atcdn.co.uk/a/media/802e3b1ca47c4a6d882e8b755887d2f0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418264,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e40236bffe1c46789ab7b8042646f796.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379295,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85f162a3068142b1b049af5bbf3718e5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350873,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c5e328f78894060ba503143c76128a6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320001,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a99c6ef4f5e14fea97f8a2415ad3a370.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440252,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/20c619a02a6146aab6a63337b2cc1f74.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384238,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c4cfabd0176d4719a6866b7bc1190136.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401910,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3dedc46edad43078ec873bd5b22b012.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361680,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e03cdafbaa74ad6b0f39b8240c58643.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292213,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f890935ac9ea4da3beb2712c42e7c268.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412/a784bd6c-65a2-54d2-bdc4-e1cf3cbbd412_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374640,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/802e3b1ca47c4a6d882e8b755887d2f0.jpg',
'Width': 2048}],
'price': 6995,
'price_includes_vat': True,
'registration_date': '2015-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.2 DIG-T n-tec XTRON 2WD Euro 5 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'n-tec',
'year': 2015}
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602280298361%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602280298361: {'created_time': 1774883707.934821, 'last_price_update_time': 1774883707.934835}
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602280298361') HTTP/1.1" 204 0
2026-03-30 15:15:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7 with identifier: 202602240184132
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36e7c8b386a8472baa386f7daa2fc23a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36e7c8b386a8472baa386f7daa2fc23a.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1ad995a9724743748a13dfe5d77f991a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1ad995a9724743748a13dfe5d77f991a.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7cd7f5f4fd13463d9df7fc152c767108.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7cd7f5f4fd13463d9df7fc152c767108.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24d320d22a384ad388405b572ba3ac4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24d320d22a384ad388405b572ba3ac4d.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F842cd2826e6e4bb1b4bf9833cdcceafd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/842cd2826e6e4bb1b4bf9833cdcceafd.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f28fb6ee8e14ca9a121011f0a8a141b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f28fb6ee8e14ca9a121011f0a8a141b.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe7fa168159f1468d9854d639f64a67c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e7fa168159f1468d9854d639f64a67c7.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3fe1f1222af14f139a40409e0e127f8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3fe1f1222af14f139a40409e0e127f8b.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5aa2ae13faca4cd2a30631f40ba96360.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5aa2ae13faca4cd2a30631f40ba96360.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F434bb3171ae44de8b8be775561c46028.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/434bb3171ae44de8b8be775561c46028.jpg already downloaded
2026-03-30 15:15:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7 with identifier 202602240184132
2026-03-30 15:15:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7
2026-03-30 15:15:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2016 Ford Focus Zetec presents an exceptional '
'opportunity with its remarkably low mileage of just 34,800 '
'miles. This popular hatchback is equipped with a 1.6 litre '
'petrol engine and meets Euro 6 emissions standards. Inside, '
"you'll find the convenience of manual air conditioning and a "
'Bluetooth handsfree phone system, allowing you to stay '
'connected and comfortable on every journey.\n'
'\n'
'The Zetec trim level of this Focus offers practical '
'advantages that set it apart. Its low insurance group rating '
'means more affordable motoring, while the generous boot space '
'provides ample room for shopping, luggage, or sports '
'equipment. These features combined indicate that this Ford '
'Focus is a sensible and well equipped choice for everyday '
'driving.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240184132',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Ford',
'model': 'Focus',
'odometer': 34250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 38,
'photo_urls': ['https://m.atcdn.co.uk/a/media/36e7c8b386a8472baa386f7daa2fc23a.jpg',
'https://m.atcdn.co.uk/a/media/1ad995a9724743748a13dfe5d77f991a.jpg',
'https://m.atcdn.co.uk/a/media/7cd7f5f4fd13463d9df7fc152c767108.jpg',
'https://m.atcdn.co.uk/a/media/24d320d22a384ad388405b572ba3ac4d.jpg',
'https://m.atcdn.co.uk/a/media/842cd2826e6e4bb1b4bf9833cdcceafd.jpg',
'https://m.atcdn.co.uk/a/media/0f28fb6ee8e14ca9a121011f0a8a141b.jpg',
'https://m.atcdn.co.uk/a/media/e7fa168159f1468d9854d639f64a67c7.jpg',
'https://m.atcdn.co.uk/a/media/3fe1f1222af14f139a40409e0e127f8b.jpg',
'https://m.atcdn.co.uk/a/media/5aa2ae13faca4cd2a30631f40ba96360.jpg',
'https://m.atcdn.co.uk/a/media/434bb3171ae44de8b8be775561c46028.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444932,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/36e7c8b386a8472baa386f7daa2fc23a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422039,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1ad995a9724743748a13dfe5d77f991a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403708,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7cd7f5f4fd13463d9df7fc152c767108.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392899,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/24d320d22a384ad388405b572ba3ac4d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465999,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/842cd2826e6e4bb1b4bf9833cdcceafd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443837,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f28fb6ee8e14ca9a121011f0a8a141b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459626,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e7fa168159f1468d9854d639f64a67c7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412515,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3fe1f1222af14f139a40409e0e127f8b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357552,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5aa2ae13faca4cd2a30631f40ba96360.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7/1d01efa2-ac0c-5ec0-8a9d-5938ebb8b1f7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347262,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/434bb3171ae44de8b8be775561c46028.jpg',
'Width': 2048}],
'price': 8395,
'price_includes_vat': True,
'registration_date': '2016-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 Zetec Powershift Euro 6 5dr',
'transmission': 'automatic',
'trim': 'Zetec',
'year': 2016}
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240184132%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240184132: {'created_time': 1774883708.241465, 'last_price_update_time': 1774883708.241474}
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240184132') HTTP/1.1" 204 0
2026-03-30 15:15:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb with identifier: 202601299506942
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32017ba10b2949dda53e655a2616d888.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32017ba10b2949dda53e655a2616d888.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F984337e4a0bc4a78b722cdbb60ba1d9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/984337e4a0bc4a78b722cdbb60ba1d9e.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F545f2f41d1b94f5f885855164ad00ce3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/545f2f41d1b94f5f885855164ad00ce3.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4d69c3442fef4d0da30094871420bf30.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4d69c3442fef4d0da30094871420bf30.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb09200f4885045bfae719dfbe799427a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b09200f4885045bfae719dfbe799427a.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc88dca1671d54cc1a35489bb42582d1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c88dca1671d54cc1a35489bb42582d1a.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F05ddfbf9acb6475b90f6560806847417.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/05ddfbf9acb6475b90f6560806847417.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f0a1a1f0b3d408c86a526a1085040de.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f0a1a1f0b3d408c86a526a1085040de.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30948acf048d499d8f21e65c1e6b90d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30948acf048d499d8f21e65c1e6b90d2.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2f30f9215f2b49b99fb78c625a91a512.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2f30f9215f2b49b99fb78c625a91a512.jpg already downloaded
2026-03-30 15:15:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb with identifier 202601299506942
2026-03-30 15:15:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb
2026-03-30 15:15:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 104,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2018 Citroen C4 Cactus Flair presents a compelling blend '
'of style and practicality, featuring a distinctive Chrome '
'Foglight Surround and Airbump Highlight that sets it apart. '
'Powered by an efficient 1.2 litre Euro 6 petrol engine, this '
"model offers a smooth driving experience. Inside, you'll find "
'the Auto Pack, which includes automatic climate control and '
'headlights, ensuring comfort and convenience. Stay connected '
'and entertained with Bluetooth handsfree and media streaming, '
'further enhanced by the Citroen Connect Nav system, '
'compatible with both Android Auto and Apple CarPlay. Enjoy an '
'open and airy cabin thanks to the thermally insulated '
'panoramic sunroof, and appreciate the generous boot space for '
'all your needs.\n'
'\n'
'The Citroen C4 Cactus Flair excels with several key '
'highlights that demonstrate its superiority. Its impressive '
'fuel economy of 63 miles per gallon means fewer stops at the '
'petrol station, making it an economical choice. The low CO2 '
'emissions are also a significant advantage, contributing to a '
'lower environmental impact. For those who value performance, '
'the 0 to 62 miles per hour acceleration in just 9.4 seconds '
'offers responsive driving. These features combined with its '
'unique design and practical interior make this C4 Cactus a '
'standout option.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 108,
'fuel_type': 'Petrol',
'id': '6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299506942',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Citroen',
'model': 'C4 Cactus',
'odometer': 63600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photo_urls': ['https://m.atcdn.co.uk/a/media/32017ba10b2949dda53e655a2616d888.jpg',
'https://m.atcdn.co.uk/a/media/984337e4a0bc4a78b722cdbb60ba1d9e.jpg',
'https://m.atcdn.co.uk/a/media/545f2f41d1b94f5f885855164ad00ce3.jpg',
'https://m.atcdn.co.uk/a/media/4d69c3442fef4d0da30094871420bf30.jpg',
'https://m.atcdn.co.uk/a/media/b09200f4885045bfae719dfbe799427a.jpg',
'https://m.atcdn.co.uk/a/media/c88dca1671d54cc1a35489bb42582d1a.jpg',
'https://m.atcdn.co.uk/a/media/05ddfbf9acb6475b90f6560806847417.jpg',
'https://m.atcdn.co.uk/a/media/8f0a1a1f0b3d408c86a526a1085040de.jpg',
'https://m.atcdn.co.uk/a/media/30948acf048d499d8f21e65c1e6b90d2.jpg',
'https://m.atcdn.co.uk/a/media/2f30f9215f2b49b99fb78c625a91a512.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573476,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/32017ba10b2949dda53e655a2616d888.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605918,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/984337e4a0bc4a78b722cdbb60ba1d9e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634995,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/545f2f41d1b94f5f885855164ad00ce3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505944,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4d69c3442fef4d0da30094871420bf30.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 592367,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b09200f4885045bfae719dfbe799427a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654425,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c88dca1671d54cc1a35489bb42582d1a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641334,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/05ddfbf9acb6475b90f6560806847417.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 526622,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f0a1a1f0b3d408c86a526a1085040de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573981,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/30948acf048d499d8f21e65c1e6b90d2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb/6fcde29d-c0fa-5ec5-ab3d-51f8f2c00ebb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671312,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2f30f9215f2b49b99fb78c625a91a512.jpg',
'Width': 2048}],
'price': 5995,
'price_includes_vat': True,
'registration_date': '2018-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Cactus 1.2 PureTech Flair Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Flair',
'year': 2018}
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299506942%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299506942: {'created_time': 1774883708.55424, 'last_price_update_time': 1774883708.554251}
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299506942') HTTP/1.1" 204 0
2026-03-30 15:15:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d111034-892c-57f4-b972-04208fd26aad with identifier: 202601299505810
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d111034-892c-57f4-b972-04208fd26aad
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e5f22143de8484791ecbe1d399aba1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e5f22143de8484791ecbe1d399aba1e.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01467c7f798b4b048aade589c740d7b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01467c7f798b4b048aade589c740d7b7.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f5c96762e88411ba2121352cadb0cb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f5c96762e88411ba2121352cadb0cb2.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa6b6bc13e4cd4d07a1683fd4232f1566.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a6b6bc13e4cd4d07a1683fd4232f1566.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff019efbf1a9b4cc6bb352215ebfa2e90.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f019efbf1a9b4cc6bb352215ebfa2e90.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7280ddf4efc441cba422da552d0bf1a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7280ddf4efc441cba422da552d0bf1a4.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4cacf8c1b6274faa85b07ca233356b5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4cacf8c1b6274faa85b07ca233356b5c.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4230bb9222194d7cbfd9175f0ba5a0dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4230bb9222194d7cbfd9175f0ba5a0dc.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b841376e31b4d079cc6edeb9e38c652.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b841376e31b4d079cc6edeb9e38c652.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2bbc03f78c38448c95f29f131c2e68f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2bbc03f78c38448c95f29f131c2e68f4.jpg already downloaded
2026-03-30 15:15:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1d111034-892c-57f4-b972-04208fd26aad with identifier 202601299505810
2026-03-30 15:15:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1d111034-892c-57f4-b972-04208fd26aad
2026-03-30 15:15:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'Grey',
'currency': 'GBP',
'description': 'Discover this 2015 Vauxhall Astra i Limited Edition, boasting '
'exceptionally low mileage for its age at just 52,000 miles. '
'This well maintained example has had only two owners and '
'features a responsive 1.6L petrol engine, meeting Euro 6 '
"emission standards. Inside, you'll appreciate the comfort of "
'heated front seats, the convenience of mobile phone system '
'with Bluetooth connectivity, and the ease of air '
'conditioning, ensuring a pleasant journey in any weather.\n'
'\n'
'This Vauxhall Astra stands out with its low insurance group, '
'making it an economical choice for many drivers. Furthermore, '
'its generous boot space offers practicality for shopping '
'trips or luggage. These aspects, combined with its careful '
'ownership and low mileage, indicate that this Astra is in '
'excellent condition and offers superior value compared to '
'other vehicles of its kind on the market.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 113,
'fuel_type': 'Petrol',
'id': '1d111034-892c-57f4-b972-04208fd26aad',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299505810',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Vauxhall',
'model': 'Astra',
'odometer': 52000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0e5f22143de8484791ecbe1d399aba1e.jpg',
'https://m.atcdn.co.uk/a/media/01467c7f798b4b048aade589c740d7b7.jpg',
'https://m.atcdn.co.uk/a/media/3f5c96762e88411ba2121352cadb0cb2.jpg',
'https://m.atcdn.co.uk/a/media/a6b6bc13e4cd4d07a1683fd4232f1566.jpg',
'https://m.atcdn.co.uk/a/media/f019efbf1a9b4cc6bb352215ebfa2e90.jpg',
'https://m.atcdn.co.uk/a/media/7280ddf4efc441cba422da552d0bf1a4.jpg',
'https://m.atcdn.co.uk/a/media/4cacf8c1b6274faa85b07ca233356b5c.jpg',
'https://m.atcdn.co.uk/a/media/4230bb9222194d7cbfd9175f0ba5a0dc.jpg',
'https://m.atcdn.co.uk/a/media/1b841376e31b4d079cc6edeb9e38c652.jpg',
'https://m.atcdn.co.uk/a/media/2bbc03f78c38448c95f29f131c2e68f4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364158,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0e5f22143de8484791ecbe1d399aba1e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380104,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/01467c7f798b4b048aade589c740d7b7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306445,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f5c96762e88411ba2121352cadb0cb2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312557,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a6b6bc13e4cd4d07a1683fd4232f1566.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383732,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f019efbf1a9b4cc6bb352215ebfa2e90.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420392,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7280ddf4efc441cba422da552d0bf1a4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330748,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4cacf8c1b6274faa85b07ca233356b5c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335353,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4230bb9222194d7cbfd9175f0ba5a0dc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319415,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b841376e31b4d079cc6edeb9e38c652.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d111034-892c-57f4-b972-04208fd26aad/1d111034-892c-57f4-b972-04208fd26aad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331641,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2bbc03f78c38448c95f29f131c2e68f4.jpg',
'Width': 2048}],
'price': 4995,
'price_includes_vat': True,
'registration_date': '2015-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Astra 1.6i Limited Edition Euro 6 5dr',
'transmission': 'manual',
'trim': 'Limited Edition',
'year': 2015}
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299505810%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299505810: {'created_time': 1774883708.779948, 'last_price_update_time': 1774883708.77996}
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299505810') HTTP/1.1" 204 0
2026-03-30 15:15:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 781e7016-9c27-5c07-8de2-e27308be102e with identifier: 202601299505787
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 781e7016-9c27-5c07-8de2-e27308be102e
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9f0a434ac0646df8f48b4ff4c69a096.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9f0a434ac0646df8f48b4ff4c69a096.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc53b6662ba394ec79ba8b1f07c7da375.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c53b6662ba394ec79ba8b1f07c7da375.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f6df11757a44cc29524b15914b674fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f6df11757a44cc29524b15914b674fe.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1d825c8a90e47dea141072cc6a4d966.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1d825c8a90e47dea141072cc6a4d966.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcfe14c792dd64bd8a1bbeacd227417b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cfe14c792dd64bd8a1bbeacd227417b5.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F664410ca22b1416c8b983c38f8278504.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/664410ca22b1416c8b983c38f8278504.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7887035f3291482085cf8631872bfaf1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7887035f3291482085cf8631872bfaf1.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4988d447bd442668708f6cb1130a650.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4988d447bd442668708f6cb1130a650.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F648a97e2eedf467da6f6b387aa0e9eea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/648a97e2eedf467da6f6b387aa0e9eea.jpg already downloaded
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07e5e61c2105467dbb6a135879388b5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07e5e61c2105467dbb6a135879388b5a.jpg already downloaded
2026-03-30 15:15:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 781e7016-9c27-5c07-8de2-e27308be102e with identifier 202601299505787
2026-03-30 15:15:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 781e7016-9c27-5c07-8de2-e27308be102e
2026-03-30 15:15:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'Black',
'currency': 'GBP',
'description': 'The Peugeot 2008 Allure is a 2018 model that boasts a 1.2L '
'Petrol Engine, meeting the stringent Euro 6 emission '
'standards. This trim level is equipped with a range of '
'desirable features, including a 7in Multifunction Colour '
'Touchscreen with Steering Wheel Mounted Controls, which '
'allows seamless integration with Apple CarPlay. The vehicle '
'also comes with a Visibility Pack, which includes automatic '
'headlights that switch on when needed, and a Rear Parking Aid '
'with a rear sensor to make parking a breeze. Additionally, '
'the Allure trim features Automatic Dual Zone Air Conditioning '
'with Climate Control, ensuring a comfortable ride for all '
'occupants. Bluetooth connectivity is also standard, allowing '
'for effortless hands-free calls and music streaming.\n'
'\n'
'The Peugeot 2008 Allure is an attractive option for those '
'seeking a fuel-efficient vehicle. With a fuel economy of up '
'to 58 mpg, this model is designed to keep running costs low. '
'Furthermore, its low insurance group rating makes it an '
'affordable choice for drivers. The 2008 Allure also boasts '
'low CO2 emissions, making it a more environmentally friendly '
'option. These impressive credentials make the Peugeot 2008 '
'Allure a compelling choice for those seeking a reliable and '
'cost-effective vehicle.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 81,
'fuel_type': 'Petrol',
'id': '781e7016-9c27-5c07-8de2-e27308be102e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299505787',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Peugeot',
'model': '2008',
'odometer': 56300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 49,
'photo_urls': ['https://m.atcdn.co.uk/a/media/e9f0a434ac0646df8f48b4ff4c69a096.jpg',
'https://m.atcdn.co.uk/a/media/c53b6662ba394ec79ba8b1f07c7da375.jpg',
'https://m.atcdn.co.uk/a/media/3f6df11757a44cc29524b15914b674fe.jpg',
'https://m.atcdn.co.uk/a/media/d1d825c8a90e47dea141072cc6a4d966.jpg',
'https://m.atcdn.co.uk/a/media/cfe14c792dd64bd8a1bbeacd227417b5.jpg',
'https://m.atcdn.co.uk/a/media/664410ca22b1416c8b983c38f8278504.jpg',
'https://m.atcdn.co.uk/a/media/7887035f3291482085cf8631872bfaf1.jpg',
'https://m.atcdn.co.uk/a/media/f4988d447bd442668708f6cb1130a650.jpg',
'https://m.atcdn.co.uk/a/media/648a97e2eedf467da6f6b387aa0e9eea.jpg',
'https://m.atcdn.co.uk/a/media/07e5e61c2105467dbb6a135879388b5a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390075,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9f0a434ac0646df8f48b4ff4c69a096.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368226,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c53b6662ba394ec79ba8b1f07c7da375.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 457635,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f6df11757a44cc29524b15914b674fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 465487,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1d825c8a90e47dea141072cc6a4d966.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473322,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cfe14c792dd64bd8a1bbeacd227417b5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541083,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/664410ca22b1416c8b983c38f8278504.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535862,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7887035f3291482085cf8631872bfaf1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534452,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4988d447bd442668708f6cb1130a650.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 469813,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/648a97e2eedf467da6f6b387aa0e9eea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_781e7016-9c27-5c07-8de2-e27308be102e/781e7016-9c27-5c07-8de2-e27308be102e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529231,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/07e5e61c2105467dbb6a135879388b5a.jpg',
'Width': 2048}],
'price': 5995,
'price_includes_vat': True,
'registration_date': '2018-05-01',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Allure Euro 6 5dr',
'transmission': 'manual',
'trim': 'Allure',
'year': 2018}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299505787%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299505787: {'created_time': 1774883709.025987, 'last_price_update_time': 1774883709.026}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299505787') HTTP/1.1" 204 0
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ac33581c-2ac7-583e-94f0-e48cfbc36f97 with identifier: 202601169212373
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac33581c-2ac7-583e-94f0-e48cfbc36f97
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5442eb3487d94f5ea5d666d6ef346735.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5442eb3487d94f5ea5d666d6ef346735.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8fee76b89cd14fc3a46ded6a65d49259.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8fee76b89cd14fc3a46ded6a65d49259.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7567b0f52f8c4edfb1499c984a0c065a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7567b0f52f8c4edfb1499c984a0c065a.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F804ef6eddd66472cac824dbb54548e80.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/804ef6eddd66472cac824dbb54548e80.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb69408300d4d4e7badafe88ea972c7c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b69408300d4d4e7badafe88ea972c7c8.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F372f2ec3474744d182cdee0fb07ca945.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/372f2ec3474744d182cdee0fb07ca945.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa47bef2c636a45afbb381869da99e6f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a47bef2c636a45afbb381869da99e6f5.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ee3152ef9da4396be7e33f8772e716f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ee3152ef9da4396be7e33f8772e716f.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1509a6e1e67449fc94b4610a4aa638d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1509a6e1e67449fc94b4610a4aa638d4.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F503cc1c3d90549f784e1599638437483.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/503cc1c3d90549f784e1599638437483.jpg already downloaded
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ac33581c-2ac7-583e-94f0-e48cfbc36f97 with identifier 202601169212373
2026-03-30 15:15:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ac33581c-2ac7-583e-94f0-e48cfbc36f97
2026-03-30 15:15:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2016 Land Rover Range Rover Evoque TD4 SE Tech boasts a '
'clear vehicle history, offering peace of mind for its next '
'owner. This stylish four wheel drive model is equipped with a '
'2.0L diesel engine, meeting Euro 6 emissions standards. '
"Inside, you'll find comfortable heated front seats and the "
'convenience of Bluetooth phone connectivity. For enhanced '
'visibility and safety, it features Xenon headlamps with LED '
'signature and automatic headlights. Parking is made easier '
'with rear parking aid, and the generous boot space ensures '
'practicality for all your needs.\n'
'\n'
'Experience impressive efficiency with this Evoque, achieving '
'a remarkable 55 miles per gallon, which is better than many '
'similar vehicles. Its low CO2 emissions also contribute to '
'its appeal. This model accelerates from 0 to 60 miles per '
'hour in just 8.5 seconds, demonstrating a strong performance '
'that sets it apart.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 178,
'fuel_type': 'Diesel',
'id': 'ac33581c-2ac7-583e-94f0-e48cfbc36f97',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601169212373',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Land Rover',
'model': 'Range Rover Evoque',
'odometer': 76000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/5442eb3487d94f5ea5d666d6ef346735.jpg',
'https://m.atcdn.co.uk/a/media/8fee76b89cd14fc3a46ded6a65d49259.jpg',
'https://m.atcdn.co.uk/a/media/7567b0f52f8c4edfb1499c984a0c065a.jpg',
'https://m.atcdn.co.uk/a/media/804ef6eddd66472cac824dbb54548e80.jpg',
'https://m.atcdn.co.uk/a/media/b69408300d4d4e7badafe88ea972c7c8.jpg',
'https://m.atcdn.co.uk/a/media/372f2ec3474744d182cdee0fb07ca945.jpg',
'https://m.atcdn.co.uk/a/media/a47bef2c636a45afbb381869da99e6f5.jpg',
'https://m.atcdn.co.uk/a/media/6ee3152ef9da4396be7e33f8772e716f.jpg',
'https://m.atcdn.co.uk/a/media/1509a6e1e67449fc94b4610a4aa638d4.jpg',
'https://m.atcdn.co.uk/a/media/503cc1c3d90549f784e1599638437483.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560990,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5442eb3487d94f5ea5d666d6ef346735.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584759,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8fee76b89cd14fc3a46ded6a65d49259.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567986,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7567b0f52f8c4edfb1499c984a0c065a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495283,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/804ef6eddd66472cac824dbb54548e80.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665268,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b69408300d4d4e7badafe88ea972c7c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687152,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/372f2ec3474744d182cdee0fb07ca945.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687770,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a47bef2c636a45afbb381869da99e6f5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672018,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ee3152ef9da4396be7e33f8772e716f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632376,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1509a6e1e67449fc94b4610a4aa638d4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac33581c-2ac7-583e-94f0-e48cfbc36f97/ac33581c-2ac7-583e-94f0-e48cfbc36f97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505437,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/503cc1c3d90549f784e1599638437483.jpg',
'Width': 2048}],
'price': 8995,
'price_includes_vat': True,
'registration_date': '2016-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque 2.0 TD4 SE Tech Auto 4WD Euro 6 (s/s) '
'5dr',
'transmission': 'automatic',
'trim': 'SE Tech',
'year': 2016}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601169212373%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601169212373: {'created_time': 1774883709.240197, 'last_price_update_time': 1774883709.240207}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601169212373') HTTP/1.1" 204 0
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d26ba874-ed1c-5cae-b466-8ac20ad64e9b with identifier: 202601149148866
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d26ba874-ed1c-5cae-b466-8ac20ad64e9b
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71bd89a6964d4ecabc87592f972754c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71bd89a6964d4ecabc87592f972754c9.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9368f33491bb4f1aaafdcab8e3408e82.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9368f33491bb4f1aaafdcab8e3408e82.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb992a496936c46679dc9c5cb0983cc69.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b992a496936c46679dc9c5cb0983cc69.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79adeee1a1f041928fce7db34b4c62da.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79adeee1a1f041928fce7db34b4c62da.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27aa210aab114998a8fcb1a5f100ea1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27aa210aab114998a8fcb1a5f100ea1c.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F21915d54302b494ab5f714b17c4b39db.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/21915d54302b494ab5f714b17c4b39db.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe442758b296249c2984362ef7ad58e99.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e442758b296249c2984362ef7ad58e99.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1387a330138488887621b7df627466a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1387a330138488887621b7df627466a.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faf95bfc643464e18afc7e5c09e6cf26e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/af95bfc643464e18afc7e5c09e6cf26e.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb922a3e5f7414a86b282ad1bf5d7f7c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b922a3e5f7414a86b282ad1bf5d7f7c8.jpg already downloaded
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d26ba874-ed1c-5cae-b466-8ac20ad64e9b with identifier 202601149148866
2026-03-30 15:15:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d26ba874-ed1c-5cae-b466-8ac20ad64e9b
2026-03-30 15:15:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2017 Ford Focus T Titanium is presented with a clear '
'vehicle history check, offering you peace of mind. This '
'popular hatchback is equipped with a 1.0 litre petrol engine '
"and meets Euro 6 emissions standards. Inside, you'll find "
'dual zone electronic automatic climate control for '
'personalised comfort, rear parking sensors to aid '
'manoeuvring, and a Bluetooth handsfree phone system for safe '
'connectivity on the go.\n'
'\n'
'With an impressive fuel economy of 60 miles per gallon, this '
'Focus is designed to be economical to run. Its low CO2 '
'emissions further contribute to its cost effectiveness and '
'environmental consideration. Furthermore, the generous boot '
'space ensures you have ample room for luggage or shopping, '
'making this Ford Focus a practical and efficient choice.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': 'd26ba874-ed1c-5cae-b466-8ac20ad64e9b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149148866',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Ford',
'model': 'Focus',
'odometer': 67600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/71bd89a6964d4ecabc87592f972754c9.jpg',
'https://m.atcdn.co.uk/a/media/9368f33491bb4f1aaafdcab8e3408e82.jpg',
'https://m.atcdn.co.uk/a/media/b992a496936c46679dc9c5cb0983cc69.jpg',
'https://m.atcdn.co.uk/a/media/79adeee1a1f041928fce7db34b4c62da.jpg',
'https://m.atcdn.co.uk/a/media/27aa210aab114998a8fcb1a5f100ea1c.jpg',
'https://m.atcdn.co.uk/a/media/21915d54302b494ab5f714b17c4b39db.jpg',
'https://m.atcdn.co.uk/a/media/e442758b296249c2984362ef7ad58e99.jpg',
'https://m.atcdn.co.uk/a/media/c1387a330138488887621b7df627466a.jpg',
'https://m.atcdn.co.uk/a/media/af95bfc643464e18afc7e5c09e6cf26e.jpg',
'https://m.atcdn.co.uk/a/media/b922a3e5f7414a86b282ad1bf5d7f7c8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639837,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/71bd89a6964d4ecabc87592f972754c9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635684,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9368f33491bb4f1aaafdcab8e3408e82.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605565,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b992a496936c46679dc9c5cb0983cc69.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625715,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79adeee1a1f041928fce7db34b4c62da.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657581,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/27aa210aab114998a8fcb1a5f100ea1c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692895,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/21915d54302b494ab5f714b17c4b39db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632666,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e442758b296249c2984362ef7ad58e99.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508584,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c1387a330138488887621b7df627466a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622317,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/af95bfc643464e18afc7e5c09e6cf26e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26ba874-ed1c-5cae-b466-8ac20ad64e9b/d26ba874-ed1c-5cae-b466-8ac20ad64e9b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687608,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b922a3e5f7414a86b282ad1bf5d7f7c8.jpg',
'Width': 2048}],
'price': 5495,
'price_includes_vat': True,
'registration_date': '2017-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost Titanium Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149148866%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149148866: {'created_time': 1774883709.475131, 'last_price_update_time': 1774883709.475142}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149148866') HTTP/1.1" 204 0
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e1fdaf53-58ee-5552-87e6-74eba1eda31e with identifier: 202601149148806
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1fdaf53-58ee-5552-87e6-74eba1eda31e
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd6aba34106f342c980596e15a32f3179.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d6aba34106f342c980596e15a32f3179.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91a2bc8ce1554aaa92c447c64eaeb5ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91a2bc8ce1554aaa92c447c64eaeb5ad.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8d46f05365b46c6bb16615c2c5e3de9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8d46f05365b46c6bb16615c2c5e3de9.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5397dd6db074d72aecadab5e6de29d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5397dd6db074d72aecadab5e6de29d8.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F399532d2564545949a38359d7eb50692.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/399532d2564545949a38359d7eb50692.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd7e856d85f44bf992012be420f2cb7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd7e856d85f44bf992012be420f2cb7f.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2879fa2fa27467dbd337f878e32a061.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2879fa2fa27467dbd337f878e32a061.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5bbf8eda924143b99a56d1ad998904e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5bbf8eda924143b99a56d1ad998904e1.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F31f4731e749945a09bd88540cddbdc87.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/31f4731e749945a09bd88540cddbdc87.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc58082aa6db4ac7951d30779f141b02.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc58082aa6db4ac7951d30779f141b02.jpg already downloaded
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e1fdaf53-58ee-5552-87e6-74eba1eda31e with identifier 202601149148806
2026-03-30 15:15:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e1fdaf53-58ee-5552-87e6-74eba1eda31e
2026-03-30 15:15:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2017 BMW 1 Series 118i Sport offers a compelling blend '
'of performance and practicality. Powered by a 1.5 litre '
'petrol engine, this Euro 6 compliant model delivers an '
'engaging driving experience with a swift 0-62mph acceleration '
"time of just 8.5 seconds. Inside, you'll find a comfortable "
'Sport trim interior, complete with automatic single zone air '
'conditioning for consistent cabin comfort. Connectivity is '
'also a strong point, featuring Bluetooth hands free with a '
'USB audio interface, and enhanced Bluetooth telephone '
'preparation with voice control, ensuring you can stay '
'connected safely on the go. The inclusion of a rain sensor '
'with automatic headlight activation adds further convenience, '
'automatically adjusting lighting conditions for you.\n'
'\n'
'Beyond its impressive features, this BMW 1 Series stands out '
'with its generous boot space, offering ample room for '
'shopping, luggage, or sporting equipment. The combination of '
'its lively acceleration and efficient Euro 6 engine means '
'this 118i Sport provides a more dynamic and responsive drive '
'compared to many vehicles in its class. This particular model '
'is well equipped to offer a refined and enjoyable ownership '
'experience.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 134,
'fuel_type': 'Petrol',
'id': 'e1fdaf53-58ee-5552-87e6-74eba1eda31e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149148806',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'BMW',
'model': '1 Series',
'odometer': 78900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d6aba34106f342c980596e15a32f3179.jpg',
'https://m.atcdn.co.uk/a/media/91a2bc8ce1554aaa92c447c64eaeb5ad.jpg',
'https://m.atcdn.co.uk/a/media/a8d46f05365b46c6bb16615c2c5e3de9.jpg',
'https://m.atcdn.co.uk/a/media/c5397dd6db074d72aecadab5e6de29d8.jpg',
'https://m.atcdn.co.uk/a/media/399532d2564545949a38359d7eb50692.jpg',
'https://m.atcdn.co.uk/a/media/cd7e856d85f44bf992012be420f2cb7f.jpg',
'https://m.atcdn.co.uk/a/media/d2879fa2fa27467dbd337f878e32a061.jpg',
'https://m.atcdn.co.uk/a/media/5bbf8eda924143b99a56d1ad998904e1.jpg',
'https://m.atcdn.co.uk/a/media/31f4731e749945a09bd88540cddbdc87.jpg',
'https://m.atcdn.co.uk/a/media/cc58082aa6db4ac7951d30779f141b02.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630677,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d6aba34106f342c980596e15a32f3179.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573596,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/91a2bc8ce1554aaa92c447c64eaeb5ad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676314,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a8d46f05365b46c6bb16615c2c5e3de9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637379,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c5397dd6db074d72aecadab5e6de29d8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 717804,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/399532d2564545949a38359d7eb50692.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703130,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd7e856d85f44bf992012be420f2cb7f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672058,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2879fa2fa27467dbd337f878e32a061.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574521,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5bbf8eda924143b99a56d1ad998904e1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 654216,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/31f4731e749945a09bd88540cddbdc87.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1fdaf53-58ee-5552-87e6-74eba1eda31e/e1fdaf53-58ee-5552-87e6-74eba1eda31e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 541745,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cc58082aa6db4ac7951d30779f141b02.jpg',
'Width': 2048}],
'price': 7295,
'price_includes_vat': True,
'registration_date': '2017-05-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1 Series 1.5 118i Sport Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2017}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149148806%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149148806: {'created_time': 1774883709.744736, 'last_price_update_time': 1774883709.744747}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149148806') HTTP/1.1" 204 0
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b50b328-eae9-5c80-ba13-b05f14f12b96 with identifier: 202511268159390
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b50b328-eae9-5c80-ba13-b05f14f12b96
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ea1df9fe7d34231bc366476364eac7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ea1df9fe7d34231bc366476364eac7e.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd835262bcafb4148b70f1ffae5c9cac3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d835262bcafb4148b70f1ffae5c9cac3.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F295c862279be442787a76bf68c3be4a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/295c862279be442787a76bf68c3be4a0.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcebc68786c4e42aab0d3d0c8e7db7a16.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cebc68786c4e42aab0d3d0c8e7db7a16.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8eb7bd65fbf44e86831160af00f57050.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8eb7bd65fbf44e86831160af00f57050.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01e4e0568cf6490d8adaa7ca1f11a3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01e4e0568cf6490d8adaa7ca1f11a3ac.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe79f9f3844b4562895457c1a76ddd47.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe79f9f3844b4562895457c1a76ddd47.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0fea1ecd026c449f9596ffa2c6895154.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0fea1ecd026c449f9596ffa2c6895154.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8536e375d5c24727b33f4988a64adf9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8536e375d5c24727b33f4988a64adf9e.jpg already downloaded
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F14010f4917e94199b91dd05cfed456df.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/14010f4917e94199b91dd05cfed456df.jpg already downloaded
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7b50b328-eae9-5c80-ba13-b05f14f12b96 with identifier 202511268159390
2026-03-30 15:15:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7b50b328-eae9-5c80-ba13-b05f14f12b96
2026-03-30 15:15:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2011 Volkswagen Golf TSI Match presents an exceptional '
'opportunity with its remarkably low mileage of just 51,500 '
'miles, a significant advantage for a vehicle of its age, and '
'comes with a clear vehicle history check. Powered by a '
'responsive 1.4 litre petrol engine, this Golf offers a '
'satisfying driving experience, reaching 0-62mph in a brisk '
'9.5 seconds. The Match trim level ensures a well equipped '
'interior, featuring Bluetooth telephone preparation for '
'seamless connectivity and Climatic semi-automatic air '
'conditioning to maintain a comfortable cabin temperature.\n'
'\n'
'Further enhancing its appeal, this Golf boasts both front and '
'rear parking sensors, making manoeuvring in tight spaces '
'considerably easier. The generous boot space is a practical '
'highlight, offering ample room for shopping, luggage, or '
'sports equipment. These features, combined with its efficient '
'engine and low mileage, demonstrate why this Volkswagen Golf '
'TSI Match stands out as a superior choice compared to other '
'vehicles in its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 120,
'fuel_type': 'Petrol',
'id': '7b50b328-eae9-5c80-ba13-b05f14f12b96',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268159390',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 51500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photo_urls': ['https://m.atcdn.co.uk/a/media/2ea1df9fe7d34231bc366476364eac7e.jpg',
'https://m.atcdn.co.uk/a/media/d835262bcafb4148b70f1ffae5c9cac3.jpg',
'https://m.atcdn.co.uk/a/media/295c862279be442787a76bf68c3be4a0.jpg',
'https://m.atcdn.co.uk/a/media/cebc68786c4e42aab0d3d0c8e7db7a16.jpg',
'https://m.atcdn.co.uk/a/media/8eb7bd65fbf44e86831160af00f57050.jpg',
'https://m.atcdn.co.uk/a/media/01e4e0568cf6490d8adaa7ca1f11a3ac.jpg',
'https://m.atcdn.co.uk/a/media/fe79f9f3844b4562895457c1a76ddd47.jpg',
'https://m.atcdn.co.uk/a/media/0fea1ecd026c449f9596ffa2c6895154.jpg',
'https://m.atcdn.co.uk/a/media/8536e375d5c24727b33f4988a64adf9e.jpg',
'https://m.atcdn.co.uk/a/media/14010f4917e94199b91dd05cfed456df.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318276,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ea1df9fe7d34231bc366476364eac7e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327794,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d835262bcafb4148b70f1ffae5c9cac3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334015,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/295c862279be442787a76bf68c3be4a0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346618,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cebc68786c4e42aab0d3d0c8e7db7a16.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324571,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8eb7bd65fbf44e86831160af00f57050.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415920,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/01e4e0568cf6490d8adaa7ca1f11a3ac.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415322,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe79f9f3844b4562895457c1a76ddd47.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384599,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0fea1ecd026c449f9596ffa2c6895154.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366269,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8536e375d5c24727b33f4988a64adf9e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b50b328-eae9-5c80-ba13-b05f14f12b96/7b50b328-eae9-5c80-ba13-b05f14f12b96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340408,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/14010f4917e94199b91dd05cfed456df.jpg',
'Width': 2048}],
'price': 6495,
'price_includes_vat': True,
'registration_date': '2011-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf 1.4 TSI Match DSG Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Match',
'year': 2011}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268159390%27 HTTP/1.1" 200 None
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268159390: {'created_time': 1774883709.975739, 'last_price_update_time': 1774883709.975751}
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268159390') HTTP/1.1" 204 0
2026-03-30 15:15:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:15:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d3824c91-afe5-5696-94e8-49145b0d0602 with identifier: 202511268150261
2026-03-30 15:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3824c91-afe5-5696-94e8-49145b0d0602
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F189befee6102460ba511fa3f7c586ff0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/189befee6102460ba511fa3f7c586ff0.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe66a095044ac43be9f3fa995508b092f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e66a095044ac43be9f3fa995508b092f.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc369908f03e2435b899096e5ce2906bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c369908f03e2435b899096e5ce2906bf.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5167c53f2750437188f63383f21a5e99.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5167c53f2750437188f63383f21a5e99.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe23f87e072de4f92afc5bd4583d24e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e23f87e072de4f92afc5bd4583d24e79.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0df401ac5084756a1a0c678fee78ad3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0df401ac5084756a1a0c678fee78ad3.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbec48a4db0ca45988a6504d777009e5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bec48a4db0ca45988a6504d777009e5f.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2c4f621ae004390bb3a3b1b94ee08ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2c4f621ae004390bb3a3b1b94ee08ec.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F094eac10980440d089a002264fa5fee0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/094eac10980440d089a002264fa5fee0.jpg already downloaded
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0878bc4d2a374d17a8d8135232a7636a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0878bc4d2a374d17a8d8135232a7636a.jpg already downloaded
2026-03-30 15:15:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d3824c91-afe5-5696-94e8-49145b0d0602 with identifier 202511268150261
2026-03-30 15:15:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d3824c91-afe5-5696-94e8-49145b0d0602
2026-03-30 15:15:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 145,
'color': 'Red',
'currency': 'GBP',
'description': 'This 2013 Nissan Juke Acenta Premium is a standout choice '
'with its remarkably low mileage of just 60,900 miles for its '
'age. Powered by a 1.6L petrol engine, this Acenta Premium '
'variant offers a comfortable and convenient driving '
'experience. It comes equipped with climate control air '
'conditioning to keep you cool, a colour reversing camera for '
'easier parking, and Bluetooth telephone integration for '
'seamless connectivity on the go.\n'
'\n'
'The Juke Acenta Premium also benefits from being in a low '
'insurance group, which can help to keep your running costs '
'down. This, combined with its low mileage and desirable '
'features, suggests this particular Nissan Juke offers '
'excellent value compared to other similar vehicles on the '
'market.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 115,
'fuel_type': 'Petrol',
'id': 'd3824c91-afe5-5696-94e8-49145b0d0602',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268150261',
'listing': 'directbuy',
'location': 'Romford, Essex',
'make': 'Nissan',
'model': 'Juke',
'odometer': 60900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/189befee6102460ba511fa3f7c586ff0.jpg',
'https://m.atcdn.co.uk/a/media/e66a095044ac43be9f3fa995508b092f.jpg',
'https://m.atcdn.co.uk/a/media/c369908f03e2435b899096e5ce2906bf.jpg',
'https://m.atcdn.co.uk/a/media/5167c53f2750437188f63383f21a5e99.jpg',
'https://m.atcdn.co.uk/a/media/e23f87e072de4f92afc5bd4583d24e79.jpg',
'https://m.atcdn.co.uk/a/media/a0df401ac5084756a1a0c678fee78ad3.jpg',
'https://m.atcdn.co.uk/a/media/bec48a4db0ca45988a6504d777009e5f.jpg',
'https://m.atcdn.co.uk/a/media/d2c4f621ae004390bb3a3b1b94ee08ec.jpg',
'https://m.atcdn.co.uk/a/media/094eac10980440d089a002264fa5fee0.jpg',
'https://m.atcdn.co.uk/a/media/0878bc4d2a374d17a8d8135232a7636a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459388,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/189befee6102460ba511fa3f7c586ff0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419987,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e66a095044ac43be9f3fa995508b092f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375492,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c369908f03e2435b899096e5ce2906bf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352288,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5167c53f2750437188f63383f21a5e99.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435043,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e23f87e072de4f92afc5bd4583d24e79.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414580,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0df401ac5084756a1a0c678fee78ad3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387912,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bec48a4db0ca45988a6504d777009e5f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370384,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2c4f621ae004390bb3a3b1b94ee08ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325557,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/094eac10980440d089a002264fa5fee0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3824c91-afe5-5696-94e8-49145b0d0602/d3824c91-afe5-5696-94e8-49145b0d0602_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313610,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0878bc4d2a374d17a8d8135232a7636a.jpg',
'Width': 2048}],
'price': 5696,
'price_includes_vat': True,
'registration_date': '2013-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.6 Acenta Premium CVT Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Acenta Premium',
'year': 2013}
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268150261%27 HTTP/1.1" 200 None
2026-03-30 15:15:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268150261: {'created_time': 1774883710.195991, 'last_price_update_time': 1774883710.196001}
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268150261') HTTP/1.1" 204 0
2026-03-30 15:15:10 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:15:10 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:15:10 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:15:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:15:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4ac6603c2c1f11f18e133aacc95538c6
2026-03-30 15:15:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:15:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:15:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:15:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:15:10 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587710 HTTP/1.1" 200 None
2026-03-30 15:15:10 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (13 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4ac6603c2c1f11f18e133aacc95538c6.jl
2026-03-30 15:15:10 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 100142,
'downloader/request_count': 3,
'downloader/request_method_count/POST': 3,
'downloader/response_bytes': 627991,
'downloader/response_count': 3,
'downloader/response_status_count/200': 3,
'elapsed_time_seconds': 12.970289,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 15, 15, 10, 842080, tzinfo=datetime.timezone.utc),
'item_scraped_count': 13,
'log_count/DEBUG': 419,
'log_count/INFO': 270,
'memusage/max': 149319680,
'memusage/startup': 149319680,
'request_depth_max': 1,
'response_received_count': 3,
'scheduler/dequeued': 3,
'scheduler/dequeued/memory': 3,
'scheduler/enqueued': 3,
'scheduler/enqueued/memory': 3,
'scrape_type/new': 13,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 3,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.6268346092353263,
'scrapy-zyte-api/mean_response_seconds': 1.6838094120224318,
'scrapy-zyte-api/processed': 3,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
'scrapy-zyte-api/request_args/experimental.requestCookies': 2,
'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
'scrapy-zyte-api/request_args/httpRequestBody': 3,
'scrapy-zyte-api/request_args/httpRequestMethod': 3,
'scrapy-zyte-api/request_args/httpResponseBody': 3,
'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
'scrapy-zyte-api/request_args/url': 3,
'scrapy-zyte-api/status_codes/200': 3,
'scrapy-zyte-api/success': 3,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 30, 15, 14, 57, 871791, tzinfo=datetime.timezone.utc)}
2026-03-30 15:15:10 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:15:11 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f285535b750>
2026-03-30 15:15:11 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f285535bf50>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)