2026-03-31 21:29:21 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-31 21:29:21 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-31 21:29:21 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-31 21:29:21 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-31 21:29:21 [auto_selling_autotrader.co.uk] INFO: _job: 7a69064a2ce811f19724def17024dec4, SCRAPY_JOB: None
2026-03-31 21:29:21 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-31 21:29:21 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-31 21:29:21 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-31 21:29:21 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-31 21:29:21 [scrapy.extensions.telnet] INFO: Telnet Password: e285e993061f19e2
2026-03-31 21:29:21 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-31 21:29:21 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/7a69064a2ce811f19724def17024dec4.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-31 21:29:21 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-31 21:29:21 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-31 21:29:21 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-31 21:29:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-31 21:29:21 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-31 21:29:21 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-31 21:29:21 [scrapy.core.engine] INFO: Spider opened
2026-03-31 21:29:21 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-31 21:29:21 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-31 21:29:21 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-31 21:29:21 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-31 21:29:21 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2026-03-31 21:29:21 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-31 21:29:21 [scrapy-playwright] INFO: Starting download handler
2026-03-31 21:29:21 [scrapy-playwright] INFO: Starting download handler
2026-03-31 21:29:26 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10037625 and multipost_profile_id: 824c1cb4-7e27-49df-94a5-2b9ecad212a5 and job_id: 7a69064a2ce811f19724def17024dec4 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10037625&sort=price-asc
2026-03-31 21:29:26 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10037625, page: 1
2026-03-31 21:29:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-31 21:29:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-31 21:29:27 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-31 21:29:27 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 14
2026-03-31 21:29:27 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-31 21:29:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-31 21:29:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-31 21:29:27 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-31 21:29:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-31 21:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603311172921%27 HTTP/1.1" 200 None
2026-03-31 21:29:27 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603311172921: 1
2026-03-31 21:29:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281097166%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603281097166: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921306%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230921306: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921002%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230921002: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200863387%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200863387: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130676939%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130676939: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110609050%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110609050: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070491173%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603070491173: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602280297116%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602280297116: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039642482%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602039642482: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149139971%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149139971: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149136822%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149136822: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512198711597%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512198711597: 1
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507214686771%27 HTTP/1.1" 200 None
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202507214686771: 1
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-31 21:29:28 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 4 detail requests (batch 2)
2026-03-31 21:29:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-31 21:29:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-31 21:29:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-31 21:29:29 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:29 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ee2553ff-4689-5fa9-b913-ac3de8522eb5 with identifier: 202601149139971
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee2553ff-4689-5fa9-b913-ac3de8522eb5
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc307016b4fda49edb223ee4a0b4d094f.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c307016b4fda49edb223ee4a0b4d094f.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a070078d61f47f88664c8394b04dfe2.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a070078d61f47f88664c8394b04dfe2.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73be83b8d82e435b85630698a6b391d9.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73be83b8d82e435b85630698a6b391d9.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b79793d67994de085e28a5f4b4c4515.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b79793d67994de085e28a5f4b4c4515.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc454566ad90e439fb723f19936af3301.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c454566ad90e439fb723f19936af3301.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4b48970937f418daac1093c2d0654d8.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4b48970937f418daac1093c2d0654d8.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff20787bf93654cbeb40c34d7f584cafa.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f20787bf93654cbeb40c34d7f584cafa.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde213c368de446d1b9c895fdfa19e410.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de213c368de446d1b9c895fdfa19e410.jpg already downloaded
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2dd8fb68de1e42f3b30ed2e76d7cfded.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2dd8fb68de1e42f3b30ed2e76d7cfded.jpg already downloaded
2026-03-31 21:29:29 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ee2553ff-4689-5fa9-b913-ac3de8522eb5 with identifier 202601149139971
2026-03-31 21:29:30 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-31 21:29:30 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-31 21:29:30 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-31 21:29:30 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-31 21:29:30 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-31 21:29:30 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2018
2026-03-31 21:29:30 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774992570
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774992570
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:30 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ee2553ff-4689-5fa9-b913-ac3de8522eb5
2026-03-31 21:29:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'White',
'currency': 'GBP',
'description': '*Part-exchange to clear* No warranty/guarantee* Sold on trade '
'to trade basis as is right now or spares or repair to whole '
'public* Retail price £4500+. Vauxhall Astra Van 2010 1.3 '
"diesel- We took this vehicle in part exchange but van doesn't "
'fit our stock profile- Van starts and drive like be should, '
'no knocks from suspension, brakes are good, tyres are good- '
'Need clean inside and outside- Long mot until 12/11/2026- '
'Astra is Hpi clear ( report will be provided)- Comes with '
"locking wheel nut and 2 keys- We don't inspect our trade cars "
'through workshop but we always describe them accurate as '
'possible with know faults. Thank you\n'
'\n'
'Please check our website for more cars www.automad.co.uk',
'doors_number': 3,
'emission_standard': 'Euro 4',
'engine': '1.3L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'id': 'ee2553ff-4689-5fa9-b913-ac3de8522eb5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149139971',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Vauxhall',
'model': 'Astra Van',
'odometer': 101700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c307016b4fda49edb223ee4a0b4d094f.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/4a070078d61f47f88664c8394b04dfe2.jpg',
'https://m.atcdn.co.uk/a/media/73be83b8d82e435b85630698a6b391d9.jpg',
'https://m.atcdn.co.uk/a/media/4b79793d67994de085e28a5f4b4c4515.jpg',
'https://m.atcdn.co.uk/a/media/c454566ad90e439fb723f19936af3301.jpg',
'https://m.atcdn.co.uk/a/media/f4b48970937f418daac1093c2d0654d8.jpg',
'https://m.atcdn.co.uk/a/media/f20787bf93654cbeb40c34d7f584cafa.jpg',
'https://m.atcdn.co.uk/a/media/de213c368de446d1b9c895fdfa19e410.jpg',
'https://m.atcdn.co.uk/a/media/2dd8fb68de1e42f3b30ed2e76d7cfded.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 919804,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c307016b4fda49edb223ee4a0b4d094f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 800975,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a070078d61f47f88664c8394b04dfe2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 879705,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73be83b8d82e435b85630698a6b391d9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 771489,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b79793d67994de085e28a5f4b4c4515.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 841729,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c454566ad90e439fb723f19936af3301.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829993,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4b48970937f418daac1093c2d0654d8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813185,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f20787bf93654cbeb40c34d7f584cafa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421467,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/de213c368de446d1b9c895fdfa19e410.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646461,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2dd8fb68de1e42f3b30ed2e76d7cfded.jpg',
'Width': 2048}],
'price': 2495,
'price_includes_vat': True,
'registration_date': '2010-07-20',
'seats_number': 2,
'seller_name': None,
'title': 'Vauxhall Astra Van 1.3 CDTi 16v Club 3dr',
'transmission': 'manual',
'trim': 'Club',
'year': 2010}
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149139971%27 HTTP/1.1" 200 None
2026-03-31 21:29:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149139971: {'created_time': 1774992570.719018, 'last_price_update_time': 1774992570.719026}
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149139971') HTTP/1.1" 204 0
2026-03-31 21:29:30 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:30 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 27c1bc37-95ec-541f-8506-142e24ae1591 with identifier: 202601149136822
2026-03-31 21:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27c1bc37-95ec-541f-8506-142e24ae1591
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad63b2e76c64415ba1e106c8e30b31ec.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad63b2e76c64415ba1e106c8e30b31ec.jpg already downloaded
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2613e12a37ea4a0e880b7d270c7a4799.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2613e12a37ea4a0e880b7d270c7a4799.jpg already downloaded
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F202fc51804684b33a80c2eca763372e3.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/202fc51804684b33a80c2eca763372e3.jpg already downloaded
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F840f4e38e6274158a0f47e274ec1c969.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/840f4e38e6274158a0f47e274ec1c969.jpg already downloaded
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2049c836e38c4537b21eaf95f0b58535.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2049c836e38c4537b21eaf95f0b58535.jpg already downloaded
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5e07f6538b241179942d6f89d88c821.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5e07f6538b241179942d6f89d88c821.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13d98003160d43feb7a978994a4a34df.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13d98003160d43feb7a978994a4a34df.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea0c3ad7bcd641dfafc9d2e32700fa20.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea0c3ad7bcd641dfafc9d2e32700fa20.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f37a225d4634776b6f4a03bc0d887e6.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f37a225d4634776b6f4a03bc0d887e6.jpg already downloaded
2026-03-31 21:29:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 27c1bc37-95ec-541f-8506-142e24ae1591 with identifier 202601149136822
2026-03-31 21:29:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 27c1bc37-95ec-541f-8506-142e24ae1591
2026-03-31 21:29:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Fiat '
'500x 2016 1.4T petrol 5dr- Car came to us as Main dealer part '
"exchange so it's very well looked after- Full Service "
'History- Fresh service- Long Mot until 02/12/2026- 3 months '
"warranty- Fiat is Hpi clear ( report will be provided)- It's "
'in lovely condition inside and outside- Service history show '
'services in: 2017, 2018, 2019, 2021, 2022, 2023, 2024, 2025, '
'2026- Safety/health check inspection has been done including '
'fresh service- Car will be supplied with Fresh Service, Long '
'MOT and 3 months warranty- Good spec car with plenty of toys '
'such as alloy wheels, power steering, half-leather seats, '
'front and rear electric windows, electric mirrors, Sat-nav, '
'rear parking sensors, Dual climate control, leather steering '
'wheel, cruise control, keyless start and stop, aux input, USB '
'input, Bluetooth, 12v socket, central locking, 2x keys and '
'much more.\n'
'\n'
'Please check our website for more cars www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': '27c1bc37-95ec-541f-8506-142e24ae1591',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149136822',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Fiat',
'model': '500X',
'odometer': 71255,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 53,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ad63b2e76c64415ba1e106c8e30b31ec.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/2613e12a37ea4a0e880b7d270c7a4799.jpg',
'https://m.atcdn.co.uk/a/media/202fc51804684b33a80c2eca763372e3.jpg',
'https://m.atcdn.co.uk/a/media/840f4e38e6274158a0f47e274ec1c969.jpg',
'https://m.atcdn.co.uk/a/media/2049c836e38c4537b21eaf95f0b58535.jpg',
'https://m.atcdn.co.uk/a/media/b5e07f6538b241179942d6f89d88c821.jpg',
'https://m.atcdn.co.uk/a/media/13d98003160d43feb7a978994a4a34df.jpg',
'https://m.atcdn.co.uk/a/media/ea0c3ad7bcd641dfafc9d2e32700fa20.jpg',
'https://m.atcdn.co.uk/a/media/3f37a225d4634776b6f4a03bc0d887e6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689705,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad63b2e76c64415ba1e106c8e30b31ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727783,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2613e12a37ea4a0e880b7d270c7a4799.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677895,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/202fc51804684b33a80c2eca763372e3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660421,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/840f4e38e6274158a0f47e274ec1c969.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662782,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2049c836e38c4537b21eaf95f0b58535.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720110,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b5e07f6538b241179942d6f89d88c821.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727279,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13d98003160d43feb7a978994a4a34df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626481,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea0c3ad7bcd641dfafc9d2e32700fa20.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635618,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f37a225d4634776b6f4a03bc0d887e6.jpg',
'Width': 2048}],
'price': 5990,
'price_includes_vat': True,
'registration_date': '2016-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.4 MultiAir Lounge Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2016}
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149136822%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149136822: {'created_time': 1774992571.078383, 'last_price_update_time': 1774992571.078394}
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149136822') HTTP/1.1" 204 0
2026-03-31 21:29:31 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7af276c0-b270-5959-84c1-e7c4795f72ae with identifier: 202512198711597
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7af276c0-b270-5959-84c1-e7c4795f72ae
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3943411dc0c74bc6a7adb40d16b052c9.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3943411dc0c74bc6a7adb40d16b052c9.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ae76ecaf9484df59a4ef45e86304411.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ae76ecaf9484df59a4ef45e86304411.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F33e634f0c1e04311abb298f5f6659bc8.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/33e634f0c1e04311abb298f5f6659bc8.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbf9898ac83ea413da35eb3438f1c1eea.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bf9898ac83ea413da35eb3438f1c1eea.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F909270c6e0e34065a56a03e24232735d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/909270c6e0e34065a56a03e24232735d.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F862d4e3321ea498ebbe2adc0b5cdc121.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/862d4e3321ea498ebbe2adc0b5cdc121.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F37e56e731eb9464a91dc6448accd3d51.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/37e56e731eb9464a91dc6448accd3d51.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2d1006a870f94496b2b725cb2ba894a8.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2d1006a870f94496b2b725cb2ba894a8.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1effeffa74a249b3857523bf3520328d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1effeffa74a249b3857523bf3520328d.jpg already downloaded
2026-03-31 21:29:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7af276c0-b270-5959-84c1-e7c4795f72ae with identifier 202512198711597
2026-03-31 21:29:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7af276c0-b270-5959-84c1-e7c4795f72ae
2026-03-31 21:29:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Kia '
'Optima 2014 1.7 diesel 4dr- Car came to us as Main dealer '
"part exchange so it's very well looked after- Only 3 owners "
'from new and same owner since 2018!- Service history- Fresh '
'service- Long mot until 16/10/2026 without any advisories- 3 '
'months warranty- Optima is Hpi clear ( report will be '
"provided)- It's in lovely condition inside and outside- "
'Service history show services in 2015/ 2016/ 2017/ 2018/ '
'2021/ 2025- Safety/health check inspection has been done- '
'Recently new rear brake discs and pads has been fitted- Car '
'will be supplied with fresh service, Long MOT until '
'16/10/2026 and 3 months warranty- Very good spec car with '
'plenty of toys such as diamond cut alloy wheels, power '
'steering, full leather-electric-heated seats with memory '
'settings, reverse camera, front and rear electric windows, '
'electric mirrors, Sat-nav, rear and front parking sensors, '
'Dual climate control, leather steering wheel, cruise control, '
'aux input, USB input, Bluetooth, 12v socket, central locking, '
'2x keys and much more.\n'
'\n'
'Please check our website for more cars www.automad.co.uk',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '1.7L',
'engine_horse_power': 134,
'fuel_type': 'Diesel',
'id': '7af276c0-b270-5959-84c1-e7c4795f72ae',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512198711597',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Kia',
'model': 'Optima',
'odometer': 57402,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 65,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3943411dc0c74bc6a7adb40d16b052c9.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/2ae76ecaf9484df59a4ef45e86304411.jpg',
'https://m.atcdn.co.uk/a/media/33e634f0c1e04311abb298f5f6659bc8.jpg',
'https://m.atcdn.co.uk/a/media/bf9898ac83ea413da35eb3438f1c1eea.jpg',
'https://m.atcdn.co.uk/a/media/909270c6e0e34065a56a03e24232735d.jpg',
'https://m.atcdn.co.uk/a/media/862d4e3321ea498ebbe2adc0b5cdc121.jpg',
'https://m.atcdn.co.uk/a/media/37e56e731eb9464a91dc6448accd3d51.jpg',
'https://m.atcdn.co.uk/a/media/2d1006a870f94496b2b725cb2ba894a8.jpg',
'https://m.atcdn.co.uk/a/media/1effeffa74a249b3857523bf3520328d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1000101,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3943411dc0c74bc6a7adb40d16b052c9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 971465,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ae76ecaf9484df59a4ef45e86304411.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859196,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/33e634f0c1e04311abb298f5f6659bc8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 917872,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bf9898ac83ea413da35eb3438f1c1eea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 839926,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/909270c6e0e34065a56a03e24232735d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 910193,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/862d4e3321ea498ebbe2adc0b5cdc121.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 977267,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/37e56e731eb9464a91dc6448accd3d51.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 901631,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2d1006a870f94496b2b725cb2ba894a8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 837608,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1effeffa74a249b3857523bf3520328d.jpg',
'Width': 2048}],
'price': 6950,
'price_includes_vat': True,
'registration_date': '2014-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Optima 1.7 CRDi EcoDynamics 2 Euro 5 (s/s) 4dr',
'transmission': 'manual',
'trim': '2',
'year': 2014}
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512198711597%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512198711597: {'created_time': 1774992571.339581, 'last_price_update_time': 1774992571.339591}
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512198711597') HTTP/1.1" 204 0
2026-03-31 21:29:31 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 26015fae-ff8c-5576-a20e-5674265ae067 with identifier: 202507214686771
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26015fae-ff8c-5576-a20e-5674265ae067
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd7b6ec6112b847408f26daeb6c197bf6.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d7b6ec6112b847408f26daeb6c197bf6.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb9f2d4334284243bc6d9a854b354ea0.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db9f2d4334284243bc6d9a854b354ea0.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60819cbc45a44aada14c5b4c21ad3756.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60819cbc45a44aada14c5b4c21ad3756.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5eede684a46041308d74e14f83f4c77b.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5eede684a46041308d74e14f83f4c77b.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e081de99d6a4b1189a10c2c7c3bc9d5.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e081de99d6a4b1189a10c2c7c3bc9d5.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf81c1a0b1bf4f11b3a5c9da16aaa862.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df81c1a0b1bf4f11b3a5c9da16aaa862.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F285ac1bfc22b49f18b34dfbd5040e16e.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/285ac1bfc22b49f18b34dfbd5040e16e.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F046dfee640ba4f859b381b0e9c649acf.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/046dfee640ba4f859b381b0e9c649acf.jpg already downloaded
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb2217e88a97469f938a8e0edcd14df2.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db2217e88a97469f938a8e0edcd14df2.jpg already downloaded
2026-03-31 21:29:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 26015fae-ff8c-5576-a20e-5674265ae067 with identifier 202507214686771
2026-03-31 21:29:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 26015fae-ff8c-5576-a20e-5674265ae067
2026-03-31 21:29:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Red',
'currency': 'GBP',
'description': 'Very clean and cheap to run 1st/family car- Hyundai i20 2015 '
'1.2 petrol 5dr. Only £35 road tax- Only 2 owners from new and '
'same one since 2021-Service history- Fresh service- Fresh '
'MOT- 3 months warranty- Hyundai is Hpi clear ( report will be '
"provided). It's in lovely condition inside and outside. "
'Safety/health check inspection has been done including fresh '
'service. Car will be supplied with fresh service, Fresh MOT '
'and 3 months warranty. Very good spec car with plenty of toys '
'such as front and rear fog lights, alloy wheels, power '
'steering, front and rear electric windows, electric mirrors, '
'rear parking sensors, AC, leather steering wheel, cruise '
'control, aux input, USB input, Bluetooth, 12v socket, central '
'locking, 2x keys and much more.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 83,
'fuel_type': 'Petrol',
'id': '26015fae-ff8c-5576-a20e-5674265ae067',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202507214686771',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Hyundai',
'model': 'i20',
'odometer': 99825,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d7b6ec6112b847408f26daeb6c197bf6.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/db9f2d4334284243bc6d9a854b354ea0.jpg',
'https://m.atcdn.co.uk/a/media/60819cbc45a44aada14c5b4c21ad3756.jpg',
'https://m.atcdn.co.uk/a/media/5eede684a46041308d74e14f83f4c77b.jpg',
'https://m.atcdn.co.uk/a/media/9e081de99d6a4b1189a10c2c7c3bc9d5.jpg',
'https://m.atcdn.co.uk/a/media/df81c1a0b1bf4f11b3a5c9da16aaa862.jpg',
'https://m.atcdn.co.uk/a/media/285ac1bfc22b49f18b34dfbd5040e16e.jpg',
'https://m.atcdn.co.uk/a/media/046dfee640ba4f859b381b0e9c649acf.jpg',
'https://m.atcdn.co.uk/a/media/db2217e88a97469f938a8e0edcd14df2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 785172,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d7b6ec6112b847408f26daeb6c197bf6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752621,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db9f2d4334284243bc6d9a854b354ea0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702482,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60819cbc45a44aada14c5b4c21ad3756.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544745,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5eede684a46041308d74e14f83f4c77b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729922,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e081de99d6a4b1189a10c2c7c3bc9d5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747299,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/df81c1a0b1bf4f11b3a5c9da16aaa862.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762565,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/285ac1bfc22b49f18b34dfbd5040e16e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 733193,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/046dfee640ba4f859b381b0e9c649acf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655306,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db2217e88a97469f938a8e0edcd14df2.jpg',
'Width': 2048}],
'price': 3995,
'price_includes_vat': True,
'registration_date': '2015-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i20 1.2 Blue Drive SE Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2015}
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507214686771%27 HTTP/1.1" 200 None
2026-03-31 21:29:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202507214686771: {'created_time': 1774992571.586983, 'last_price_update_time': 1774992571.586992}
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202507214686771') HTTP/1.1" 204 0
2026-03-31 21:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-31 21:29:40 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:40 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: effa3d9a-9c26-5ede-be4a-4bc45df280a6 with identifier: 202603311172921
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 3 photos for item effa3d9a-9c26-5ede-be4a-4bc45df280a6
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48166f2f59444d58a10ca1b96e573f52.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48166f2f59444d58a10ca1b96e573f52.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dc9847c307d493b91b64ddf31387591.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dc9847c307d493b91b64ddf31387591.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:40 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:40 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a740f51-f85f-51f3-b593-a321746adb7f with identifier: 202603281097166
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7eff90a7546546c2b4aaeabcad9bdb39.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7eff90a7546546c2b4aaeabcad9bdb39.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2db1ce53732428fbe22605a57b2d7cb.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2db1ce53732428fbe22605a57b2d7cb.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa899ca687020442388bfb8b007042f60.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a899ca687020442388bfb8b007042f60.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53bb852928d5488dbfd803b94b897069.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53bb852928d5488dbfd803b94b897069.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc43496c224f345cdae26821587aef7ec.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c43496c224f345cdae26821587aef7ec.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc95bc2ecdec40b587c39ab390466933.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc95bc2ecdec40b587c39ab390466933.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe984291fc9274376bc1ccdf76a1786d9.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e984291fc9274376bc1ccdf76a1786d9.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4d503ea834bf40989e1731619203058c.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4d503ea834bf40989e1731619203058c.jpg not downloaded yet
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F220c2cffcbfe43eebaeba857d2328fdd.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/220c2cffcbfe43eebaeba857d2328fdd.jpg not downloaded yet
2026-03-31 21:29:40 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:40 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac with identifier: 202603230921306
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98c86cdffd344706b52fa298caa7e593.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98c86cdffd344706b52fa298caa7e593.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07bb19c65fbc4d80bb873ad90c6e8b6b.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07bb19c65fbc4d80bb873ad90c6e8b6b.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77e9ccb8271047e6aef06c0346f07528.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77e9ccb8271047e6aef06c0346f07528.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb2713b849de74c35b0ee3fde3274b5ef.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b2713b849de74c35b0ee3fde3274b5ef.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd99b0b3d9bf4ae1951e43e615d9e02a.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd99b0b3d9bf4ae1951e43e615d9e02a.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0168abbecb814d32be25e2b66dbffd2b.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0168abbecb814d32be25e2b66dbffd2b.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29f46a3f39984f348df56620273d6030.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29f46a3f39984f348df56620273d6030.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F898628d8fee04fe7a862ebaa16afc579.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/898628d8fee04fe7a862ebaa16afc579.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8535cf9d2ab34e0588c8789b264b5daf.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8535cf9d2ab34e0588c8789b264b5daf.jpg already downloaded
2026-03-31 21:29:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac with identifier 202603230921306
2026-03-31 21:29:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac
2026-03-31 21:29:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Ford '
'Kuga 2017 St-line 2.0 diesel 5dr SUV- ULEZ compliant- Car '
"came to us as Main dealer part exchange so it's very well "
'looked after- Only 2 owners from new and same owner since '
'2020!- Full Service History with 9x stamps!- Fresh service- '
'Fresh MOT- 3 months warranty- Kuga is Hpi clear ( report will '
"be provided)- It's in lovely condition inside and outside- "
'Safety/health check inspection has been done including fresh '
'service and 2x new tyres- Recently changed front and rear '
'brakes- Car will be supplied with fresh service, fresh MOT '
'and 3 months warranty- Very good spec car with plenty of toys '
"such as 19'' alloy wheels, power steering, panoramic "
'roof/sunroof, half leather-electric-heated seats, reverse '
'camera, hands free power tailgate, front and rear electric '
'windows, electric mirrors, Sat-nav, rear and front parking '
'sensors, Dual climate control, leather steering wheel, cruise '
'control, keyless entry/start and stop, aux input, USB input, '
'Bluetooth, 12v socket, central locking, 2x keys and much '
'more.\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230921306',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Ford',
'model': 'Kuga',
'odometer': 82154,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 65,
'photo_urls': ['https://m.atcdn.co.uk/a/media/98c86cdffd344706b52fa298caa7e593.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/07bb19c65fbc4d80bb873ad90c6e8b6b.jpg',
'https://m.atcdn.co.uk/a/media/77e9ccb8271047e6aef06c0346f07528.jpg',
'https://m.atcdn.co.uk/a/media/b2713b849de74c35b0ee3fde3274b5ef.jpg',
'https://m.atcdn.co.uk/a/media/cd99b0b3d9bf4ae1951e43e615d9e02a.jpg',
'https://m.atcdn.co.uk/a/media/0168abbecb814d32be25e2b66dbffd2b.jpg',
'https://m.atcdn.co.uk/a/media/29f46a3f39984f348df56620273d6030.jpg',
'https://m.atcdn.co.uk/a/media/898628d8fee04fe7a862ebaa16afc579.jpg',
'https://m.atcdn.co.uk/a/media/8535cf9d2ab34e0588c8789b264b5daf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776116,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98c86cdffd344706b52fa298caa7e593.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810913,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/07bb19c65fbc4d80bb873ad90c6e8b6b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762667,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/77e9ccb8271047e6aef06c0346f07528.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696388,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b2713b849de74c35b0ee3fde3274b5ef.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 786012,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd99b0b3d9bf4ae1951e43e615d9e02a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752313,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0168abbecb814d32be25e2b66dbffd2b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762166,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/29f46a3f39984f348df56620273d6030.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707114,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/898628d8fee04fe7a862ebaa16afc579.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596123,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8535cf9d2ab34e0588c8789b264b5daf.jpg',
'Width': 2048}],
'price': 9350,
'price_includes_vat': True,
'registration_date': '2017-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2017}
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921306%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230921306: {'created_time': 1774992580.672786, 'last_price_update_time': 1774992580.672797}
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230921306') HTTP/1.1" 204 0
2026-03-31 21:29:40 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:40 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 164909a5-4b3f-5191-92c5-dcd3559664bc with identifier: 202603230921002
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 164909a5-4b3f-5191-92c5-dcd3559664bc
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9978f7d372b44455ba09deeef3a541dd.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9978f7d372b44455ba09deeef3a541dd.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe09522940cf14ce188cd2f9f1661aac3.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e09522940cf14ce188cd2f9f1661aac3.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fca705eb7459a43bd8a70ead5b9b06a2f.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ca705eb7459a43bd8a70ead5b9b06a2f.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd1c83905deb4de7a3d7b42e7a2cea4d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd1c83905deb4de7a3d7b42e7a2cea4d.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F208c76c8621c4251a1664bb039feba3c.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/208c76c8621c4251a1664bb039feba3c.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff7861c8ce65a47008010feb3d44eeb5e.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f7861c8ce65a47008010feb3d44eeb5e.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac2ca5713c9a4fb3aadcf0fbd17afe66.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac2ca5713c9a4fb3aadcf0fbd17afe66.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d884fa67e3b47d6a25e398ce1eb9281.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d884fa67e3b47d6a25e398ce1eb9281.jpg already downloaded
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d614d54cce84614955fd1ea237a3343.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d614d54cce84614955fd1ea237a3343.jpg already downloaded
2026-03-31 21:29:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 164909a5-4b3f-5191-92c5-dcd3559664bc with identifier 202603230921002
2026-03-31 21:29:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 164909a5-4b3f-5191-92c5-dcd3559664bc
2026-03-31 21:29:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 194,
'color': 'Black',
'currency': 'GBP',
'description': 'Isuzu D-max Utah Vision 2013 2.5 diesel 4x4- Vehicle came to '
"us as Main dealer part exchange so it's very well looked "
'after- Same owner from new- Very good service history with '
'8x stamps ( 5x from Main Dealer)- Fresh service- Fresh mot- 3 '
'months warranty- D-max is Hpi clear ( report will be '
"provided)- It's in lovely condition inside and outside- "
'Safety/health check inspection has been done including fresh '
'service- Pickup truck will be supplied with fresh service, '
'Fresh MOT and 3 months warranty- Good spec with alloy wheels, '
'power steering, full leather-electric-heated seats, reverse '
'camera, front and rear electric windows, electric mirrors, '
'Sat-nav, rear parking sensors, AC, leather steering wheel, '
'cruise control, aux input, USB input, Bluetooth, 12v socket, '
'central locking and much more.\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2.5L',
'engine_horse_power': 161,
'fuel_type': 'Diesel',
'id': '164909a5-4b3f-5191-92c5-dcd3559664bc',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230921002',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 119200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9978f7d372b44455ba09deeef3a541dd.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/e09522940cf14ce188cd2f9f1661aac3.jpg',
'https://m.atcdn.co.uk/a/media/ca705eb7459a43bd8a70ead5b9b06a2f.jpg',
'https://m.atcdn.co.uk/a/media/cd1c83905deb4de7a3d7b42e7a2cea4d.jpg',
'https://m.atcdn.co.uk/a/media/208c76c8621c4251a1664bb039feba3c.jpg',
'https://m.atcdn.co.uk/a/media/f7861c8ce65a47008010feb3d44eeb5e.jpg',
'https://m.atcdn.co.uk/a/media/ac2ca5713c9a4fb3aadcf0fbd17afe66.jpg',
'https://m.atcdn.co.uk/a/media/9d884fa67e3b47d6a25e398ce1eb9281.jpg',
'https://m.atcdn.co.uk/a/media/6d614d54cce84614955fd1ea237a3343.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731350,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9978f7d372b44455ba09deeef3a541dd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 791171,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e09522940cf14ce188cd2f9f1661aac3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802170,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ca705eb7459a43bd8a70ead5b9b06a2f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763325,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd1c83905deb4de7a3d7b42e7a2cea4d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777730,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/208c76c8621c4251a1664bb039feba3c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 815641,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f7861c8ce65a47008010feb3d44eeb5e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697207,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac2ca5713c9a4fb3aadcf0fbd17afe66.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706444,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d884fa67e3b47d6a25e398ce1eb9281.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618338,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d614d54cce84614955fd1ea237a3343.jpg',
'Width': 2048}],
'price': 8994,
'price_includes_vat': True,
'registration_date': '2013-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max 2.5 TD Utah Vision 4x4 4dr',
'transmission': 'manual',
'trim': 'Utah Vision',
'year': 2013}
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921002%27 HTTP/1.1" 200 None
2026-03-31 21:29:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230921002: {'created_time': 1774992580.939913, 'last_price_update_time': 1774992580.939926}
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230921002') HTTP/1.1" 204 0
2026-03-31 21:29:40 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:40 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c72bf76c-53c6-585e-afe1-7eb8ad7fda1e with identifier: 202603200863387
2026-03-31 21:29:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c72bf76c-53c6-585e-afe1-7eb8ad7fda1e
2026-03-31 21:29:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6bb2b2972eab445cb6800f0b3c5ab80c.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6bb2b2972eab445cb6800f0b3c5ab80c.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5dabedaa9b464b1888c9804a6a257f26.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5dabedaa9b464b1888c9804a6a257f26.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdaa123c8b0f040da9a0338e16ecd707f.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/daa123c8b0f040da9a0338e16ecd707f.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd988da667c2f4dbd9912d3953ceeeb28.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d988da667c2f4dbd9912d3953ceeeb28.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Facd747858caf4e9c983ac3ce7691f3b4.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/acd747858caf4e9c983ac3ce7691f3b4.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7beb6ab9d4f54e75acb98066d6ce594c.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7beb6ab9d4f54e75acb98066d6ce594c.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2696102cba64985b88b7b5f69286a63.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2696102cba64985b88b7b5f69286a63.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F904b4fb4de184833ac9e3315764c6171.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/904b4fb4de184833ac9e3315764c6171.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9fbacf1f3e44d3685ecca83aa41ce85.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9fbacf1f3e44d3685ecca83aa41ce85.jpg already downloaded
2026-03-31 21:29:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c72bf76c-53c6-585e-afe1-7eb8ad7fda1e with identifier 202603200863387
2026-03-31 21:29:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c72bf76c-53c6-585e-afe1-7eb8ad7fda1e
2026-03-31 21:29:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with very low mileage- '
'Vauxhall Insignia 2015 2.0 diesel 5dr estate- Only £35 road '
"tax- Car came to us as Main dealer part exchange so it's very "
'well looked after- Only 4 owners from new and same owner '
'since 2021!- Full Service History with 11x stamps!- Fresh '
'service- Fresh MOT- 3 months warranty- Insignia is Hpi clear '
"( report will be provided)- It's in lovely condition inside "
'and outside- Safety/health check inspection has been done '
'including fresh service- Car will be supplied with fresh '
'service, Fresh MOT and 3 months warranty- Good spec car with '
'plenty of toys such as alloy wheels, power steering, front '
'and rear electric windows, electric mirrors, DAB radio, AC, '
'leather steering wheel, cruise control, aux input, USB input, '
'Bluetooth, 12v socket, central locking, 2x keys, brand new '
'tow bar and much more.\n'
'\n'
'More cars available on our website: www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 161,
'fuel_type': 'Diesel',
'id': 'c72bf76c-53c6-585e-afe1-7eb8ad7fda1e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200863387',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Vauxhall',
'model': 'Insignia',
'odometer': 57500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6bb2b2972eab445cb6800f0b3c5ab80c.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/5dabedaa9b464b1888c9804a6a257f26.jpg',
'https://m.atcdn.co.uk/a/media/daa123c8b0f040da9a0338e16ecd707f.jpg',
'https://m.atcdn.co.uk/a/media/d988da667c2f4dbd9912d3953ceeeb28.jpg',
'https://m.atcdn.co.uk/a/media/acd747858caf4e9c983ac3ce7691f3b4.jpg',
'https://m.atcdn.co.uk/a/media/7beb6ab9d4f54e75acb98066d6ce594c.jpg',
'https://m.atcdn.co.uk/a/media/a2696102cba64985b88b7b5f69286a63.jpg',
'https://m.atcdn.co.uk/a/media/904b4fb4de184833ac9e3315764c6171.jpg',
'https://m.atcdn.co.uk/a/media/e9fbacf1f3e44d3685ecca83aa41ce85.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 945111,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6bb2b2972eab445cb6800f0b3c5ab80c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 957664,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5dabedaa9b464b1888c9804a6a257f26.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1071194,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/daa123c8b0f040da9a0338e16ecd707f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 862408,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d988da667c2f4dbd9912d3953ceeeb28.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 925225,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/acd747858caf4e9c983ac3ce7691f3b4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1012767,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7beb6ab9d4f54e75acb98066d6ce594c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 936552,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2696102cba64985b88b7b5f69286a63.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805227,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/904b4fb4de184833ac9e3315764c6171.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 814398,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9fbacf1f3e44d3685ecca83aa41ce85.jpg',
'Width': 2048}],
'price': 6650,
'price_includes_vat': True,
'registration_date': '2015-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Insignia 2.0 CDTi ecoFLEX SRi Sports Tourer Euro 5 (s/s) '
'5dr',
'transmission': 'manual',
'trim': 'SRi',
'year': 2015}
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200863387%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200863387: {'created_time': 1774992581.224213, 'last_price_update_time': 1774992581.224221}
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200863387') HTTP/1.1" 204 0
2026-03-31 21:29:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8568a6ed-985a-5f73-b346-7968619286f4 with identifier: 202603130676939
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8568a6ed-985a-5f73-b346-7968619286f4
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F92a0928b647c40ef944ad46941444e60.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/92a0928b647c40ef944ad46941444e60.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1d2c430c3d3408e831feb1b2a178e08.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1d2c430c3d3408e831feb1b2a178e08.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F471d2daefc95424099c22adc14c41e6d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/471d2daefc95424099c22adc14c41e6d.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F177c2f4e223b420ba335ec02063f39fd.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/177c2f4e223b420ba335ec02063f39fd.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9257ebfff0ed463c8f544d34bfa5d3b2.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9257ebfff0ed463c8f544d34bfa5d3b2.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40df341bd1934ef9afb65427754b3834.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40df341bd1934ef9afb65427754b3834.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0c6a202a89349c7b419ebde186fb0f7.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0c6a202a89349c7b419ebde186fb0f7.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb14e4450458d421da946e2543f2285ab.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b14e4450458d421da946e2543f2285ab.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F51c456c55b6d4546b5c0473ef5d33978.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/51c456c55b6d4546b5c0473ef5d33978.jpg already downloaded
2026-03-31 21:29:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8568a6ed-985a-5f73-b346-7968619286f4 with identifier 202603130676939
2026-03-31 21:29:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8568a6ed-985a-5f73-b346-7968619286f4
2026-03-31 21:29:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'White',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- '
'Mitsubishi ASX 2018 1.6 petrol 5dr SUV- Car came to us as '
"Main dealer part exchange so it's very well looked after- "
'Only 2 owners from new and same owner since 2019!- Service '
'history- Fresh service- Long MOT until 21/01/2027 without any '
'advisories- 3 months warranty- ASX is Hpi clear ( report will '
"be provided)- It's in lovely condition inside and outside- "
'Safety/health check inspection has been done including fresh '
'service and 2x new tyres- Car will be supplied with fresh '
'service, long MOT and 3 months warranty- Top spec car with '
'plenty of toys such as front and rear fog lights, alloy '
'wheels, power steering, panoramic roof, half leather-heated '
'seats, reverse camera, front and rear electric windows, '
'electric mirrors, Dual climate control, leather steering '
'wheel, cruise control, keyless entry/start and stop, aux '
'input, USB input, Bluetooth, 12v socket, central locking, 2x '
'keys and much more.\n'
'\n'
'More cars available on our website: www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 115,
'fuel_type': 'Petrol',
'id': '8568a6ed-985a-5f73-b346-7968619286f4',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130676939',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 75437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 58,
'photo_urls': ['https://m.atcdn.co.uk/a/media/92a0928b647c40ef944ad46941444e60.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/d1d2c430c3d3408e831feb1b2a178e08.jpg',
'https://m.atcdn.co.uk/a/media/471d2daefc95424099c22adc14c41e6d.jpg',
'https://m.atcdn.co.uk/a/media/177c2f4e223b420ba335ec02063f39fd.jpg',
'https://m.atcdn.co.uk/a/media/9257ebfff0ed463c8f544d34bfa5d3b2.jpg',
'https://m.atcdn.co.uk/a/media/40df341bd1934ef9afb65427754b3834.jpg',
'https://m.atcdn.co.uk/a/media/a0c6a202a89349c7b419ebde186fb0f7.jpg',
'https://m.atcdn.co.uk/a/media/b14e4450458d421da946e2543f2285ab.jpg',
'https://m.atcdn.co.uk/a/media/51c456c55b6d4546b5c0473ef5d33978.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687095,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/92a0928b647c40ef944ad46941444e60.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749060,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1d2c430c3d3408e831feb1b2a178e08.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774772,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/471d2daefc95424099c22adc14c41e6d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624100,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/177c2f4e223b420ba335ec02063f39fd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712733,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9257ebfff0ed463c8f544d34bfa5d3b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782366,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/40df341bd1934ef9afb65427754b3834.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701919,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0c6a202a89349c7b419ebde186fb0f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620595,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b14e4450458d421da946e2543f2285ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507444,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/51c456c55b6d4546b5c0473ef5d33978.jpg',
'Width': 2048}],
'price': 8495,
'price_includes_vat': True,
'registration_date': '2018-01-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 4 Euro 6 5dr',
'transmission': 'manual',
'trim': '4',
'year': 2018}
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130676939%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130676939: {'created_time': 1774992581.456927, 'last_price_update_time': 1774992581.456936}
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130676939') HTTP/1.1" 204 0
2026-03-31 21:29:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b028ca-9352-5630-8276-ff489c2b4fb8 with identifier: 202603110609050
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9b028ca-9352-5630-8276-ff489c2b4fb8
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5433705088ab4004b445f13a5f3a6d26.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5433705088ab4004b445f13a5f3a6d26.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd440c4b07f81488f87beea4ea80d619c.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d440c4b07f81488f87beea4ea80d619c.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e0e0d6b80f84a0b8645713afa5238ee.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e0e0d6b80f84a0b8645713afa5238ee.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ebb7049198f4539959e5d6286fe8fad.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ebb7049198f4539959e5d6286fe8fad.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7114f9fd5a98425ebd325b1cad7c06ab.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7114f9fd5a98425ebd325b1cad7c06ab.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F406045eca9d348f99174c05cc1906c17.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/406045eca9d348f99174c05cc1906c17.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F81e84b8e187f4275bd82992a55598b46.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/81e84b8e187f4275bd82992a55598b46.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fca8c73f548eb472b85a7619e719a866f.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ca8c73f548eb472b85a7619e719a866f.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7234abb4acb742498c59689bf88f094e.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7234abb4acb742498c59689bf88f094e.jpg already downloaded
2026-03-31 21:29:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a9b028ca-9352-5630-8276-ff489c2b4fb8 with identifier 202603110609050
2026-03-31 21:29:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a9b028ca-9352-5630-8276-ff489c2b4fb8
2026-03-31 21:29:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Grey',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Audi '
'A6 2011 S-line 2.0 diesel 4dr- Car came to us as Main dealer '
"part exchange so it's very well looked after- Only 3 owners "
'from new and same owner since 2014!- Full Audi Service '
'history- Fresh service by Audi- long MOT until 20/08/2026- 3 '
'months warranty- Audi is Hpi clear ( report will be '
"provided)- It's in lovely condition inside and outside- "
'Service history show services in 2012, 2013, 2014, 2015, '
'2016, 2018, 2020, 2020, 2022, 2024, 2025, 2025. Fresh service '
'has been done by Audi main dealer at 87840 11/08/2025 with '
'fresh MOT- Also 4x alloy wheel has been refurbished- '
'Safety/health check inspection has been done- Car will be '
'supplied with fresh service, long MOT until 20/08/2026 and 3 '
'months warranty- Very good spec car with plenty of toys such '
'as front and rear fog lights, alloy wheels, power steering, '
'full leather seats, front and rear electric windows, electric '
'mirrors, Sat-nav, rear parking sensors, Dual climate control, '
'leather steering wheel, cruise control, aux input, USB input, '
'Bluetooth, 12v socket, central locking, 2x keys and much '
'more.\n'
'\n'
'More cars available on our website: www.automad.co.uk',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Diesel',
'id': 'a9b028ca-9352-5630-8276-ff489c2b4fb8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110609050',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Audi',
'model': 'A6 Saloon',
'odometer': 88000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photo_urls': ['https://m.atcdn.co.uk/a/media/5433705088ab4004b445f13a5f3a6d26.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/d440c4b07f81488f87beea4ea80d619c.jpg',
'https://m.atcdn.co.uk/a/media/4e0e0d6b80f84a0b8645713afa5238ee.jpg',
'https://m.atcdn.co.uk/a/media/3ebb7049198f4539959e5d6286fe8fad.jpg',
'https://m.atcdn.co.uk/a/media/7114f9fd5a98425ebd325b1cad7c06ab.jpg',
'https://m.atcdn.co.uk/a/media/406045eca9d348f99174c05cc1906c17.jpg',
'https://m.atcdn.co.uk/a/media/81e84b8e187f4275bd82992a55598b46.jpg',
'https://m.atcdn.co.uk/a/media/ca8c73f548eb472b85a7619e719a866f.jpg',
'https://m.atcdn.co.uk/a/media/7234abb4acb742498c59689bf88f094e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 929339,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5433705088ab4004b445f13a5f3a6d26.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 894749,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d440c4b07f81488f87beea4ea80d619c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 972593,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e0e0d6b80f84a0b8645713afa5238ee.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 884590,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ebb7049198f4539959e5d6286fe8fad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 921113,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7114f9fd5a98425ebd325b1cad7c06ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 962493,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/406045eca9d348f99174c05cc1906c17.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 882283,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/81e84b8e187f4275bd82992a55598b46.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 901039,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ca8c73f548eb472b85a7619e719a866f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848830,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7234abb4acb742498c59689bf88f094e.jpg',
'Width': 2048}],
'price': 4990,
'price_includes_vat': True,
'registration_date': '2011-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 Saloon 2.0 TDIe S line Euro 5 4dr',
'transmission': 'manual',
'trim': 'S line',
'year': 2011}
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110609050%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110609050: {'created_time': 1774992581.708877, 'last_price_update_time': 1774992581.708891}
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110609050') HTTP/1.1" 204 0
2026-03-31 21:29:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a3effda-9ce9-522c-86de-bc63cc2b5d04 with identifier: 202603070491173
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a3effda-9ce9-522c-86de-bc63cc2b5d04
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fece74c2d09dc47849d218f100418a730.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ece74c2d09dc47849d218f100418a730.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F872ffb71671c4a75aa59ea003ee8ce9d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/872ffb71671c4a75aa59ea003ee8ce9d.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F226008c42af54679b3b1017920b86301.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/226008c42af54679b3b1017920b86301.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8284ab7d2ec7416ba94d608d19d09efb.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8284ab7d2ec7416ba94d608d19d09efb.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff60c1066efdc4d59bc3c2785dd55adb6.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f60c1066efdc4d59bc3c2785dd55adb6.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F011c280d288f4052ac107d9701c6c0fe.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/011c280d288f4052ac107d9701c6c0fe.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F06899448eeb84401ac7f5642e7087adb.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/06899448eeb84401ac7f5642e7087adb.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6aaf75d4d594dc7a509092ea48d96f6.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6aaf75d4d594dc7a509092ea48d96f6.jpg already downloaded
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4cd10085575a45ce808da4cd94730383.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4cd10085575a45ce808da4cd94730383.jpg already downloaded
2026-03-31 21:29:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4a3effda-9ce9-522c-86de-bc63cc2b5d04 with identifier 202603070491173
2026-03-31 21:29:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4a3effda-9ce9-522c-86de-bc63cc2b5d04
2026-03-31 21:29:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'Silver',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Kia '
'Sportage 2014 1.6 petrol 5dr SUV- Car came to us as Main '
"dealer part exchange so it's very well looked after- Full "
'Service History with 11x stamps- Fresh service- Fresh MOT- 3 '
'months warranty- Kia is Hpi clear ( report will be provided)- '
"It's in lovely condition inside and outside- Service history "
'show services in: 2015, 2016, 2017, 2018, 2019, 2020, 2021, '
'2022, 2023, 2025, 2026- Safety/health check inspection has '
'been done including re-gass AC- Car will be supplied with '
'fresh service, Fresh MOT and 3 months warranty- Good spec car '
'with alloy wheels, power steering, panoramic opening roof, '
'half leather seats, front and rear electric windows, electric '
'mirrors, upgraded radio, Sat-nav, rear parking sensors, Dual '
'climate control, leather steering wheel, cruise control, aux '
'input, USB input, Bluetooth, 12v socket, central locking, 2x '
'keys and much more.\n'
'\n'
'Please check our website for more cars www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 135,
'fuel_type': 'Petrol',
'id': '4a3effda-9ce9-522c-86de-bc63cc2b5d04',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603070491173',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Kia',
'model': 'Sportage',
'odometer': 77904,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 62,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ece74c2d09dc47849d218f100418a730.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/872ffb71671c4a75aa59ea003ee8ce9d.jpg',
'https://m.atcdn.co.uk/a/media/226008c42af54679b3b1017920b86301.jpg',
'https://m.atcdn.co.uk/a/media/8284ab7d2ec7416ba94d608d19d09efb.jpg',
'https://m.atcdn.co.uk/a/media/f60c1066efdc4d59bc3c2785dd55adb6.jpg',
'https://m.atcdn.co.uk/a/media/011c280d288f4052ac107d9701c6c0fe.jpg',
'https://m.atcdn.co.uk/a/media/06899448eeb84401ac7f5642e7087adb.jpg',
'https://m.atcdn.co.uk/a/media/c6aaf75d4d594dc7a509092ea48d96f6.jpg',
'https://m.atcdn.co.uk/a/media/4cd10085575a45ce808da4cd94730383.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 894045,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ece74c2d09dc47849d218f100418a730.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 949102,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/872ffb71671c4a75aa59ea003ee8ce9d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885339,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/226008c42af54679b3b1017920b86301.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 839655,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8284ab7d2ec7416ba94d608d19d09efb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 878765,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f60c1066efdc4d59bc3c2785dd55adb6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866526,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/011c280d288f4052ac107d9701c6c0fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859818,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/06899448eeb84401ac7f5642e7087adb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694666,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6aaf75d4d594dc7a509092ea48d96f6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584246,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4cd10085575a45ce808da4cd94730383.jpg',
'Width': 2048}],
'price': 5890,
'price_includes_vat': True,
'registration_date': '2014-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Sportage 1.6 GDi EcoDynamics 2 2WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': '2',
'year': 2014}
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070491173%27 HTTP/1.1" 200 None
2026-03-31 21:29:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603070491173: {'created_time': 1774992581.98133, 'last_price_update_time': 1774992581.981338}
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603070491173') HTTP/1.1" 204 0
2026-03-31 21:29:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4134ba-d782-5e87-bac2-e85e7bcd6c25 with identifier: 202602280297116
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb4134ba-d782-5e87-bac2-e85e7bcd6c25
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f4943063bd84f1897f821d4d7c25154.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f4943063bd84f1897f821d4d7c25154.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02dba826f1634e5dbdef7270ee440894.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02dba826f1634e5dbdef7270ee440894.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b8dab00c7004724b021ed8163d69420.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b8dab00c7004724b021ed8163d69420.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feca3a76732bd45a6a2a486ec0d36e1cc.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eca3a76732bd45a6a2a486ec0d36e1cc.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ba895a7546b4190a24764b3be8e23c3.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ba895a7546b4190a24764b3be8e23c3.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7ad56d11cb6b4192993837a2780cfa3c.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7ad56d11cb6b4192993837a2780cfa3c.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53e9d36650eb48a091a55ff083f1d2ef.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53e9d36650eb48a091a55ff083f1d2ef.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ec12326ddbe4ff4bd485c93568fb34b.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ec12326ddbe4ff4bd485c93568fb34b.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c43ac7ed6a0457680c6aba629b1cb25.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c43ac7ed6a0457680c6aba629b1cb25.jpg already downloaded
2026-03-31 21:29:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: eb4134ba-d782-5e87-bac2-e85e7bcd6c25 with identifier 202602280297116
2026-03-31 21:29:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item eb4134ba-d782-5e87-bac2-e85e7bcd6c25
2026-03-31 21:29:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': 'Orange',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car- DS4 Crossback 2015 '
'1.6 diesel 5dr- Only £20 road tax- Service history with 9x '
'stamps- Fresh service- Fresh mot- 3 months warranty- DS4 is '
"Hpi clear ( report will be provided)- It's in lovely "
'condition inside and outside- Service history show services '
'in 2016, 2017, 2020, 2021, 2022, 2024, 2024, 2025, 2026. '
'Safety/health check inspection has been done including fresh '
'oil service and brand new clutch kit- Car will be supplied '
'with fresh service, Fresh MOT and 3 months warranty- Very '
'good spec car with plenty of toys such as front and rear fog '
'lights, alloy wheels, power steering, half-leather seats, '
'reverse camera, electric windows, electric mirrors, Sat-nav, '
'rear parking sensors, Dual climate control, leather steering '
'wheel, cruise control, keyless entry/start and stop, aux '
'input, USB input, Bluetooth, 12v socket, central locking, 2x '
'keys and much more.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 118,
'fuel_type': 'Diesel',
'id': 'eb4134ba-d782-5e87-bac2-e85e7bcd6c25',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602280297116',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'DS AUTOMOBILES',
'model': 'DS 4 CROSSBACK',
'odometer': 99254,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8f4943063bd84f1897f821d4d7c25154.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/02dba826f1634e5dbdef7270ee440894.jpg',
'https://m.atcdn.co.uk/a/media/2b8dab00c7004724b021ed8163d69420.jpg',
'https://m.atcdn.co.uk/a/media/eca3a76732bd45a6a2a486ec0d36e1cc.jpg',
'https://m.atcdn.co.uk/a/media/5ba895a7546b4190a24764b3be8e23c3.jpg',
'https://m.atcdn.co.uk/a/media/7ad56d11cb6b4192993837a2780cfa3c.jpg',
'https://m.atcdn.co.uk/a/media/53e9d36650eb48a091a55ff083f1d2ef.jpg',
'https://m.atcdn.co.uk/a/media/0ec12326ddbe4ff4bd485c93568fb34b.jpg',
'https://m.atcdn.co.uk/a/media/5c43ac7ed6a0457680c6aba629b1cb25.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 994465,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f4943063bd84f1897f821d4d7c25154.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 987154,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/02dba826f1634e5dbdef7270ee440894.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 953215,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b8dab00c7004724b021ed8163d69420.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 947781,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eca3a76732bd45a6a2a486ec0d36e1cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 999543,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5ba895a7546b4190a24764b3be8e23c3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 984497,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7ad56d11cb6b4192993837a2780cfa3c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 941511,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53e9d36650eb48a091a55ff083f1d2ef.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 870111,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0ec12326ddbe4ff4bd485c93568fb34b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 730891,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c43ac7ed6a0457680c6aba629b1cb25.jpg',
'Width': 2048}],
'price': 3995,
'price_includes_vat': True,
'registration_date': '2015-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS 4 CROSSBACK 1.6 BlueHDi Crossback Euro 6 (s/s) '
'5dr',
'transmission': 'manual',
'year': 2015}
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602280297116%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602280297116: {'created_time': 1774992582.314832, 'last_price_update_time': 1774992582.314839}
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602280297116') HTTP/1.1" 204 0
2026-03-31 21:29:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-31 21:29:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ff125f-a2fe-5d7b-9c61-368eb3c32c5d with identifier: 202602039642482
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46ff125f-a2fe-5d7b-9c61-368eb3c32c5d
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9415927679b14584a760e835c45a3235.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9415927679b14584a760e835c45a3235.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2a29ca08565491bb933d103cd507c84.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2a29ca08565491bb933d103cd507c84.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79abe595a44a4027b456a4f3938e836c.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79abe595a44a4027b456a4f3938e836c.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F734355d808084089b72e44def07270de.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/734355d808084089b72e44def07270de.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fafc2bd16f8754abe9a4f1f0e65520988.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/afc2bd16f8754abe9a4f1f0e65520988.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8d99ee8d33b5486b9d12ace2a56ef2c0.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8d99ee8d33b5486b9d12ace2a56ef2c0.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb23fb517987c4a0e8252e05ab38e26e8.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b23fb517987c4a0e8252e05ab38e26e8.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13c94348611042b0b9c9dad25f23c063.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13c94348611042b0b9c9dad25f23c063.jpg already downloaded
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6683ccaa403a4894b8c2dfd2aa5b0448.jpg%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6683ccaa403a4894b8c2dfd2aa5b0448.jpg already downloaded
2026-03-31 21:29:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 46ff125f-a2fe-5d7b-9c61-368eb3c32c5d with identifier 202602039642482
2026-03-31 21:29:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:29:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 46ff125f-a2fe-5d7b-9c61-368eb3c32c5d
2026-03-31 21:29:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 256,
'color': 'Grey',
'currency': 'GBP',
'description': '*Part-exchange to clear* No warranty/guarantee* Sold on trade '
'to trade basis as is right now or spares or repair to whole '
'public* Beautiful Audi S5 2009 4.2 V8 automatic petrol coupe '
'3dr- I bought this car for my self as Main Dealer part '
'exchange from Holdcroft in Stoke-on-Trent by end of August '
'2025 with 83500 on the clock and only reason of selling it '
'is because I just bought RS6 Avant so S5 must go- I think '
"it's the best Audi S5 for sale at the moment on the market- "
'Massive bonus is new timing chain kit with starter motor '
'fitted to the car 04/2025 at 82500 miles on the clock- '
'12/02/2025 replace all axle oils ( front diff, rear diff, '
'trans box) and also Walnut blasting was done with 8x new '
'injector seals and Ac re-gassed- 09/12/2024 service including '
'all filters and 8x spark plugs- Car starts and drive '
'beautifully- No knocks from suspension, brakes are good, '
'tyres are good 4x matching Yokohama ones- Very clean inside '
'and outside- All 4x alloy wheels has been refurbished as '
'well- Long mot until 25/06/2026 with no advisories- Great '
'service history with 10x stamps- Audi is Hpi clear ( report '
'will be provided). Great spec car with reverse camera, full '
'leather-electric- heated seats with memory options, active '
'cruise control, Bang & Olufsen sound system, Blind spots and '
'much more - Comes with full V5c, locking wheel nut, '
'handbooks, lots of invoices, paperwork and 2x keys- Also '
'straight after I bought it we fit sport Milltek exhaust '
'system which sounds great, original Audi one which is quitter '
'is included with the car so new owner have 2x options. \n'
'Because of the age, mileage and of course nature of '
"performance cars it's no something what we want to retail. Of "
'course we open to any kind of inspections. Thank you\n'
'\n'
'Video of interior and exhaust sound: '
'https://youtu.be/en-1mhDFibM\n'
'\n'
'More cars available on our website: www.automad.co.uk',
'doors_number': 2,
'emission_standard': 'Euro 4',
'engine': '4.2L',
'engine_horse_power': 349,
'fuel_type': 'Petrol',
'id': '46ff125f-a2fe-5d7b-9c61-368eb3c32c5d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602039642482',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Audi',
'model': 'S5',
'odometer': 85175,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9415927679b14584a760e835c45a3235.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/f2a29ca08565491bb933d103cd507c84.jpg',
'https://m.atcdn.co.uk/a/media/79abe595a44a4027b456a4f3938e836c.jpg',
'https://m.atcdn.co.uk/a/media/734355d808084089b72e44def07270de.jpg',
'https://m.atcdn.co.uk/a/media/afc2bd16f8754abe9a4f1f0e65520988.jpg',
'https://m.atcdn.co.uk/a/media/8d99ee8d33b5486b9d12ace2a56ef2c0.jpg',
'https://m.atcdn.co.uk/a/media/b23fb517987c4a0e8252e05ab38e26e8.jpg',
'https://m.atcdn.co.uk/a/media/13c94348611042b0b9c9dad25f23c063.jpg',
'https://m.atcdn.co.uk/a/media/6683ccaa403a4894b8c2dfd2aa5b0448.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 817038,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9415927679b14584a760e835c45a3235.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 916907,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2a29ca08565491bb933d103cd507c84.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 890028,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79abe595a44a4027b456a4f3938e836c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 891909,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/734355d808084089b72e44def07270de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 910224,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/afc2bd16f8754abe9a4f1f0e65520988.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777649,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8d99ee8d33b5486b9d12ace2a56ef2c0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783028,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b23fb517987c4a0e8252e05ab38e26e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738424,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13c94348611042b0b9c9dad25f23c063.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548765,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6683ccaa403a4894b8c2dfd2aa5b0448.jpg',
'Width': 2048}],
'price': 7950,
'price_includes_vat': True,
'registration_date': '2009-03-01',
'seats_number': 4,
'seller_name': None,
'title': 'Audi S5 4.2 V8 Tiptronic quattro Euro 4 2dr',
'transmission': 'automatic',
'year': 2009}
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039642482%27 HTTP/1.1" 200 None
2026-03-31 21:29:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602039642482: {'created_time': 1774992582.537765, 'last_price_update_time': 1774992582.537775}
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039642482') HTTP/1.1" 204 0
2026-03-31 21:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7eff90a7546546c2b4aaeabcad9bdb39.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-31 21:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/53bb852928d5488dbfd803b94b897069.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-31 21:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c43496c224f345cdae26821587aef7ec.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-31 21:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a899ca687020442388bfb8b007042f60.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-31 21:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bc95bc2ecdec40b587c39ab390466933.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-31 21:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e984291fc9274376bc1ccdf76a1786d9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-31 21:29:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-31 21:29:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-31 21:29:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-31 21:29:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f03bf38d8d0>
2026-03-31 21:29:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-31 21:29:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-31 21:29:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_0.jpg HTTP/1.1" 201 0
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7eff90a7546546c2b4aaeabcad9bdb39.jpg') HTTP/1.1" 204 0
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7eff90a7546546c2b4aaeabcad9bdb39.jpg saved to cache
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f03bd758e90>
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_4.jpg HTTP/1.1" 201 0
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53bb852928d5488dbfd803b94b897069.jpg') HTTP/1.1" 204 0
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53bb852928d5488dbfd803b94b897069.jpg saved to cache
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f03bf3a1090>
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_5.jpg HTTP/1.1" 201 0
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc43496c224f345cdae26821587aef7ec.jpg') HTTP/1.1" 204 0
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c43496c224f345cdae26821587aef7ec.jpg saved to cache
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:29:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/220c2cffcbfe43eebaeba857d2328fdd.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f03c0b2be90>
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_3.jpg HTTP/1.1" 201 0
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa899ca687020442388bfb8b007042f60.jpg') HTTP/1.1" 204 0
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a899ca687020442388bfb8b007042f60.jpg saved to cache
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f03bf36bc90>
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_6.jpg HTTP/1.1" 201 0
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc95bc2ecdec40b587c39ab390466933.jpg') HTTP/1.1" 204 0
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc95bc2ecdec40b587c39ab390466933.jpg saved to cache
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f03c0b97f10>
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_7.jpg HTTP/1.1" 201 0
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe984291fc9274376bc1ccdf76a1786d9.jpg') HTTP/1.1" 204 0
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e984291fc9274376bc1ccdf76a1786d9.jpg saved to cache
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f03bc5a3e90>
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_9.jpg HTTP/1.1" 201 0
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F220c2cffcbfe43eebaeba857d2328fdd.jpg') HTTP/1.1" 204 0
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/220c2cffcbfe43eebaeba857d2328fdd.jpg saved to cache
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:29:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4d503ea834bf40989e1731619203058c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f03bc58e5d0>
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-31 21:29:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_8.jpg HTTP/1.1" 201 0
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:29:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4d503ea834bf40989e1731619203058c.jpg') HTTP/1.1" 204 0
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4d503ea834bf40989e1731619203058c.jpg saved to cache
2026-03-31 21:29:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:30:21 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 12 items (at 12 items/min)
2026-03-31 21:30:21 [scrapy.extensions.memusage] INFO: Peak memory usage is 174MiB
2026-03-31 21:31:21 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 0 pages/min), scraped 12 items (at 0 items/min)
2026-03-31 21:31:21 [scrapy.extensions.memusage] INFO: Peak memory usage is 174MiB
2026-03-31 21:32:21 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 0 pages/min), scraped 12 items (at 0 items/min)
2026-03-31 21:32:21 [scrapy.extensions.memusage] INFO: Peak memory usage is 174MiB
2026-03-31 21:32:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: effa3d9a-9c26-5ede-be4a-4bc45df280a6 with identifier 202603311172921
2026-03-31 21:32:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:32:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:32:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item effa3d9a-9c26-5ede-be4a-4bc45df280a6
2026-03-31 21:32:40 [scrapy.core.scraper] DEBUG: Scraped from User timeout caused connection failure: Getting https://m.atcdn.co.uk/a/media/48166f2f59444d58a10ca1b96e573f52.jpg took longer than 180.0 seconds..
{'auction_title': '',
'c_o_2_emission_value': 169,
'color': 'Yellow',
'currency': 'GBP',
'description': '*Just arrived* Main Dealer part exchange- 1 owner from new '
'with Full Service History!!- Very Good Spec- More photos and '
'details available soon. Thank you\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2.3L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'id': 'effa3d9a-9c26-5ede-be4a-4bc45df280a6',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603311172921',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Nissan',
'model': 'Navara',
'odometer': 56897,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 3,
'photo_urls': ['https://m.atcdn.co.uk/a/media/48166f2f59444d58a10ca1b96e573f52.jpg',
'https://m.atcdn.co.uk/a/media/0dc9847c307d493b91b64ddf31387591.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8556b07e-ce73-5f17-af01-423aef5d2682/8556b07e-ce73-5f17-af01-423aef5d2682_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45505,
'Height': 734,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dc9847c307d493b91b64ddf31387591.jpg',
'Width': 978},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048}],
'price': 13995,
'price_includes_vat': True,
'registration_date': '2016-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Navara 2.3 dCi N-Connecta 4WD Euro 5 4dr',
'transmission': 'manual',
'trim': 'N-Connecta',
'year': 2016}
2026-03-31 21:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603311172921%27 HTTP/1.1" 200 None
2026-03-31 21:32:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603311172921: {'created_time': 1774992760.312993, 'last_price_update_time': 1774992760.313002}
2026-03-31 21:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603311172921') HTTP/1.1" 204 0
2026-03-31 21:32:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item effa3d9a-9c26-5ede-be4a-4bc45df280a6 due to User timeout caused connection failure: Getting https://m.atcdn.co.uk/a/media/48166f2f59444d58a10ca1b96e573f52.jpg took longer than 180.0 seconds..
2026-03-31 21:32:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0a740f51-f85f-51f3-b593-a321746adb7f with identifier 202603281097166
2026-03-31 21:32:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:32:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:32:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-31 21:32:40 [scrapy.core.scraper] DEBUG: Scraped from User timeout caused connection failure: Getting https://m.atcdn.co.uk/a/media/a2db1ce53732428fbe22605a57b2d7cb.jpg took longer than 180.0 seconds..
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'Grey',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- '
'Dacia Duster 2017 1.5 diesel 5dr SUV 4WD- Car came to us as '
"Main dealer part exchange so it's very well looked after- "
'Only 2 owners from new and same owner since 2018!- Good '
'Service history with 6x stamps- Fresh service- Long MOT until '
'08/03/2027- 3 months warranty- Duster is Hpi clear ( report '
"will be provided)- It's in lovely condition inside and "
'outside- Safety/health check inspection has been done '
'including fresh service- Car will be supplied with fresh '
'service, long MOT and 3 months warranty- Good spec car with '
'alloy wheels, power steering, front and rear electric '
'windows, electric mirrors, AC, leather steering wheel, cruise '
'control, aux input, USB input, Bluetooth, 12v socket, central '
'locking, tow bard, 2x keys and much more.\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': '0a740f51-f85f-51f3-b593-a321746adb7f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603281097166',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Dacia',
'model': 'Duster',
'odometer': 80000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photo_urls': ['https://m.atcdn.co.uk/a/media/7eff90a7546546c2b4aaeabcad9bdb39.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/a2db1ce53732428fbe22605a57b2d7cb.jpg',
'https://m.atcdn.co.uk/a/media/a899ca687020442388bfb8b007042f60.jpg',
'https://m.atcdn.co.uk/a/media/53bb852928d5488dbfd803b94b897069.jpg',
'https://m.atcdn.co.uk/a/media/c43496c224f345cdae26821587aef7ec.jpg',
'https://m.atcdn.co.uk/a/media/bc95bc2ecdec40b587c39ab390466933.jpg',
'https://m.atcdn.co.uk/a/media/e984291fc9274376bc1ccdf76a1786d9.jpg',
'https://m.atcdn.co.uk/a/media/4d503ea834bf40989e1731619203058c.jpg',
'https://m.atcdn.co.uk/a/media/220c2cffcbfe43eebaeba857d2328fdd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 822682,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7eff90a7546546c2b4aaeabcad9bdb39.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 894845,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a899ca687020442388bfb8b007042f60.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 722246,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53bb852928d5488dbfd803b94b897069.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738558,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c43496c224f345cdae26821587aef7ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 786651,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc95bc2ecdec40b587c39ab390466933.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738870,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e984291fc9274376bc1ccdf76a1786d9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692988,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4d503ea834bf40989e1731619203058c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599576,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/220c2cffcbfe43eebaeba857d2328fdd.jpg',
'Width': 2048}],
'price': 5995,
'price_includes_vat': True,
'registration_date': '2017-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Laureate 4WD Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2017}
2026-03-31 21:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281097166%27 HTTP/1.1" 200 None
2026-03-31 21:32:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603281097166: {'created_time': 1774992760.377045, 'last_price_update_time': 1774992760.377056}
2026-03-31 21:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603281097166') HTTP/1.1" 204 0
2026-03-31 21:32:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 0a740f51-f85f-51f3-b593-a321746adb7f due to User timeout caused connection failure: Getting https://m.atcdn.co.uk/a/media/a2db1ce53732428fbe22605a57b2d7cb.jpg took longer than 180.0 seconds..
2026-03-31 21:32:40 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-31 21:32:40 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-31 21:32:40 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-31 21:32:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:32:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-31 21:32:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 7a69064a2ce811f19724def17024dec4
2026-03-31 21:32:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-31 21:32:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-31 21:32:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:32:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-31 21:32:40 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-31 21:32:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-31 21:32:41 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-31 21:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-31 21:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773696761 HTTP/1.1" 200 None
2026-03-31 21:32:42 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (14 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/7a69064a2ce811f19724def17024dec4.jl
2026-03-31 21:32:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 2,
'downloader/exception_type_count/twisted.internet.error.TimeoutError': 2,
'downloader/request_bytes': 111171,
'downloader/request_count': 13,
'downloader/request_method_count/GET': 10,
'downloader/request_method_count/POST': 3,
'downloader/response_bytes': 6630689,
'downloader/response_count': 11,
'downloader/response_status_count/200': 11,
'elapsed_time_seconds': 200.629432,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 31, 21, 32, 42, 111554, tzinfo=datetime.timezone.utc),
'item_scraped_count': 14,
'log_count/DEBUG': 481,
'log_count/INFO': 335,
'memusage/max': 182525952,
'memusage/startup': 149397504,
'photo_download_count': 8,
'request_depth_max': 2,
'response_received_count': 3,
'scheduler/dequeued': 13,
'scheduler/dequeued/memory': 13,
'scheduler/enqueued': 13,
'scheduler/enqueued/memory': 13,
'scrape_type/new': 14,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 3,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 4.64153333986178,
'scrapy-zyte-api/mean_response_seconds': 4.787119172358265,
'scrapy-zyte-api/processed': 3,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
'scrapy-zyte-api/request_args/experimental.requestCookies': 2,
'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
'scrapy-zyte-api/request_args/httpRequestBody': 3,
'scrapy-zyte-api/request_args/httpRequestMethod': 3,
'scrapy-zyte-api/request_args/httpResponseBody': 3,
'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
'scrapy-zyte-api/request_args/url': 3,
'scrapy-zyte-api/status_codes/200': 3,
'scrapy-zyte-api/success': 3,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 31, 21, 29, 21, 482122, tzinfo=datetime.timezone.utc)}
2026-03-31 21:32:42 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-31 21:32:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f03c0b97210>
2026-03-31 21:32:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f03c0b97a50>