PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2026-03-30 15:08:12 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:08:12 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: _job: 4a7299842c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:08:12 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:08:12 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:08:12 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:08:12 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:08:12 [scrapy.extensions.telnet] INFO: Telnet Password: 06366364e91089e6
2026-03-30 15:08:12 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:08:12 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4a7299842c1f11f18e133aacc95538c6.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 15:08:12 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:08:12 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:08:12 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:08:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:08:12 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:08:12 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:08:12 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:08:12 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:08:12 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:08:12 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:08:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:08:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 15:08:12 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 15:08:12 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:08:12 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10037625 and multipost_profile_id: 824c1cb4-7e27-49df-94a5-2b9ecad212a5 and job_id: 4a7299842c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10037625&sort=price-asc
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10037625, page: 1
2026-03-30 15:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 16
2026-03-30 15:08:19 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 15:08:19 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281097166%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603281097166: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240967127%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240967127: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921306%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230921306: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921002%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230921002: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200863387%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200863387: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130676939%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130676939: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110609050%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110609050: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070491173%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603070491173: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030363262%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030363262: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602280297116%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602280297116: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079752283%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602079752283: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039642482%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602039642482: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149139971%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149139971: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149136822%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149136822: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512198711597%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512198711597: 1
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507214686771%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202507214686771: 1
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 6 detail requests (batch 2)
2026-03-30 15:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cced1199-a871-52d1-8cc4-caa6d7b981ac with identifier: 202602079752283
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cced1199-a871-52d1-8cc4-caa6d7b981ac
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3adea83e8ab740cfb1dbbbccb842ce2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3adea83e8ab740cfb1dbbbccb842ce2a.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4e4786bfcdd4d3aaa6df0936ed25347.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4e4786bfcdd4d3aaa6df0936ed25347.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b11fe48c66d4017bcc4fd5f6fe8c4bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b11fe48c66d4017bcc4fd5f6fe8c4bb.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f7dd9fef8104389ad3d461c5328175a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f7dd9fef8104389ad3d461c5328175a.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe627d4cb08ab4e5384f7c448fea9c0af.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e627d4cb08ab4e5384f7c448fea9c0af.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Febddb431c60d4aa882ebc76527b51fca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ebddb431c60d4aa882ebc76527b51fca.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F10332444f2604abf9054f7c350ebeab9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/10332444f2604abf9054f7c350ebeab9.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec83a8288cf74cce9f5b369d2b4407db.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec83a8288cf74cce9f5b369d2b4407db.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F143051691e62484a9c01aa72d77ee8a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/143051691e62484a9c01aa72d77ee8a1.jpg already downloaded
2026-03-30 15:08:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cced1199-a871-52d1-8cc4-caa6d7b981ac with identifier 202602079752283
2026-03-30 15:08:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:08:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:08:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:08:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:08:21 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:08:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:21 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:21 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:08:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:08:21 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:08:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:21 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:22 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2017
2026-03-30 15:08:22 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883302
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883302
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:22 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cced1199-a871-52d1-8cc4-caa6d7b981ac
2026-03-30 15:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 233,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean Pickup Truck with low mileage- Mitsubishi L200 '
'2014 2.5 diesel 4WD Automatic LWB- Vehicle came to us as Main '
"dealer part exchange so it's very well looked after- Only 2 "
'owners from new and same owner since 2021! Last owned by '
'printing company so the truck was used for light duties only- '
'Good Service history with 8x stamps- Fresh service- Long MOT '
'until 01/09/2026- 3 months warranty- L200 is Hpi clear ( '
"report will be provided)- It's in lovely condition inside and "
'outside- Safety/health check inspection has been done with '
'brand new battery- Recently, two new front tyres, front brake '
'discs, and pads have been changed- Vehicle will be supplied '
'with fresh service, Long MOT and 3 months warranty- Good '
'spec: front and rear fog lights, alloy wheels, power '
'steering, full leather-heated seats, upgraded radio, front '
'and rear electric windows, electric mirrors, Sat-nav, AC, '
'leather steering wheel, cruise control, aux input, USB input, '
'Bluetooth, 12v socket, central locking, very clean bed with '
'upgraded liner, chrome bars, side steps 2x keys and much '
'more.\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2.5L',
'engine_horse_power': 176,
'fuel_type': 'Diesel',
'id': 'cced1199-a871-52d1-8cc4-caa6d7b981ac',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602079752283',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Mitsubishi',
'model': 'L200',
'odometer': 100000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 61,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3adea83e8ab740cfb1dbbbccb842ce2a.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/f4e4786bfcdd4d3aaa6df0936ed25347.jpg',
'https://m.atcdn.co.uk/a/media/3b11fe48c66d4017bcc4fd5f6fe8c4bb.jpg',
'https://m.atcdn.co.uk/a/media/0f7dd9fef8104389ad3d461c5328175a.jpg',
'https://m.atcdn.co.uk/a/media/e627d4cb08ab4e5384f7c448fea9c0af.jpg',
'https://m.atcdn.co.uk/a/media/ebddb431c60d4aa882ebc76527b51fca.jpg',
'https://m.atcdn.co.uk/a/media/10332444f2604abf9054f7c350ebeab9.jpg',
'https://m.atcdn.co.uk/a/media/ec83a8288cf74cce9f5b369d2b4407db.jpg',
'https://m.atcdn.co.uk/a/media/143051691e62484a9c01aa72d77ee8a1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 930602,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3adea83e8ab740cfb1dbbbccb842ce2a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 939360,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4e4786bfcdd4d3aaa6df0936ed25347.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 904403,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b11fe48c66d4017bcc4fd5f6fe8c4bb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 730903,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f7dd9fef8104389ad3d461c5328175a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 864308,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e627d4cb08ab4e5384f7c448fea9c0af.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782882,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ebddb431c60d4aa882ebc76527b51fca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 744018,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/10332444f2604abf9054f7c350ebeab9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 869296,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec83a8288cf74cce9f5b369d2b4407db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cced1199-a871-52d1-8cc4-caa6d7b981ac/cced1199-a871-52d1-8cc4-caa6d7b981ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646885,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/143051691e62484a9c01aa72d77ee8a1.jpg',
'Width': 2048}],
'price': 8994,
'price_includes_vat': True,
'registration_date': '2014-08-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi L200 2.5 DI-D Barbarian Auto 4WD Euro 5 4dr (LB)',
'transmission': 'automatic',
'trim': 'Barbarian',
'year': 2014}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079752283%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602079752283: {'created_time': 1774883302.532482, 'last_price_update_time': 1774883302.532497}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079752283') HTTP/1.1" 204 0
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ff125f-a2fe-5d7b-9c61-368eb3c32c5d with identifier: 202602039642482
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46ff125f-a2fe-5d7b-9c61-368eb3c32c5d
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9415927679b14584a760e835c45a3235.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9415927679b14584a760e835c45a3235.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2a29ca08565491bb933d103cd507c84.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2a29ca08565491bb933d103cd507c84.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79abe595a44a4027b456a4f3938e836c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79abe595a44a4027b456a4f3938e836c.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F734355d808084089b72e44def07270de.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/734355d808084089b72e44def07270de.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fafc2bd16f8754abe9a4f1f0e65520988.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/afc2bd16f8754abe9a4f1f0e65520988.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8d99ee8d33b5486b9d12ace2a56ef2c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8d99ee8d33b5486b9d12ace2a56ef2c0.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb23fb517987c4a0e8252e05ab38e26e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b23fb517987c4a0e8252e05ab38e26e8.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13c94348611042b0b9c9dad25f23c063.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13c94348611042b0b9c9dad25f23c063.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6683ccaa403a4894b8c2dfd2aa5b0448.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6683ccaa403a4894b8c2dfd2aa5b0448.jpg already downloaded
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 46ff125f-a2fe-5d7b-9c61-368eb3c32c5d with identifier 202602039642482
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 46ff125f-a2fe-5d7b-9c61-368eb3c32c5d
2026-03-30 15:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 256,
'color': 'Grey',
'currency': 'GBP',
'description': '*Part-exchange to clear* No warranty/guarantee* Sold on trade '
'to trade basis as is right now or spares or repair to whole '
'public* Beautiful Audi S5 2009 4.2 V8 automatic petrol coupe '
'3dr- I bought this car for my self as Main Dealer part '
'exchange from Holdcroft in Stoke-on-Trent by end of August '
'2025 with 83500 on the clock and only reason of selling it '
'is because I just bought RS6 Avant so S5 must go- I think '
"it's the best Audi S5 for sale at the moment on the market- "
'Massive bonus is new timing chain kit with starter motor '
'fitted to the car 04/2025 at 82500 miles on the clock- '
'12/02/2025 replace all axle oils ( front diff, rear diff, '
'trans box) and also Walnut blasting was done with 8x new '
'injector seals and Ac re-gassed- 09/12/2024 service including '
'all filters and 8x spark plugs- Car starts and drive '
'beautifully- No knocks from suspension, brakes are good, '
'tyres are good 4x matching Yokohama ones- Very clean inside '
'and outside- All 4x alloy wheels has been refurbished as '
'well- Long mot until 25/06/2026 with no advisories- Great '
'service history with 10x stamps- Audi is Hpi clear ( report '
'will be provided). Great spec car with reverse camera, full '
'leather-electric- heated seats with memory options, active '
'cruise control, Bang & Olufsen sound system, Blind spots and '
'much more - Comes with full V5c, locking wheel nut, '
'handbooks, lots of invoices, paperwork and 2x keys- Also '
'straight after I bought it we fit sport Milltek exhaust '
'system which sounds great, original Audi one which is quitter '
'is included with the car so new owner have 2x options. \n'
'Because of the age, mileage and of course nature of '
"performance cars it's no something what we want to retail. Of "
'course we open to any kind of inspections. Thank you\n'
'\n'
'Video of interior and exhaust sound: '
'https://youtu.be/en-1mhDFibM\n'
'\n'
'More cars available on our website: www.automad.co.uk',
'doors_number': 2,
'emission_standard': 'Euro 4',
'engine': '4.2L',
'engine_horse_power': 349,
'fuel_type': 'Petrol',
'id': '46ff125f-a2fe-5d7b-9c61-368eb3c32c5d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602039642482',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Audi',
'model': 'S5',
'odometer': 85175,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9415927679b14584a760e835c45a3235.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/f2a29ca08565491bb933d103cd507c84.jpg',
'https://m.atcdn.co.uk/a/media/79abe595a44a4027b456a4f3938e836c.jpg',
'https://m.atcdn.co.uk/a/media/734355d808084089b72e44def07270de.jpg',
'https://m.atcdn.co.uk/a/media/afc2bd16f8754abe9a4f1f0e65520988.jpg',
'https://m.atcdn.co.uk/a/media/8d99ee8d33b5486b9d12ace2a56ef2c0.jpg',
'https://m.atcdn.co.uk/a/media/b23fb517987c4a0e8252e05ab38e26e8.jpg',
'https://m.atcdn.co.uk/a/media/13c94348611042b0b9c9dad25f23c063.jpg',
'https://m.atcdn.co.uk/a/media/6683ccaa403a4894b8c2dfd2aa5b0448.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 817038,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9415927679b14584a760e835c45a3235.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 916907,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2a29ca08565491bb933d103cd507c84.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 890028,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79abe595a44a4027b456a4f3938e836c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 891909,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/734355d808084089b72e44def07270de.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 910224,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/afc2bd16f8754abe9a4f1f0e65520988.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777649,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8d99ee8d33b5486b9d12ace2a56ef2c0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783028,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b23fb517987c4a0e8252e05ab38e26e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738424,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13c94348611042b0b9c9dad25f23c063.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ff125f-a2fe-5d7b-9c61-368eb3c32c5d/46ff125f-a2fe-5d7b-9c61-368eb3c32c5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548765,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6683ccaa403a4894b8c2dfd2aa5b0448.jpg',
'Width': 2048}],
'price': 7950,
'price_includes_vat': True,
'registration_date': '2009-03-01',
'seats_number': 4,
'seller_name': None,
'title': 'Audi S5 4.2 V8 Tiptronic quattro Euro 4 2dr',
'transmission': 'automatic',
'year': 2009}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039642482%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602039642482: {'created_time': 1774883303.001979, 'last_price_update_time': 1774883303.001995}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039642482') HTTP/1.1" 204 0
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ee2553ff-4689-5fa9-b913-ac3de8522eb5 with identifier: 202601149139971
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee2553ff-4689-5fa9-b913-ac3de8522eb5
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc307016b4fda49edb223ee4a0b4d094f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c307016b4fda49edb223ee4a0b4d094f.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a070078d61f47f88664c8394b04dfe2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a070078d61f47f88664c8394b04dfe2.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73be83b8d82e435b85630698a6b391d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73be83b8d82e435b85630698a6b391d9.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b79793d67994de085e28a5f4b4c4515.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b79793d67994de085e28a5f4b4c4515.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc454566ad90e439fb723f19936af3301.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c454566ad90e439fb723f19936af3301.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4b48970937f418daac1093c2d0654d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4b48970937f418daac1093c2d0654d8.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff20787bf93654cbeb40c34d7f584cafa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f20787bf93654cbeb40c34d7f584cafa.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde213c368de446d1b9c895fdfa19e410.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de213c368de446d1b9c895fdfa19e410.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2dd8fb68de1e42f3b30ed2e76d7cfded.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2dd8fb68de1e42f3b30ed2e76d7cfded.jpg already downloaded
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ee2553ff-4689-5fa9-b913-ac3de8522eb5 with identifier 202601149139971
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ee2553ff-4689-5fa9-b913-ac3de8522eb5
2026-03-30 15:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'White',
'currency': 'GBP',
'description': '*Part-exchange to clear* No warranty/guarantee* Sold on trade '
'to trade basis as is right now or spares or repair to whole '
'public* Retail price £4500+. Vauxhall Astra Van 2010 1.3 '
"diesel- We took this vehicle in part exchange but van doesn't "
'fit our stock profile- Van starts and drive like be should, '
'no knocks from suspension, brakes are good, tyres are good- '
'Need clean inside and outside- Long mot until 12/11/2026- '
'Astra is Hpi clear ( report will be provided)- Comes with '
"locking wheel nut and 2 keys- We don't inspect our trade cars "
'through workshop but we always describe them accurate as '
'possible with know faults. Thank you\n'
'\n'
'Please check our website for more cars www.automad.co.uk',
'doors_number': 3,
'emission_standard': 'Euro 4',
'engine': '1.3L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'id': 'ee2553ff-4689-5fa9-b913-ac3de8522eb5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149139971',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Vauxhall',
'model': 'Astra Van',
'odometer': 101700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c307016b4fda49edb223ee4a0b4d094f.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/4a070078d61f47f88664c8394b04dfe2.jpg',
'https://m.atcdn.co.uk/a/media/73be83b8d82e435b85630698a6b391d9.jpg',
'https://m.atcdn.co.uk/a/media/4b79793d67994de085e28a5f4b4c4515.jpg',
'https://m.atcdn.co.uk/a/media/c454566ad90e439fb723f19936af3301.jpg',
'https://m.atcdn.co.uk/a/media/f4b48970937f418daac1093c2d0654d8.jpg',
'https://m.atcdn.co.uk/a/media/f20787bf93654cbeb40c34d7f584cafa.jpg',
'https://m.atcdn.co.uk/a/media/de213c368de446d1b9c895fdfa19e410.jpg',
'https://m.atcdn.co.uk/a/media/2dd8fb68de1e42f3b30ed2e76d7cfded.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 919804,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c307016b4fda49edb223ee4a0b4d094f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 800975,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a070078d61f47f88664c8394b04dfe2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 879705,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73be83b8d82e435b85630698a6b391d9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 771489,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b79793d67994de085e28a5f4b4c4515.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 841729,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c454566ad90e439fb723f19936af3301.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829993,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4b48970937f418daac1093c2d0654d8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 813185,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f20787bf93654cbeb40c34d7f584cafa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421467,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/de213c368de446d1b9c895fdfa19e410.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee2553ff-4689-5fa9-b913-ac3de8522eb5/ee2553ff-4689-5fa9-b913-ac3de8522eb5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646461,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2dd8fb68de1e42f3b30ed2e76d7cfded.jpg',
'Width': 2048}],
'price': 2495,
'price_includes_vat': True,
'registration_date': '2010-07-20',
'seats_number': 2,
'seller_name': None,
'title': 'Vauxhall Astra Van 1.3 CDTi 16v Club 3dr',
'transmission': 'manual',
'trim': 'Club',
'year': 2010}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149139971%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149139971: {'created_time': 1774883303.355905, 'last_price_update_time': 1774883303.355914}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149139971') HTTP/1.1" 204 0
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a740f51-f85f-51f3-b593-a321746adb7f with identifier: 202603281097166
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 3 photos for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcb5ada486f3f4794b17d2219cc2cfcd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cb5ada486f3f4794b17d2219cc2cfcd5.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dc9847c307d493b91b64ddf31387591.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dc9847c307d493b91b64ddf31387591.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 27c1bc37-95ec-541f-8506-142e24ae1591 with identifier: 202601149136822
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27c1bc37-95ec-541f-8506-142e24ae1591
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad63b2e76c64415ba1e106c8e30b31ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad63b2e76c64415ba1e106c8e30b31ec.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2613e12a37ea4a0e880b7d270c7a4799.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2613e12a37ea4a0e880b7d270c7a4799.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F202fc51804684b33a80c2eca763372e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/202fc51804684b33a80c2eca763372e3.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F840f4e38e6274158a0f47e274ec1c969.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/840f4e38e6274158a0f47e274ec1c969.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2049c836e38c4537b21eaf95f0b58535.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2049c836e38c4537b21eaf95f0b58535.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5e07f6538b241179942d6f89d88c821.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5e07f6538b241179942d6f89d88c821.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13d98003160d43feb7a978994a4a34df.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13d98003160d43feb7a978994a4a34df.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea0c3ad7bcd641dfafc9d2e32700fa20.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea0c3ad7bcd641dfafc9d2e32700fa20.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f37a225d4634776b6f4a03bc0d887e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f37a225d4634776b6f4a03bc0d887e6.jpg already downloaded
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0a740f51-f85f-51f3-b593-a321746adb7f with identifier 202603281097166
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0a740f51-f85f-51f3-b593-a321746adb7f
2026-03-30 15:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'Grey',
'currency': 'GBP',
'description': '*Just arrived* Main Dealer part exchange- 2 owners in total, '
'last owner since 2018!- Good Service History with 6x stamps- '
'More photos and details available soon. Thank you\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': '0a740f51-f85f-51f3-b593-a321746adb7f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603281097166',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Dacia',
'model': 'Duster',
'odometer': 80031,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 3,
'photo_urls': ['https://m.atcdn.co.uk/a/media/cb5ada486f3f4794b17d2219cc2cfcd5.jpg',
'https://m.atcdn.co.uk/a/media/0dc9847c307d493b91b64ddf31387591.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a740f51-f85f-51f3-b593-a321746adb7f/0a740f51-f85f-51f3-b593-a321746adb7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 470273,
'Height': 1280,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cb5ada486f3f4794b17d2219cc2cfcd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8556b07e-ce73-5f17-af01-423aef5d2682/8556b07e-ce73-5f17-af01-423aef5d2682_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45505,
'Height': 734,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dc9847c307d493b91b64ddf31387591.jpg',
'Width': 978},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048}],
'price': 5995,
'price_includes_vat': True,
'registration_date': '2017-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Laureate 4WD Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2017}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281097166%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603281097166: {'created_time': 1774883303.728818, 'last_price_update_time': 1774883303.728832}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603281097166') HTTP/1.1" 204 0
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 27c1bc37-95ec-541f-8506-142e24ae1591 with identifier 202601149136822
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 27c1bc37-95ec-541f-8506-142e24ae1591
2026-03-30 15:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Fiat '
'500x 2016 1.4T petrol 5dr- Car came to us as Main dealer part '
"exchange so it's very well looked after- Full Service "
'History- Fresh service- Long Mot until 02/12/2026- 3 months '
"warranty- Fiat is Hpi clear ( report will be provided)- It's "
'in lovely condition inside and outside- Service history show '
'services in: 2017, 2018, 2019, 2021, 2022, 2023, 2024, 2025, '
'2026- Safety/health check inspection has been done including '
'fresh service- Car will be supplied with Fresh Service, Long '
'MOT and 3 months warranty- Good spec car with plenty of toys '
'such as alloy wheels, power steering, half-leather seats, '
'front and rear electric windows, electric mirrors, Sat-nav, '
'rear parking sensors, Dual climate control, leather steering '
'wheel, cruise control, keyless start and stop, aux input, USB '
'input, Bluetooth, 12v socket, central locking, 2x keys and '
'much more.\n'
'\n'
'Please check our website for more cars www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': '27c1bc37-95ec-541f-8506-142e24ae1591',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149136822',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Fiat',
'model': '500X',
'odometer': 71255,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 53,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ad63b2e76c64415ba1e106c8e30b31ec.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/2613e12a37ea4a0e880b7d270c7a4799.jpg',
'https://m.atcdn.co.uk/a/media/202fc51804684b33a80c2eca763372e3.jpg',
'https://m.atcdn.co.uk/a/media/840f4e38e6274158a0f47e274ec1c969.jpg',
'https://m.atcdn.co.uk/a/media/2049c836e38c4537b21eaf95f0b58535.jpg',
'https://m.atcdn.co.uk/a/media/b5e07f6538b241179942d6f89d88c821.jpg',
'https://m.atcdn.co.uk/a/media/13d98003160d43feb7a978994a4a34df.jpg',
'https://m.atcdn.co.uk/a/media/ea0c3ad7bcd641dfafc9d2e32700fa20.jpg',
'https://m.atcdn.co.uk/a/media/3f37a225d4634776b6f4a03bc0d887e6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689705,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad63b2e76c64415ba1e106c8e30b31ec.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727783,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2613e12a37ea4a0e880b7d270c7a4799.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677895,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/202fc51804684b33a80c2eca763372e3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660421,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/840f4e38e6274158a0f47e274ec1c969.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662782,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2049c836e38c4537b21eaf95f0b58535.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 720110,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b5e07f6538b241179942d6f89d88c821.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727279,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13d98003160d43feb7a978994a4a34df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626481,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea0c3ad7bcd641dfafc9d2e32700fa20.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27c1bc37-95ec-541f-8506-142e24ae1591/27c1bc37-95ec-541f-8506-142e24ae1591_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635618,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f37a225d4634776b6f4a03bc0d887e6.jpg',
'Width': 2048}],
'price': 5990,
'price_includes_vat': True,
'registration_date': '2016-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.4 MultiAir Lounge Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2016}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149136822%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149136822: {'created_time': 1774883303.886817, 'last_price_update_time': 1774883303.88683}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149136822') HTTP/1.1" 204 0
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f360f79-9ad7-5335-8738-b8db7c471bf2 with identifier: 202603240967127
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f360f79-9ad7-5335-8738-b8db7c471bf2
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9a96750ead74612b35ae59f07c10400.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9a96750ead74612b35ae59f07c10400.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F937d80aa5c6842a39753d219ed7fe39f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/937d80aa5c6842a39753d219ed7fe39f.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F22992f3c86dd417ab195931bfba822bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/22992f3c86dd417ab195931bfba822bd.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F114466e121ec4a98afe34c281e299645.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/114466e121ec4a98afe34c281e299645.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F080c811280db4b3b8f19d90729ff55b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/080c811280db4b3b8f19d90729ff55b6.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F74fd09d875b24879b9111841edbea336.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/74fd09d875b24879b9111841edbea336.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a0b7e58a6d74ce48c34270cc5b4aeda.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a0b7e58a6d74ce48c34270cc5b4aeda.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdc0e641f44484dadb327f74fc5dbfe14.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dc0e641f44484dadb327f74fc5dbfe14.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1171eef645264d7389e25143504f3159.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1171eef645264d7389e25143504f3159.jpg already downloaded
2026-03-30 15:08:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7af276c0-b270-5959-84c1-e7c4795f72ae with identifier: 202512198711597
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7af276c0-b270-5959-84c1-e7c4795f72ae
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3943411dc0c74bc6a7adb40d16b052c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3943411dc0c74bc6a7adb40d16b052c9.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ae76ecaf9484df59a4ef45e86304411.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ae76ecaf9484df59a4ef45e86304411.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F33e634f0c1e04311abb298f5f6659bc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/33e634f0c1e04311abb298f5f6659bc8.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbf9898ac83ea413da35eb3438f1c1eea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bf9898ac83ea413da35eb3438f1c1eea.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F909270c6e0e34065a56a03e24232735d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/909270c6e0e34065a56a03e24232735d.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F862d4e3321ea498ebbe2adc0b5cdc121.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/862d4e3321ea498ebbe2adc0b5cdc121.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F37e56e731eb9464a91dc6448accd3d51.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/37e56e731eb9464a91dc6448accd3d51.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2d1006a870f94496b2b725cb2ba894a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2d1006a870f94496b2b725cb2ba894a8.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1effeffa74a249b3857523bf3520328d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1effeffa74a249b3857523bf3520328d.jpg already downloaded
2026-03-30 15:08:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5f360f79-9ad7-5335-8738-b8db7c471bf2 with identifier 202603240967127
2026-03-30 15:08:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:24 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5f360f79-9ad7-5335-8738-b8db7c471bf2
2026-03-30 15:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'Red',
'currency': 'GBP',
'description': '*Part-exchange to clear* No warranty/guarantee* Sold on trade '
'to trade basis as is right now or spares or repair to whole '
'public* Retail price £5300- Mercedes B-class 2014 1.5 diesel '
"5dr- We took this car in part exchange but car doesn't fit "
'our stock profile- Car starts and drive like be should- No '
'knocks from suspension, brakes are good, tyres are good- '
'Clean inside and outside- Recently new rear brake discs and '
'pads has been fitted, also 4x alloy wheels has been '
'refurbished- Last service done 10/07/2025 at 73950- Mot until '
'25/06/2026 with no advisories- Mercedes is Hpi clear ( report '
'will be provided). Good spec car with reverse camera, leather '
'seats, sat-nav and much more- Comes with full V5c, locking '
"wheel nut, 2x keys and handbooks. We don't inspect our trade "
'cars through workshop but we always describe them accurate as '
'possible with know faults. Thank you\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.5L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': '5f360f79-9ad7-5335-8738-b8db7c471bf2',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240967127',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Mercedes-Benz',
'model': 'B Class',
'odometer': 76237,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f9a96750ead74612b35ae59f07c10400.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/937d80aa5c6842a39753d219ed7fe39f.jpg',
'https://m.atcdn.co.uk/a/media/22992f3c86dd417ab195931bfba822bd.jpg',
'https://m.atcdn.co.uk/a/media/114466e121ec4a98afe34c281e299645.jpg',
'https://m.atcdn.co.uk/a/media/080c811280db4b3b8f19d90729ff55b6.jpg',
'https://m.atcdn.co.uk/a/media/74fd09d875b24879b9111841edbea336.jpg',
'https://m.atcdn.co.uk/a/media/8a0b7e58a6d74ce48c34270cc5b4aeda.jpg',
'https://m.atcdn.co.uk/a/media/dc0e641f44484dadb327f74fc5dbfe14.jpg',
'https://m.atcdn.co.uk/a/media/1171eef645264d7389e25143504f3159.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 951074,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9a96750ead74612b35ae59f07c10400.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 982496,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/937d80aa5c6842a39753d219ed7fe39f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 918911,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/22992f3c86dd417ab195931bfba822bd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 850576,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/114466e121ec4a98afe34c281e299645.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 947182,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/080c811280db4b3b8f19d90729ff55b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 937259,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/74fd09d875b24879b9111841edbea336.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 897103,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8a0b7e58a6d74ce48c34270cc5b4aeda.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 764039,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dc0e641f44484dadb327f74fc5dbfe14.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f360f79-9ad7-5335-8738-b8db7c471bf2/5f360f79-9ad7-5335-8738-b8db7c471bf2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 832266,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1171eef645264d7389e25143504f3159.jpg',
'Width': 2048}],
'price': 3995,
'price_includes_vat': True,
'registration_date': '2014-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz B Class 1.5 B180 CDI Sport Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2014}
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240967127%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240967127: {'created_time': 1774883304.543514, 'last_price_update_time': 1774883304.543528}
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240967127') HTTP/1.1" 204 0
2026-03-30 15:08:24 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7af276c0-b270-5959-84c1-e7c4795f72ae with identifier 202512198711597
2026-03-30 15:08:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:24 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:24 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7af276c0-b270-5959-84c1-e7c4795f72ae
2026-03-30 15:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Kia '
'Optima 2014 1.7 diesel 4dr- Car came to us as Main dealer '
"part exchange so it's very well looked after- Only 3 owners "
'from new and same owner since 2018!- Service history- Fresh '
'service- Long mot until 16/10/2026 without any advisories- 3 '
'months warranty- Optima is Hpi clear ( report will be '
"provided)- It's in lovely condition inside and outside- "
'Service history show services in 2015/ 2016/ 2017/ 2018/ '
'2021/ 2025- Safety/health check inspection has been done- '
'Recently new rear brake discs and pads has been fitted- Car '
'will be supplied with fresh service, Long MOT until '
'16/10/2026 and 3 months warranty- Very good spec car with '
'plenty of toys such as diamond cut alloy wheels, power '
'steering, full leather-electric-heated seats with memory '
'settings, reverse camera, front and rear electric windows, '
'electric mirrors, Sat-nav, rear and front parking sensors, '
'Dual climate control, leather steering wheel, cruise control, '
'aux input, USB input, Bluetooth, 12v socket, central locking, '
'2x keys and much more.\n'
'\n'
'Please check our website for more cars www.automad.co.uk',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '1.7L',
'engine_horse_power': 134,
'fuel_type': 'Diesel',
'id': '7af276c0-b270-5959-84c1-e7c4795f72ae',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512198711597',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Kia',
'model': 'Optima',
'odometer': 57402,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 65,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3943411dc0c74bc6a7adb40d16b052c9.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/2ae76ecaf9484df59a4ef45e86304411.jpg',
'https://m.atcdn.co.uk/a/media/33e634f0c1e04311abb298f5f6659bc8.jpg',
'https://m.atcdn.co.uk/a/media/bf9898ac83ea413da35eb3438f1c1eea.jpg',
'https://m.atcdn.co.uk/a/media/909270c6e0e34065a56a03e24232735d.jpg',
'https://m.atcdn.co.uk/a/media/862d4e3321ea498ebbe2adc0b5cdc121.jpg',
'https://m.atcdn.co.uk/a/media/37e56e731eb9464a91dc6448accd3d51.jpg',
'https://m.atcdn.co.uk/a/media/2d1006a870f94496b2b725cb2ba894a8.jpg',
'https://m.atcdn.co.uk/a/media/1effeffa74a249b3857523bf3520328d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1000101,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3943411dc0c74bc6a7adb40d16b052c9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 971465,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ae76ecaf9484df59a4ef45e86304411.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859196,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/33e634f0c1e04311abb298f5f6659bc8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 917872,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bf9898ac83ea413da35eb3438f1c1eea.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 839926,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/909270c6e0e34065a56a03e24232735d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 910193,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/862d4e3321ea498ebbe2adc0b5cdc121.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 977267,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/37e56e731eb9464a91dc6448accd3d51.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 901631,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2d1006a870f94496b2b725cb2ba894a8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af276c0-b270-5959-84c1-e7c4795f72ae/7af276c0-b270-5959-84c1-e7c4795f72ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 837608,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1effeffa74a249b3857523bf3520328d.jpg',
'Width': 2048}],
'price': 6950,
'price_includes_vat': True,
'registration_date': '2014-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Optima 1.7 CRDi EcoDynamics 2 Euro 5 (s/s) 4dr',
'transmission': 'manual',
'trim': '2',
'year': 2014}
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512198711597%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512198711597: {'created_time': 1774883304.612959, 'last_price_update_time': 1774883304.612971}
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512198711597') HTTP/1.1" 204 0
2026-03-30 15:08:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac with identifier: 202603230921306
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98c86cdffd344706b52fa298caa7e593.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98c86cdffd344706b52fa298caa7e593.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07bb19c65fbc4d80bb873ad90c6e8b6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07bb19c65fbc4d80bb873ad90c6e8b6b.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77e9ccb8271047e6aef06c0346f07528.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77e9ccb8271047e6aef06c0346f07528.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb2713b849de74c35b0ee3fde3274b5ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b2713b849de74c35b0ee3fde3274b5ef.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd99b0b3d9bf4ae1951e43e615d9e02a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd99b0b3d9bf4ae1951e43e615d9e02a.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0168abbecb814d32be25e2b66dbffd2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0168abbecb814d32be25e2b66dbffd2b.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29f46a3f39984f348df56620273d6030.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29f46a3f39984f348df56620273d6030.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F898628d8fee04fe7a862ebaa16afc579.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/898628d8fee04fe7a862ebaa16afc579.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8535cf9d2ab34e0588c8789b264b5daf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8535cf9d2ab34e0588c8789b264b5daf.jpg already downloaded
2026-03-30 15:08:24 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 26015fae-ff8c-5576-a20e-5674265ae067 with identifier: 202507214686771
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26015fae-ff8c-5576-a20e-5674265ae067
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd7b6ec6112b847408f26daeb6c197bf6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d7b6ec6112b847408f26daeb6c197bf6.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb9f2d4334284243bc6d9a854b354ea0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db9f2d4334284243bc6d9a854b354ea0.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60819cbc45a44aada14c5b4c21ad3756.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60819cbc45a44aada14c5b4c21ad3756.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5eede684a46041308d74e14f83f4c77b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5eede684a46041308d74e14f83f4c77b.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e081de99d6a4b1189a10c2c7c3bc9d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e081de99d6a4b1189a10c2c7c3bc9d5.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf81c1a0b1bf4f11b3a5c9da16aaa862.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df81c1a0b1bf4f11b3a5c9da16aaa862.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F285ac1bfc22b49f18b34dfbd5040e16e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/285ac1bfc22b49f18b34dfbd5040e16e.jpg already downloaded
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F046dfee640ba4f859b381b0e9c649acf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/046dfee640ba4f859b381b0e9c649acf.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb2217e88a97469f938a8e0edcd14df2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db2217e88a97469f938a8e0edcd14df2.jpg already downloaded
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac with identifier 202603230921306
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac
2026-03-30 15:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Ford '
'Kuga 2017 St-line 2.0 diesel 5dr SUV- ULEZ compliant- Car '
"came to us as Main dealer part exchange so it's very well "
'looked after- Only 2 owners from new and same owner since '
'2020!- Full Service History with 9x stamps!- Fresh service- '
'Fresh MOT- 3 months warranty- Kuga is Hpi clear ( report will '
"be provided)- It's in lovely condition inside and outside- "
'Safety/health check inspection has been done including fresh '
'service and 2x new tyres- Recently changed front and rear '
'brakes- Car will be supplied with fresh service, fresh MOT '
'and 3 months warranty- Very good spec car with plenty of toys '
"such as 19'' alloy wheels, power steering, panoramic "
'roof/sunroof, half leather-electric-heated seats, reverse '
'camera, hands free power tailgate, front and rear electric '
'windows, electric mirrors, Sat-nav, rear and front parking '
'sensors, Dual climate control, leather steering wheel, cruise '
'control, keyless entry/start and stop, aux input, USB input, '
'Bluetooth, 12v socket, central locking, 2x keys and much '
'more.\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230921306',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Ford',
'model': 'Kuga',
'odometer': 82154,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 65,
'photo_urls': ['https://m.atcdn.co.uk/a/media/98c86cdffd344706b52fa298caa7e593.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/07bb19c65fbc4d80bb873ad90c6e8b6b.jpg',
'https://m.atcdn.co.uk/a/media/77e9ccb8271047e6aef06c0346f07528.jpg',
'https://m.atcdn.co.uk/a/media/b2713b849de74c35b0ee3fde3274b5ef.jpg',
'https://m.atcdn.co.uk/a/media/cd99b0b3d9bf4ae1951e43e615d9e02a.jpg',
'https://m.atcdn.co.uk/a/media/0168abbecb814d32be25e2b66dbffd2b.jpg',
'https://m.atcdn.co.uk/a/media/29f46a3f39984f348df56620273d6030.jpg',
'https://m.atcdn.co.uk/a/media/898628d8fee04fe7a862ebaa16afc579.jpg',
'https://m.atcdn.co.uk/a/media/8535cf9d2ab34e0588c8789b264b5daf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776116,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98c86cdffd344706b52fa298caa7e593.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810913,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/07bb19c65fbc4d80bb873ad90c6e8b6b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762667,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/77e9ccb8271047e6aef06c0346f07528.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 696388,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b2713b849de74c35b0ee3fde3274b5ef.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 786012,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd99b0b3d9bf4ae1951e43e615d9e02a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752313,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0168abbecb814d32be25e2b66dbffd2b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762166,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/29f46a3f39984f348df56620273d6030.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 707114,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/898628d8fee04fe7a862ebaa16afc579.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac/b224f8dc-e1ee-5ab7-8c86-60f43ff2c4ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596123,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8535cf9d2ab34e0588c8789b264b5daf.jpg',
'Width': 2048}],
'price': 9350,
'price_includes_vat': True,
'registration_date': '2017-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2017}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921306%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230921306: {'created_time': 1774883305.077575, 'last_price_update_time': 1774883305.07759}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230921306') HTTP/1.1" 204 0
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 26015fae-ff8c-5576-a20e-5674265ae067 with identifier 202507214686771
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 26015fae-ff8c-5576-a20e-5674265ae067
2026-03-30 15:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Red',
'currency': 'GBP',
'description': 'Very clean and cheap to run 1st/family car- Hyundai i20 2015 '
'1.2 petrol 5dr. Only £35 road tax- Only 2 owners from new and '
'same one since 2021-Service history- Fresh service- Fresh '
'MOT- 3 months warranty- Hyundai is Hpi clear ( report will be '
"provided). It's in lovely condition inside and outside. "
'Safety/health check inspection has been done including fresh '
'service. Car will be supplied with fresh service, Fresh MOT '
'and 3 months warranty. Very good spec car with plenty of toys '
'such as front and rear fog lights, alloy wheels, power '
'steering, front and rear electric windows, electric mirrors, '
'rear parking sensors, AC, leather steering wheel, cruise '
'control, aux input, USB input, Bluetooth, 12v socket, central '
'locking, 2x keys and much more.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 83,
'fuel_type': 'Petrol',
'id': '26015fae-ff8c-5576-a20e-5674265ae067',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202507214686771',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Hyundai',
'model': 'i20',
'odometer': 99825,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d7b6ec6112b847408f26daeb6c197bf6.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/db9f2d4334284243bc6d9a854b354ea0.jpg',
'https://m.atcdn.co.uk/a/media/60819cbc45a44aada14c5b4c21ad3756.jpg',
'https://m.atcdn.co.uk/a/media/5eede684a46041308d74e14f83f4c77b.jpg',
'https://m.atcdn.co.uk/a/media/9e081de99d6a4b1189a10c2c7c3bc9d5.jpg',
'https://m.atcdn.co.uk/a/media/df81c1a0b1bf4f11b3a5c9da16aaa862.jpg',
'https://m.atcdn.co.uk/a/media/285ac1bfc22b49f18b34dfbd5040e16e.jpg',
'https://m.atcdn.co.uk/a/media/046dfee640ba4f859b381b0e9c649acf.jpg',
'https://m.atcdn.co.uk/a/media/db2217e88a97469f938a8e0edcd14df2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 785172,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d7b6ec6112b847408f26daeb6c197bf6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 752621,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db9f2d4334284243bc6d9a854b354ea0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702482,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60819cbc45a44aada14c5b4c21ad3756.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544745,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5eede684a46041308d74e14f83f4c77b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 729922,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e081de99d6a4b1189a10c2c7c3bc9d5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 747299,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/df81c1a0b1bf4f11b3a5c9da16aaa862.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762565,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/285ac1bfc22b49f18b34dfbd5040e16e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 733193,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/046dfee640ba4f859b381b0e9c649acf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99793a50-1df3-57fa-8521-e04a52e0f27c/99793a50-1df3-57fa-8521-e04a52e0f27c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655306,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db2217e88a97469f938a8e0edcd14df2.jpg',
'Width': 2048}],
'price': 3995,
'price_includes_vat': True,
'registration_date': '2015-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i20 1.2 Blue Drive SE Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2015}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507214686771%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202507214686771: {'created_time': 1774883305.138301, 'last_price_update_time': 1774883305.138313}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202507214686771') HTTP/1.1" 204 0
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:25 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 164909a5-4b3f-5191-92c5-dcd3559664bc with identifier: 202603230921002
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 164909a5-4b3f-5191-92c5-dcd3559664bc
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9978f7d372b44455ba09deeef3a541dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9978f7d372b44455ba09deeef3a541dd.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe09522940cf14ce188cd2f9f1661aac3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e09522940cf14ce188cd2f9f1661aac3.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fca705eb7459a43bd8a70ead5b9b06a2f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ca705eb7459a43bd8a70ead5b9b06a2f.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd1c83905deb4de7a3d7b42e7a2cea4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd1c83905deb4de7a3d7b42e7a2cea4d.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F208c76c8621c4251a1664bb039feba3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/208c76c8621c4251a1664bb039feba3c.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff7861c8ce65a47008010feb3d44eeb5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f7861c8ce65a47008010feb3d44eeb5e.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac2ca5713c9a4fb3aadcf0fbd17afe66.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac2ca5713c9a4fb3aadcf0fbd17afe66.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d884fa67e3b47d6a25e398ce1eb9281.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d884fa67e3b47d6a25e398ce1eb9281.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d614d54cce84614955fd1ea237a3343.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d614d54cce84614955fd1ea237a3343.jpg already downloaded
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 164909a5-4b3f-5191-92c5-dcd3559664bc with identifier 202603230921002
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 164909a5-4b3f-5191-92c5-dcd3559664bc
2026-03-30 15:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 194,
'color': 'Black',
'currency': 'GBP',
'description': 'Isuzu D-max Utah Vision 2013 2.5 diesel 4x4- Vehicle came to '
"us as Main dealer part exchange so it's very well looked "
'after- Same owner from new- Very good service history with '
'8x stamps ( 5x from Main Dealer)- Fresh service- Fresh mot- 3 '
'months warranty- D-max is Hpi clear ( report will be '
"provided)- It's in lovely condition inside and outside- "
'Safety/health check inspection has been done including fresh '
'service- Pickup truck will be supplied with fresh service, '
'Fresh MOT and 3 months warranty- Good spec with alloy wheels, '
'power steering, full leather-electric-heated seats, reverse '
'camera, front and rear electric windows, electric mirrors, '
'Sat-nav, rear parking sensors, AC, leather steering wheel, '
'cruise control, aux input, USB input, Bluetooth, 12v socket, '
'central locking and much more.\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2.5L',
'engine_horse_power': 161,
'fuel_type': 'Diesel',
'id': '164909a5-4b3f-5191-92c5-dcd3559664bc',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230921002',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 119200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9978f7d372b44455ba09deeef3a541dd.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/e09522940cf14ce188cd2f9f1661aac3.jpg',
'https://m.atcdn.co.uk/a/media/ca705eb7459a43bd8a70ead5b9b06a2f.jpg',
'https://m.atcdn.co.uk/a/media/cd1c83905deb4de7a3d7b42e7a2cea4d.jpg',
'https://m.atcdn.co.uk/a/media/208c76c8621c4251a1664bb039feba3c.jpg',
'https://m.atcdn.co.uk/a/media/f7861c8ce65a47008010feb3d44eeb5e.jpg',
'https://m.atcdn.co.uk/a/media/ac2ca5713c9a4fb3aadcf0fbd17afe66.jpg',
'https://m.atcdn.co.uk/a/media/9d884fa67e3b47d6a25e398ce1eb9281.jpg',
'https://m.atcdn.co.uk/a/media/6d614d54cce84614955fd1ea237a3343.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 731350,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9978f7d372b44455ba09deeef3a541dd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 791171,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e09522940cf14ce188cd2f9f1661aac3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802170,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ca705eb7459a43bd8a70ead5b9b06a2f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763325,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd1c83905deb4de7a3d7b42e7a2cea4d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 777730,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/208c76c8621c4251a1664bb039feba3c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 815641,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f7861c8ce65a47008010feb3d44eeb5e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697207,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac2ca5713c9a4fb3aadcf0fbd17afe66.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 706444,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d884fa67e3b47d6a25e398ce1eb9281.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_164909a5-4b3f-5191-92c5-dcd3559664bc/164909a5-4b3f-5191-92c5-dcd3559664bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618338,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d614d54cce84614955fd1ea237a3343.jpg',
'Width': 2048}],
'price': 8994,
'price_includes_vat': True,
'registration_date': '2013-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max 2.5 TD Utah Vision 4x4 4dr',
'transmission': 'manual',
'trim': 'Utah Vision',
'year': 2013}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921002%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230921002: {'created_time': 1774883305.449722, 'last_price_update_time': 1774883305.449737}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230921002') HTTP/1.1" 204 0
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:25 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c72bf76c-53c6-585e-afe1-7eb8ad7fda1e with identifier: 202603200863387
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c72bf76c-53c6-585e-afe1-7eb8ad7fda1e
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6bb2b2972eab445cb6800f0b3c5ab80c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6bb2b2972eab445cb6800f0b3c5ab80c.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5dabedaa9b464b1888c9804a6a257f26.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5dabedaa9b464b1888c9804a6a257f26.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdaa123c8b0f040da9a0338e16ecd707f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/daa123c8b0f040da9a0338e16ecd707f.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd988da667c2f4dbd9912d3953ceeeb28.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d988da667c2f4dbd9912d3953ceeeb28.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Facd747858caf4e9c983ac3ce7691f3b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/acd747858caf4e9c983ac3ce7691f3b4.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7beb6ab9d4f54e75acb98066d6ce594c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7beb6ab9d4f54e75acb98066d6ce594c.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2696102cba64985b88b7b5f69286a63.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2696102cba64985b88b7b5f69286a63.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F904b4fb4de184833ac9e3315764c6171.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/904b4fb4de184833ac9e3315764c6171.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9fbacf1f3e44d3685ecca83aa41ce85.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9fbacf1f3e44d3685ecca83aa41ce85.jpg already downloaded
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c72bf76c-53c6-585e-afe1-7eb8ad7fda1e with identifier 202603200863387
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c72bf76c-53c6-585e-afe1-7eb8ad7fda1e
2026-03-30 15:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with very low mileage- '
'Vauxhall Insignia 2015 2.0 diesel 5dr estate- Only £35 road '
"tax- Car came to us as Main dealer part exchange so it's very "
'well looked after- Only 4 owners from new and same owner '
'since 2021!- Full Service History with 11x stamps!- Fresh '
'service- Fresh MOT- 3 months warranty- Insignia is Hpi clear '
"( report will be provided)- It's in lovely condition inside "
'and outside- Safety/health check inspection has been done '
'including fresh service- Car will be supplied with fresh '
'service, Fresh MOT and 3 months warranty- Good spec car with '
'plenty of toys such as alloy wheels, power steering, front '
'and rear electric windows, electric mirrors, DAB radio, AC, '
'leather steering wheel, cruise control, aux input, USB input, '
'Bluetooth, 12v socket, central locking, 2x keys, brand new '
'tow bar and much more.\n'
'\n'
'More cars available on our website: www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 161,
'fuel_type': 'Diesel',
'id': 'c72bf76c-53c6-585e-afe1-7eb8ad7fda1e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200863387',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Vauxhall',
'model': 'Insignia',
'odometer': 57500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6bb2b2972eab445cb6800f0b3c5ab80c.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/5dabedaa9b464b1888c9804a6a257f26.jpg',
'https://m.atcdn.co.uk/a/media/daa123c8b0f040da9a0338e16ecd707f.jpg',
'https://m.atcdn.co.uk/a/media/d988da667c2f4dbd9912d3953ceeeb28.jpg',
'https://m.atcdn.co.uk/a/media/acd747858caf4e9c983ac3ce7691f3b4.jpg',
'https://m.atcdn.co.uk/a/media/7beb6ab9d4f54e75acb98066d6ce594c.jpg',
'https://m.atcdn.co.uk/a/media/a2696102cba64985b88b7b5f69286a63.jpg',
'https://m.atcdn.co.uk/a/media/904b4fb4de184833ac9e3315764c6171.jpg',
'https://m.atcdn.co.uk/a/media/e9fbacf1f3e44d3685ecca83aa41ce85.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 945111,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6bb2b2972eab445cb6800f0b3c5ab80c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 957664,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5dabedaa9b464b1888c9804a6a257f26.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1071194,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/daa123c8b0f040da9a0338e16ecd707f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 862408,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d988da667c2f4dbd9912d3953ceeeb28.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 925225,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/acd747858caf4e9c983ac3ce7691f3b4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1012767,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7beb6ab9d4f54e75acb98066d6ce594c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 936552,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2696102cba64985b88b7b5f69286a63.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 805227,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/904b4fb4de184833ac9e3315764c6171.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c72bf76c-53c6-585e-afe1-7eb8ad7fda1e/c72bf76c-53c6-585e-afe1-7eb8ad7fda1e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 814398,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9fbacf1f3e44d3685ecca83aa41ce85.jpg',
'Width': 2048}],
'price': 6650,
'price_includes_vat': True,
'registration_date': '2015-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Insignia 2.0 CDTi ecoFLEX SRi Sports Tourer Euro 5 (s/s) '
'5dr',
'transmission': 'manual',
'trim': 'SRi',
'year': 2015}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200863387%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200863387: {'created_time': 1774883305.710403, 'last_price_update_time': 1774883305.710415}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200863387') HTTP/1.1" 204 0
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:25 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8568a6ed-985a-5f73-b346-7968619286f4 with identifier: 202603130676939
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8568a6ed-985a-5f73-b346-7968619286f4
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F92a0928b647c40ef944ad46941444e60.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/92a0928b647c40ef944ad46941444e60.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1d2c430c3d3408e831feb1b2a178e08.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1d2c430c3d3408e831feb1b2a178e08.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F471d2daefc95424099c22adc14c41e6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/471d2daefc95424099c22adc14c41e6d.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F177c2f4e223b420ba335ec02063f39fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/177c2f4e223b420ba335ec02063f39fd.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9257ebfff0ed463c8f544d34bfa5d3b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9257ebfff0ed463c8f544d34bfa5d3b2.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40df341bd1934ef9afb65427754b3834.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40df341bd1934ef9afb65427754b3834.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0c6a202a89349c7b419ebde186fb0f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0c6a202a89349c7b419ebde186fb0f7.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb14e4450458d421da946e2543f2285ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b14e4450458d421da946e2543f2285ab.jpg already downloaded
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F51c456c55b6d4546b5c0473ef5d33978.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/51c456c55b6d4546b5c0473ef5d33978.jpg already downloaded
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8568a6ed-985a-5f73-b346-7968619286f4 with identifier 202603130676939
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8568a6ed-985a-5f73-b346-7968619286f4
2026-03-30 15:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'White',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- '
'Mitsubishi ASX 2018 1.6 petrol 5dr SUV- Car came to us as '
"Main dealer part exchange so it's very well looked after- "
'Only 2 owners from new and same owner since 2019!- Service '
'history- Fresh service- Long MOT until 21/01/2027 without any '
'advisories- 3 months warranty- ASX is Hpi clear ( report will '
"be provided)- It's in lovely condition inside and outside- "
'Safety/health check inspection has been done including fresh '
'service and 2x new tyres- Car will be supplied with fresh '
'service, long MOT and 3 months warranty- Top spec car with '
'plenty of toys such as front and rear fog lights, alloy '
'wheels, power steering, panoramic roof, half leather-heated '
'seats, reverse camera, front and rear electric windows, '
'electric mirrors, Dual climate control, leather steering '
'wheel, cruise control, keyless entry/start and stop, aux '
'input, USB input, Bluetooth, 12v socket, central locking, 2x '
'keys and much more.\n'
'\n'
'More cars available on our website: www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 115,
'fuel_type': 'Petrol',
'id': '8568a6ed-985a-5f73-b346-7968619286f4',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130676939',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 75437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 58,
'photo_urls': ['https://m.atcdn.co.uk/a/media/92a0928b647c40ef944ad46941444e60.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/d1d2c430c3d3408e831feb1b2a178e08.jpg',
'https://m.atcdn.co.uk/a/media/471d2daefc95424099c22adc14c41e6d.jpg',
'https://m.atcdn.co.uk/a/media/177c2f4e223b420ba335ec02063f39fd.jpg',
'https://m.atcdn.co.uk/a/media/9257ebfff0ed463c8f544d34bfa5d3b2.jpg',
'https://m.atcdn.co.uk/a/media/40df341bd1934ef9afb65427754b3834.jpg',
'https://m.atcdn.co.uk/a/media/a0c6a202a89349c7b419ebde186fb0f7.jpg',
'https://m.atcdn.co.uk/a/media/b14e4450458d421da946e2543f2285ab.jpg',
'https://m.atcdn.co.uk/a/media/51c456c55b6d4546b5c0473ef5d33978.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687095,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/92a0928b647c40ef944ad46941444e60.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749060,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1d2c430c3d3408e831feb1b2a178e08.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774772,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/471d2daefc95424099c22adc14c41e6d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624100,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/177c2f4e223b420ba335ec02063f39fd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712733,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9257ebfff0ed463c8f544d34bfa5d3b2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782366,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/40df341bd1934ef9afb65427754b3834.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701919,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0c6a202a89349c7b419ebde186fb0f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620595,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b14e4450458d421da946e2543f2285ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8568a6ed-985a-5f73-b346-7968619286f4/8568a6ed-985a-5f73-b346-7968619286f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 507444,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/51c456c55b6d4546b5c0473ef5d33978.jpg',
'Width': 2048}],
'price': 8495,
'price_includes_vat': True,
'registration_date': '2018-01-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 4 Euro 6 5dr',
'transmission': 'manual',
'trim': '4',
'year': 2018}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130676939%27 HTTP/1.1" 200 None
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130676939: {'created_time': 1774883305.977863, 'last_price_update_time': 1774883305.977878}
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130676939') HTTP/1.1" 204 0
2026-03-30 15:08:25 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:25 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b028ca-9352-5630-8276-ff489c2b4fb8 with identifier: 202603110609050
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9b028ca-9352-5630-8276-ff489c2b4fb8
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5433705088ab4004b445f13a5f3a6d26.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5433705088ab4004b445f13a5f3a6d26.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd440c4b07f81488f87beea4ea80d619c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d440c4b07f81488f87beea4ea80d619c.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e0e0d6b80f84a0b8645713afa5238ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e0e0d6b80f84a0b8645713afa5238ee.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ebb7049198f4539959e5d6286fe8fad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ebb7049198f4539959e5d6286fe8fad.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7114f9fd5a98425ebd325b1cad7c06ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7114f9fd5a98425ebd325b1cad7c06ab.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F406045eca9d348f99174c05cc1906c17.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/406045eca9d348f99174c05cc1906c17.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F81e84b8e187f4275bd82992a55598b46.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/81e84b8e187f4275bd82992a55598b46.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fca8c73f548eb472b85a7619e719a866f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ca8c73f548eb472b85a7619e719a866f.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7234abb4acb742498c59689bf88f094e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7234abb4acb742498c59689bf88f094e.jpg already downloaded
2026-03-30 15:08:26 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a9b028ca-9352-5630-8276-ff489c2b4fb8 with identifier 202603110609050
2026-03-30 15:08:26 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:26 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:26 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a9b028ca-9352-5630-8276-ff489c2b4fb8
2026-03-30 15:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Grey',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Audi '
'A6 2011 S-line 2.0 diesel 4dr- Car came to us as Main dealer '
"part exchange so it's very well looked after- Only 3 owners "
'from new and same owner since 2014!- Full Audi Service '
'history- Fresh service by Audi- long MOT until 20/08/2026- 3 '
'months warranty- Audi is Hpi clear ( report will be '
"provided)- It's in lovely condition inside and outside- "
'Service history show services in 2012, 2013, 2014, 2015, '
'2016, 2018, 2020, 2020, 2022, 2024, 2025, 2025. Fresh service '
'has been done by Audi main dealer at 87840 11/08/2025 with '
'fresh MOT- Also 4x alloy wheel has been refurbished- '
'Safety/health check inspection has been done- Car will be '
'supplied with fresh service, long MOT until 20/08/2026 and 3 '
'months warranty- Very good spec car with plenty of toys such '
'as front and rear fog lights, alloy wheels, power steering, '
'full leather seats, front and rear electric windows, electric '
'mirrors, Sat-nav, rear parking sensors, Dual climate control, '
'leather steering wheel, cruise control, aux input, USB input, '
'Bluetooth, 12v socket, central locking, 2x keys and much '
'more.\n'
'\n'
'More cars available on our website: www.automad.co.uk',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Diesel',
'id': 'a9b028ca-9352-5630-8276-ff489c2b4fb8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110609050',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Audi',
'model': 'A6 Saloon',
'odometer': 88000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photo_urls': ['https://m.atcdn.co.uk/a/media/5433705088ab4004b445f13a5f3a6d26.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/d440c4b07f81488f87beea4ea80d619c.jpg',
'https://m.atcdn.co.uk/a/media/4e0e0d6b80f84a0b8645713afa5238ee.jpg',
'https://m.atcdn.co.uk/a/media/3ebb7049198f4539959e5d6286fe8fad.jpg',
'https://m.atcdn.co.uk/a/media/7114f9fd5a98425ebd325b1cad7c06ab.jpg',
'https://m.atcdn.co.uk/a/media/406045eca9d348f99174c05cc1906c17.jpg',
'https://m.atcdn.co.uk/a/media/81e84b8e187f4275bd82992a55598b46.jpg',
'https://m.atcdn.co.uk/a/media/ca8c73f548eb472b85a7619e719a866f.jpg',
'https://m.atcdn.co.uk/a/media/7234abb4acb742498c59689bf88f094e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 929339,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5433705088ab4004b445f13a5f3a6d26.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 894749,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d440c4b07f81488f87beea4ea80d619c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 972593,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e0e0d6b80f84a0b8645713afa5238ee.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 884590,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ebb7049198f4539959e5d6286fe8fad.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 921113,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7114f9fd5a98425ebd325b1cad7c06ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 962493,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/406045eca9d348f99174c05cc1906c17.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 882283,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/81e84b8e187f4275bd82992a55598b46.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 901039,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ca8c73f548eb472b85a7619e719a866f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b028ca-9352-5630-8276-ff489c2b4fb8/a9b028ca-9352-5630-8276-ff489c2b4fb8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848830,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7234abb4acb742498c59689bf88f094e.jpg',
'Width': 2048}],
'price': 4990,
'price_includes_vat': True,
'registration_date': '2011-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A6 Saloon 2.0 TDIe S line Euro 5 4dr',
'transmission': 'manual',
'trim': 'S line',
'year': 2011}
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110609050%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110609050: {'created_time': 1774883306.281713, 'last_price_update_time': 1774883306.281723}
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110609050') HTTP/1.1" 204 0
2026-03-30 15:08:26 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:26 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a3effda-9ce9-522c-86de-bc63cc2b5d04 with identifier: 202603070491173
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a3effda-9ce9-522c-86de-bc63cc2b5d04
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fece74c2d09dc47849d218f100418a730.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ece74c2d09dc47849d218f100418a730.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F872ffb71671c4a75aa59ea003ee8ce9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/872ffb71671c4a75aa59ea003ee8ce9d.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F226008c42af54679b3b1017920b86301.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/226008c42af54679b3b1017920b86301.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8284ab7d2ec7416ba94d608d19d09efb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8284ab7d2ec7416ba94d608d19d09efb.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff60c1066efdc4d59bc3c2785dd55adb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f60c1066efdc4d59bc3c2785dd55adb6.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F011c280d288f4052ac107d9701c6c0fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/011c280d288f4052ac107d9701c6c0fe.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F06899448eeb84401ac7f5642e7087adb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/06899448eeb84401ac7f5642e7087adb.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6aaf75d4d594dc7a509092ea48d96f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6aaf75d4d594dc7a509092ea48d96f6.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4cd10085575a45ce808da4cd94730383.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4cd10085575a45ce808da4cd94730383.jpg already downloaded
2026-03-30 15:08:26 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4a3effda-9ce9-522c-86de-bc63cc2b5d04 with identifier 202603070491173
2026-03-30 15:08:26 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:26 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:26 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4a3effda-9ce9-522c-86de-bc63cc2b5d04
2026-03-30 15:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'Silver',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car with low mileage- Kia '
'Sportage 2014 1.6 petrol 5dr SUV- Car came to us as Main '
"dealer part exchange so it's very well looked after- Full "
'Service History with 11x stamps- Fresh service- Fresh MOT- 3 '
'months warranty- Kia is Hpi clear ( report will be provided)- '
"It's in lovely condition inside and outside- Service history "
'show services in: 2015, 2016, 2017, 2018, 2019, 2020, 2021, '
'2022, 2023, 2025, 2026- Safety/health check inspection has '
'been done including re-gass AC- Car will be supplied with '
'fresh service, Fresh MOT and 3 months warranty- Good spec car '
'with alloy wheels, power steering, panoramic opening roof, '
'half leather seats, front and rear electric windows, electric '
'mirrors, upgraded radio, Sat-nav, rear parking sensors, Dual '
'climate control, leather steering wheel, cruise control, aux '
'input, USB input, Bluetooth, 12v socket, central locking, 2x '
'keys and much more.\n'
'\n'
'Please check our website for more cars www.automad.co.uk',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 135,
'fuel_type': 'Petrol',
'id': '4a3effda-9ce9-522c-86de-bc63cc2b5d04',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603070491173',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Kia',
'model': 'Sportage',
'odometer': 77904,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 62,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ece74c2d09dc47849d218f100418a730.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/872ffb71671c4a75aa59ea003ee8ce9d.jpg',
'https://m.atcdn.co.uk/a/media/226008c42af54679b3b1017920b86301.jpg',
'https://m.atcdn.co.uk/a/media/8284ab7d2ec7416ba94d608d19d09efb.jpg',
'https://m.atcdn.co.uk/a/media/f60c1066efdc4d59bc3c2785dd55adb6.jpg',
'https://m.atcdn.co.uk/a/media/011c280d288f4052ac107d9701c6c0fe.jpg',
'https://m.atcdn.co.uk/a/media/06899448eeb84401ac7f5642e7087adb.jpg',
'https://m.atcdn.co.uk/a/media/c6aaf75d4d594dc7a509092ea48d96f6.jpg',
'https://m.atcdn.co.uk/a/media/4cd10085575a45ce808da4cd94730383.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 894045,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ece74c2d09dc47849d218f100418a730.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 949102,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/872ffb71671c4a75aa59ea003ee8ce9d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885339,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/226008c42af54679b3b1017920b86301.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 839655,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8284ab7d2ec7416ba94d608d19d09efb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 878765,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f60c1066efdc4d59bc3c2785dd55adb6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866526,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/011c280d288f4052ac107d9701c6c0fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859818,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/06899448eeb84401ac7f5642e7087adb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694666,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6aaf75d4d594dc7a509092ea48d96f6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a3effda-9ce9-522c-86de-bc63cc2b5d04/4a3effda-9ce9-522c-86de-bc63cc2b5d04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584246,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4cd10085575a45ce808da4cd94730383.jpg',
'Width': 2048}],
'price': 5890,
'price_includes_vat': True,
'registration_date': '2014-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Sportage 1.6 GDi EcoDynamics 2 2WD Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': '2',
'year': 2014}
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070491173%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603070491173: {'created_time': 1774883306.540097, 'last_price_update_time': 1774883306.540108}
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603070491173') HTTP/1.1" 204 0
2026-03-30 15:08:26 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:26 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ac549629-64b5-5920-a8cf-a3a3397f7aaf with identifier: 202603030363262
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac549629-64b5-5920-a8cf-a3a3397f7aaf
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F86be6cf784914330bf7274c38267f84a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/86be6cf784914330bf7274c38267f84a.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb94b63b12474b95aed9744f45c65ddd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb94b63b12474b95aed9744f45c65ddd.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9c3af9a58d740ffaaac5e95e8b176b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9c3af9a58d740ffaaac5e95e8b176b0.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a46fb608b5f4a2da63257eb648310b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a46fb608b5f4a2da63257eb648310b4.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7fc6aa5f8bb846ab9ec9035335dd0203.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7fc6aa5f8bb846ab9ec9035335dd0203.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5662bc34e3b04d4bb1deb5160b22ddff.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5662bc34e3b04d4bb1deb5160b22ddff.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F313c40b115334166922724584018a9e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/313c40b115334166922724584018a9e8.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bdd6c09e785440eb50b4cdeecbaae3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bdd6c09e785440eb50b4cdeecbaae3d.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29dbf7213df44b6aaeebab06e4b05e0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29dbf7213df44b6aaeebab06e4b05e0a.jpg already downloaded
2026-03-30 15:08:26 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ac549629-64b5-5920-a8cf-a3a3397f7aaf with identifier 202603030363262
2026-03-30 15:08:26 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:26 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:26 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ac549629-64b5-5920-a8cf-a3a3397f7aaf
2026-03-30 15:08:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'Black',
'currency': 'GBP',
'description': 'Very clean and good looking car- Vw Scirocco R-line 2014 2.0 '
'diesel 3dr- Car came to us as Main dealer part exchange so '
"it's very well looked after- Full Service History with 13x "
'stamps- Fresh service- Long MOT until 27/10/2026- 3 months '
'warranty- Scirocco is Hpi clear ( report will be provided)- '
"It's in lovely condition inside and outside- Service history "
'show services in 2014, 2015, 2016, 2017, 2018, 2019, 2020, '
'2021, 2022, 2023, 2024, 2025, 2026- Safety/health check '
'inspection has been done including fresh service- Recently '
'new new front brake discs and pads has been changed- '
'30/04/2025 DSG gearbox service with 2x new tyres- Timing belt '
'changed twice in: 2020 and 2023 at 82000- Car will be '
'supplied with fresh service, long MOT and 3 months warranty- '
"Very good spec car with 19'' alloy wheels, power steering, "
'Sunroof, sport suspension, full leather-heated seats, '
'electric windows, electric mirrors, Sat-nav, rear parking '
'sensors, Dual climate control, leather steering wheel, aux '
'input, USB input, Bluetooth, 12v socket, central locking, 2x '
'keys and much more.\n'
'\n'
'For more vehicles please visit our website www.automad.co.uk',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 175,
'fuel_type': 'Diesel',
'id': 'ac549629-64b5-5920-a8cf-a3a3397f7aaf',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030363262',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 106804,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 59,
'photo_urls': ['https://m.atcdn.co.uk/a/media/86be6cf784914330bf7274c38267f84a.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/bb94b63b12474b95aed9744f45c65ddd.jpg',
'https://m.atcdn.co.uk/a/media/b9c3af9a58d740ffaaac5e95e8b176b0.jpg',
'https://m.atcdn.co.uk/a/media/0a46fb608b5f4a2da63257eb648310b4.jpg',
'https://m.atcdn.co.uk/a/media/7fc6aa5f8bb846ab9ec9035335dd0203.jpg',
'https://m.atcdn.co.uk/a/media/5662bc34e3b04d4bb1deb5160b22ddff.jpg',
'https://m.atcdn.co.uk/a/media/313c40b115334166922724584018a9e8.jpg',
'https://m.atcdn.co.uk/a/media/4bdd6c09e785440eb50b4cdeecbaae3d.jpg',
'https://m.atcdn.co.uk/a/media/29dbf7213df44b6aaeebab06e4b05e0a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 873598,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/86be6cf784914330bf7274c38267f84a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 960403,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb94b63b12474b95aed9744f45c65ddd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 892664,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9c3af9a58d740ffaaac5e95e8b176b0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 826004,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a46fb608b5f4a2da63257eb648310b4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 851850,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7fc6aa5f8bb846ab9ec9035335dd0203.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 869101,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5662bc34e3b04d4bb1deb5160b22ddff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 795863,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/313c40b115334166922724584018a9e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782831,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4bdd6c09e785440eb50b4cdeecbaae3d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac549629-64b5-5920-a8cf-a3a3397f7aaf/ac549629-64b5-5920-a8cf-a3a3397f7aaf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600329,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/29dbf7213df44b6aaeebab06e4b05e0a.jpg',
'Width': 2048}],
'price': 7250,
'price_includes_vat': True,
'registration_date': '2014-01-31',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TDI R-Line DSG Euro 5 3dr (Leather, Nav)',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2014}
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030363262%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030363262: {'created_time': 1774883306.813092, 'last_price_update_time': 1774883306.813102}
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030363262') HTTP/1.1" 204 0
2026-03-30 15:08:26 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:26 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4134ba-d782-5e87-bac2-e85e7bcd6c25 with identifier: 202602280297116
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb4134ba-d782-5e87-bac2-e85e7bcd6c25
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f4943063bd84f1897f821d4d7c25154.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f4943063bd84f1897f821d4d7c25154.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c25088af14044c9bf4d6fb95359a05d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02dba826f1634e5dbdef7270ee440894.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02dba826f1634e5dbdef7270ee440894.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b8dab00c7004724b021ed8163d69420.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b8dab00c7004724b021ed8163d69420.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feca3a76732bd45a6a2a486ec0d36e1cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eca3a76732bd45a6a2a486ec0d36e1cc.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ba895a7546b4190a24764b3be8e23c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ba895a7546b4190a24764b3be8e23c3.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7ad56d11cb6b4192993837a2780cfa3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7ad56d11cb6b4192993837a2780cfa3c.jpg already downloaded
2026-03-30 15:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53e9d36650eb48a091a55ff083f1d2ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53e9d36650eb48a091a55ff083f1d2ef.jpg already downloaded
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ec12326ddbe4ff4bd485c93568fb34b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ec12326ddbe4ff4bd485c93568fb34b.jpg already downloaded
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c43ac7ed6a0457680c6aba629b1cb25.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c43ac7ed6a0457680c6aba629b1cb25.jpg already downloaded
2026-03-30 15:08:27 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: eb4134ba-d782-5e87-bac2-e85e7bcd6c25 with identifier 202602280297116
2026-03-30 15:08:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:27 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item eb4134ba-d782-5e87-bac2-e85e7bcd6c25
2026-03-30 15:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': 'Orange',
'currency': 'GBP',
'description': 'Very clean and cheap to run family car- DS4 Crossback 2015 '
'1.6 diesel 5dr- Only £20 road tax- Service history with 9x '
'stamps- Fresh service- Fresh mot- 3 months warranty- DS4 is '
"Hpi clear ( report will be provided)- It's in lovely "
'condition inside and outside- Service history show services '
'in 2016, 2017, 2020, 2021, 2022, 2024, 2024, 2025, 2026. '
'Safety/health check inspection has been done including fresh '
'oil service and brand new clutch kit- Car will be supplied '
'with fresh service, Fresh MOT and 3 months warranty- Very '
'good spec car with plenty of toys such as front and rear fog '
'lights, alloy wheels, power steering, half-leather seats, '
'reverse camera, electric windows, electric mirrors, Sat-nav, '
'rear parking sensors, Dual climate control, leather steering '
'wheel, cruise control, keyless entry/start and stop, aux '
'input, USB input, Bluetooth, 12v socket, central locking, 2x '
'keys and much more.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 118,
'fuel_type': 'Diesel',
'id': 'eb4134ba-d782-5e87-bac2-e85e7bcd6c25',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602280297116',
'listing': 'directbuy',
'location': 'Walsall, Staffordshire',
'make': 'DS AUTOMOBILES',
'model': 'DS 4 CROSSBACK',
'odometer': 99254,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8f4943063bd84f1897f821d4d7c25154.jpg',
'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'https://m.atcdn.co.uk/a/media/02dba826f1634e5dbdef7270ee440894.jpg',
'https://m.atcdn.co.uk/a/media/2b8dab00c7004724b021ed8163d69420.jpg',
'https://m.atcdn.co.uk/a/media/eca3a76732bd45a6a2a486ec0d36e1cc.jpg',
'https://m.atcdn.co.uk/a/media/5ba895a7546b4190a24764b3be8e23c3.jpg',
'https://m.atcdn.co.uk/a/media/7ad56d11cb6b4192993837a2780cfa3c.jpg',
'https://m.atcdn.co.uk/a/media/53e9d36650eb48a091a55ff083f1d2ef.jpg',
'https://m.atcdn.co.uk/a/media/0ec12326ddbe4ff4bd485c93568fb34b.jpg',
'https://m.atcdn.co.uk/a/media/5c43ac7ed6a0457680c6aba629b1cb25.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 994465,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f4943063bd84f1897f821d4d7c25154.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da323e8b-6e1e-5afe-9700-73bceab94c1f/da323e8b-6e1e-5afe-9700-73bceab94c1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89583,
'Height': 2048,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c25088af14044c9bf4d6fb95359a05d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 987154,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/02dba826f1634e5dbdef7270ee440894.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 953215,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b8dab00c7004724b021ed8163d69420.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 947781,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eca3a76732bd45a6a2a486ec0d36e1cc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 999543,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5ba895a7546b4190a24764b3be8e23c3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 984497,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7ad56d11cb6b4192993837a2780cfa3c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 941511,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53e9d36650eb48a091a55ff083f1d2ef.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 870111,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0ec12326ddbe4ff4bd485c93568fb34b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb4134ba-d782-5e87-bac2-e85e7bcd6c25/eb4134ba-d782-5e87-bac2-e85e7bcd6c25_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 730891,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c43ac7ed6a0457680c6aba629b1cb25.jpg',
'Width': 2048}],
'price': 3995,
'price_includes_vat': True,
'registration_date': '2015-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS 4 CROSSBACK 1.6 BlueHDi Crossback Euro 6 (s/s) '
'5dr',
'transmission': 'manual',
'year': 2015}
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602280297116%27 HTTP/1.1" 200 None
2026-03-30 15:08:27 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602280297116: {'created_time': 1774883307.104897, 'last_price_update_time': 1774883307.104911}
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602280297116') HTTP/1.1" 204 0
2026-03-30 15:08:27 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:08:27 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:08:27 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:08:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:27 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4a7299842c1f11f18e133aacc95538c6
2026-03-30 15:08:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:08:27 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:08:27 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:27 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:08:27 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587308 HTTP/1.1" 200 None
2026-03-30 15:08:28 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (16 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4a7299842c1f11f18e133aacc95538c6.jl
2026-03-30 15:08:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 120929,
'downloader/request_count': 3,
'downloader/request_method_count/POST': 3,
'downloader/response_bytes': 740574,
'downloader/response_count': 3,
'downloader/response_status_count/200': 3,
'elapsed_time_seconds': 15.458607,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 15, 8, 28, 409861, tzinfo=datetime.timezone.utc),
'item_scraped_count': 16,
'log_count/DEBUG': 495,
'log_count/INFO': 311,
'memusage/max': 149557248,
'memusage/startup': 149557248,
'request_depth_max': 1,
'response_received_count': 3,
'scheduler/dequeued': 3,
'scheduler/dequeued/memory': 3,
'scheduler/enqueued': 3,
'scheduler/enqueued/memory': 3,
'scrape_type/new': 16,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 3,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.301676110054056,
'scrapy-zyte-api/mean_response_seconds': 1.4612544265886147,
'scrapy-zyte-api/processed': 3,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
'scrapy-zyte-api/request_args/experimental.requestCookies': 2,
'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
'scrapy-zyte-api/request_args/httpRequestBody': 3,
'scrapy-zyte-api/request_args/httpRequestMethod': 3,
'scrapy-zyte-api/request_args/httpResponseBody': 3,
'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
'scrapy-zyte-api/request_args/url': 3,
'scrapy-zyte-api/status_codes/200': 3,
'scrapy-zyte-api/success': 3,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 30, 15, 8, 12, 951254, tzinfo=datetime.timezone.utc)}
2026-03-30 15:08:28 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:08:28 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f4ce22da4d0>
2026-03-30 15:08:28 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f4ce22e7ad0>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)