PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2026-03-30 15:07:17 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:07:17 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:07:17 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:07:17 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:07:17 [auto_selling_autotrader.co.uk] INFO: _job: 4a5f6c6a2c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:07:17 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:07:17 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:07:17 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:07:17 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:07:17 [scrapy.extensions.telnet] INFO: Telnet Password: 6af1952aa88f8a24
2026-03-30 15:07:17 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:07:17 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4a5f6c6a2c1f11f18e133aacc95538c6.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 15:07:17 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:17 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:17 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:07:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:07:17 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:07:17 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:07:17 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:07:17 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:07:17 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:07:17 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:07:17 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:07:17 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 15:07:17 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 15:07:17 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:17 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:22 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10017493 and multipost_profile_id: f215d825-b3f3-45a3-b03e-331e37302432 and job_id: 4a5f6c6a2c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10017493&sort=price-asc
2026-03-30 15:07:22 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10017493, page: 1
2026-03-30 15:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Page: 1/3, total results: 46
2026-03-30 15:07:24 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 15:07:24 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603291112748%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603291112748: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603291112746%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603291112746: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281085223%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603281085223: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281085222%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603281085222: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281085221%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603281085221: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250981324%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250981324: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250981323%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250981323: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966142%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240966142: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966140%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240966140: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966138%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240966138: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966135%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240966135: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966131%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240966131: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240946249%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240946249: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200870151%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200870151: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190838486%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190838486: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170772337%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170772337: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170772333%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170772333: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170754059%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170754059: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170754058%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170754058: 1
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100573780%27 HTTP/1.1" 200 None
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100573780: 1
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-30 15:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-30 15:07:24 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10017493, page: 2
2026-03-30 15:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Page: 2/3, total results: 46
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100573779%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100573779: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100573778%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100573778: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100573777%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100573777: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030369944%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030369944: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240177729%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240177729: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240177726%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240177726: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602180028362%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602180028362: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179996986%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179996986: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109820050%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109820050: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602069733711%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602069733711: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039644347%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602039644347: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289490000%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289490000: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239373871%27 HTTP/1.1" 200 None
2026-03-30 15:07:25 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239373871: 1
2026-03-30 15:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209286701%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601209286701: 1
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601139113135%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601139113135: 1
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601129085042%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601129085042: 1
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512198711982%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512198711982: 1
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512138572546%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512138572546: 1
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157907841%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157907841: 1
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511087746249%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511087746249: 1
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-30 15:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10017493, page: 3
2026-03-30 15:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:26 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:26 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ec6b2267-3eab-5222-8515-ab18b9def79e with identifier: 202603291112748
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec6b2267-3eab-5222-8515-ab18b9def79e
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F04c0948303f6480b9de116d83ff1d276.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg already downloaded
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb678f5c4b17944f6a01788862b10a8e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg already downloaded
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc962ad07c08f4098b1a5ac8b654215bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg already downloaded
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0761a9bcbbaf4aeaae32285689e4dbb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg already downloaded
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b437fe35e9a49399a64d5fcb86ef9cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg already downloaded
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54878105cefd4b1dbc9e78672589fda0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg already downloaded
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43dfc279ab3549939780fc6d4c86309d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg already downloaded
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe4e83531cc84f61ab5655b61faa4e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg already downloaded
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd868903c70384a62858e1e0a8ea7c36c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg already downloaded
2026-03-30 15:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdbc28facf85d470598dfd17fac79c6b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dbc28facf85d470598dfd17fac79c6b1.jpg already downloaded
2026-03-30 15:07:27 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ec6b2267-3eab-5222-8515-ab18b9def79e with identifier 202603291112748
2026-03-30 15:07:27 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:07:27 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:07:27 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:07:27 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:27 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:07:27 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2022
2026-03-30 15:07:27 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883247
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883247
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:27 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ec6b2267-3eab-5222-8515-ab18b9def79e
2026-03-30 15:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'Black',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Audi A5 TDI S '
'Line | 2.0 Diesel | Automatic | Full HPI Clear | '
'Excellent Service History With 6 Records, Timing Kit Replaced '
'In 2022 | Euro 6, Ulez Compliant | Only 2 Former Keepers From '
'New | 2 Keys | Will Come With 12 Months MOT | Well Maintained '
'| Excellent Spec Including Satellite Navigation, Bluetooth & '
'More | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great '
'5-Day AA Driveaway Insurance Available From Just £44.99 '
'(Subject To Eligibility) | 10% Off AA Comprehensive Car '
'Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 2,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'id': 'ec6b2267-3eab-5222-8515-ab18b9def79e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603291112748',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Audi',
'model': 'A5',
'odometer': 87731,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg',
'https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg',
'https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg',
'https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg',
'https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg',
'https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg',
'https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg',
'https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg',
'https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg',
'https://m.atcdn.co.uk/a/media/dbc28facf85d470598dfd17fac79c6b1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_760a10fc-c6f3-5696-b7db-951384cc34ab/760a10fc-c6f3-5696-b7db-951384cc34ab_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33424,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dbc28facf85d470598dfd17fac79c6b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38080,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76384,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32158,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29694,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28089,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63190,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39564,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42355,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29431,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg',
'Width': 800}],
'price': 12990,
'price_includes_vat': True,
'registration_date': '2019-12-05',
'seats_number': 4,
'seller_name': None,
'title': 'Audi A5 TDI S LINE 2.0 2dr',
'transmission': 'automatic',
'trim': 'S line',
'year': 2019}
2026-03-30 15:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603291112748%27 HTTP/1.1" 200 None
2026-03-30 15:07:27 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603291112748: {'created_time': 1774883247.809161, 'last_price_update_time': 1774883247.809177}
2026-03-30 15:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603291112748') HTTP/1.1" 204 0
2026-03-30 15:07:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e83e94-0d90-509f-a670-3d862e74f4bf with identifier: 202603291112746
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64e83e94-0d90-509f-a670-3d862e74f4bf
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F04c0948303f6480b9de116d83ff1d276.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb678f5c4b17944f6a01788862b10a8e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc962ad07c08f4098b1a5ac8b654215bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0761a9bcbbaf4aeaae32285689e4dbb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b437fe35e9a49399a64d5fcb86ef9cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54878105cefd4b1dbc9e78672589fda0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43dfc279ab3549939780fc6d4c86309d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe4e83531cc84f61ab5655b61faa4e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd868903c70384a62858e1e0a8ea7c36c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdbc28facf85d470598dfd17fac79c6b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dbc28facf85d470598dfd17fac79c6b1.jpg already downloaded
2026-03-30 15:07:28 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 64e83e94-0d90-509f-a670-3d862e74f4bf with identifier 202603291112746
2026-03-30 15:07:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:28 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 64e83e94-0d90-509f-a670-3d862e74f4bf
2026-03-30 15:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'White',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Ford Focus Zetec '
'TDCI | 1.5 Diesel | 6 Speed Manual | VAT Qualifying | In '
'The Best Colour White | Full HPI Clear | Full Service History '
'With 4 Records | Euro 6, Ulez Compliant | Cheap To Run | Only '
'1 Owner From New | 2 Keys | Will Come With Long MOT Until '
'04/12/2026 | Excellent Spec Including Satellite Navigation, '
'Bluetooth & More | Free Interim Service Carried Out Prior To '
'Sale | Free 3 Months Nationwide Warranty, Free 12 Months '
'Breakdown Cover And £75 Off Your Next Service & MOT With All '
'Of Our Vehicles | Well Looked After Example | Looks And '
'Drives Great 5-Day AA Driveaway Insurance Available From '
'Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £249 Giving You That Added Peace Of Mind (6,12,24 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 118,
'fuel_type': 'Diesel',
'id': '64e83e94-0d90-509f-a670-3d862e74f4bf',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603291112746',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 65599,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg',
'https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg',
'https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg',
'https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg',
'https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg',
'https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg',
'https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg',
'https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg',
'https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg',
'https://m.atcdn.co.uk/a/media/dbc28facf85d470598dfd17fac79c6b1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_760a10fc-c6f3-5696-b7db-951384cc34ab/760a10fc-c6f3-5696-b7db-951384cc34ab_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 33424,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dbc28facf85d470598dfd17fac79c6b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38080,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76384,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32158,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29694,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28089,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63190,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39564,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42355,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29431,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg',
'Width': 800}],
'price': 9890,
'price_includes_vat': True,
'registration_date': '2022-12-05',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus ZETEC TDCI 1.5 5dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2022}
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603291112746%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603291112746: {'created_time': 1774883248.295958, 'last_price_update_time': 1774883248.295969}
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603291112746') HTTP/1.1" 204 0
2026-03-30 15:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 743694dd-9ca5-5d1c-990f-fb62d8ea5bea with identifier: 202603281085223
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 743694dd-9ca5-5d1c-990f-fb62d8ea5bea
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25659d1c04ca43019e64d3c2ef0b9a70.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25659d1c04ca43019e64d3c2ef0b9a70.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F883a1dab0fb04976be26628bc022955c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/883a1dab0fb04976be26628bc022955c.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6a4138ab58d45ee95970232ba8e0cae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6a4138ab58d45ee95970232ba8e0cae.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2652d1469d574a25b7933da9e0e4da50.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2652d1469d574a25b7933da9e0e4da50.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7696b396ce44465aa370d5c2eaa67640.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7696b396ce44465aa370d5c2eaa67640.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F31049781d55e45d7bf48f20c9f3f7ddf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/31049781d55e45d7bf48f20c9f3f7ddf.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32100587d0684febafa7ef4d0249296d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32100587d0684febafa7ef4d0249296d.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0047e36bc28a45298ef47eabea5afed9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0047e36bc28a45298ef47eabea5afed9.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0283b3ba19534a16b01e470a595e4262.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0283b3ba19534a16b01e470a595e4262.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdeae1ed495a3407d818b15e333ce915a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/deae1ed495a3407d818b15e333ce915a.jpg already downloaded
2026-03-30 15:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:28 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 743694dd-9ca5-5d1c-990f-fb62d8ea5bea with identifier 202603281085223
2026-03-30 15:07:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:28 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 743694dd-9ca5-5d1c-990f-fb62d8ea5bea
2026-03-30 15:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'Grey',
'currency': 'GBP',
'description': 'AQ Car Sales Are Proud To Present This Stunning Toyota Rav4 '
'D-4D Invincible AWD | 2.2 Diesel | 6 Speed Manual | Full '
'HPI Clear | Full Toyota Service History With 12 Records, '
'Clutch Replaced At 70k Miles In 23, Gearbox Serviced At 50k & '
'64k Miles | Only 1 Owner From New | 2 Keys | Will Come With '
'12 Months MOT | Well Maintained | Excellent Spec Including '
'Satellite Navigation, Bluetooth & More | Free Interim Service '
'Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection '
'Or Test Drive Welcome | Nationwide Delivery Service Available '
'| Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ** All Major Debit And Credit Cards '
'Accepted | Open 7 Days A Week With No Appointments Necessary '
'| Late Night Viewings Available By Appointment Only | All Of '
'Our Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': '743694dd-9ca5-5d1c-990f-fb62d8ea5bea',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603281085223',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Toyota',
'model': 'RAV4',
'odometer': 96591,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/25659d1c04ca43019e64d3c2ef0b9a70.jpg',
'https://m.atcdn.co.uk/a/media/883a1dab0fb04976be26628bc022955c.jpg',
'https://m.atcdn.co.uk/a/media/c6a4138ab58d45ee95970232ba8e0cae.jpg',
'https://m.atcdn.co.uk/a/media/2652d1469d574a25b7933da9e0e4da50.jpg',
'https://m.atcdn.co.uk/a/media/7696b396ce44465aa370d5c2eaa67640.jpg',
'https://m.atcdn.co.uk/a/media/31049781d55e45d7bf48f20c9f3f7ddf.jpg',
'https://m.atcdn.co.uk/a/media/32100587d0684febafa7ef4d0249296d.jpg',
'https://m.atcdn.co.uk/a/media/0047e36bc28a45298ef47eabea5afed9.jpg',
'https://m.atcdn.co.uk/a/media/0283b3ba19534a16b01e470a595e4262.jpg',
'https://m.atcdn.co.uk/a/media/deae1ed495a3407d818b15e333ce915a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97182,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/25659d1c04ca43019e64d3c2ef0b9a70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94046,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/883a1dab0fb04976be26628bc022955c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103970,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6a4138ab58d45ee95970232ba8e0cae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101463,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2652d1469d574a25b7933da9e0e4da50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98616,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7696b396ce44465aa370d5c2eaa67640.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95524,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/31049781d55e45d7bf48f20c9f3f7ddf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96276,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/32100587d0684febafa7ef4d0249296d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96207,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0047e36bc28a45298ef47eabea5afed9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72377,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0283b3ba19534a16b01e470a595e4262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_743694dd-9ca5-5d1c-990f-fb62d8ea5bea/743694dd-9ca5-5d1c-990f-fb62d8ea5bea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90789,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/deae1ed495a3407d818b15e333ce915a.jpg',
'Width': 800}],
'price': 7490,
'price_includes_vat': True,
'registration_date': '2014-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV4 D-4D INVINCIBLE AWD 2.2',
'transmission': 'manual',
'trim': 'Invincible',
'year': 2014}
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281085223%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603281085223: {'created_time': 1774883248.549565, 'last_price_update_time': 1774883248.549575}
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603281085223') HTTP/1.1" 204 0
2026-03-30 15:07:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f795b322-df6d-5b4e-8909-63cbf5012b91 with identifier: 202603281085222
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f795b322-df6d-5b4e-8909-63cbf5012b91
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F063fa184790d4060a42cd04670b78be6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/063fa184790d4060a42cd04670b78be6.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c1ad8aa7017431295827f869c4dc3ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c1ad8aa7017431295827f869c4dc3ac.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F03949f106bd04d1f9204347695f5a2ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/03949f106bd04d1f9204347695f5a2ea.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8593aab05392475a8fad1080b636c2c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8593aab05392475a8fad1080b636c2c9.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a196f74b1434303b0f350ac09775ea0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a196f74b1434303b0f350ac09775ea0.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F438967fc4ba34b94bdb917fd0c0b7221.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/438967fc4ba34b94bdb917fd0c0b7221.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8802e14448cc4e1aba715e2db92c4f55.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8802e14448cc4e1aba715e2db92c4f55.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F99b52ede3d234667aa41653996a1bd4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/99b52ede3d234667aa41653996a1bd4d.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe4f9f987fec743e989d8329e930dbbae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e4f9f987fec743e989d8329e930dbbae.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b5c9fe46ff74269b938873ca321bb91.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b5c9fe46ff74269b938873ca321bb91.jpg already downloaded
2026-03-30 15:07:28 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f795b322-df6d-5b4e-8909-63cbf5012b91 with identifier 202603281085222
2026-03-30 15:07:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:28 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f795b322-df6d-5b4e-8909-63cbf5012b91
2026-03-30 15:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Blue',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Audi Q3 TDI S Line Edition | 2.0 Diesel | 6 Speed '
'Manual | Full HPI Clear | Excellent Service History With 5 '
'Records, Timing Kit Replaced At 59k Miles In 2023, Clutch Kit '
'Replaced At 80k Miles In 2025 | Euro 6, Ulez Compliant | Only '
'2 Owners From New, Last Keeper Owned Since 2022 | 2 Keys | '
'Will Come With 12 Months MOT | Well Maintained With No '
"Advisories On The Previous 4 MOT's | Excellent Spec Including "
'Satellite Navigation, Bluetooth & More | Free Interim Service '
'Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection '
'Or Test Drive Welcome | Nationwide Delivery Service Available '
'| Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ** All Major Debit And Credit Cards '
'Accepted | Open 7 Days A Week With No Appointments Necessary '
'| Late Night Viewings Available By Appointment Only | All Of '
'Our Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'f795b322-df6d-5b4e-8909-63cbf5012b91',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603281085222',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Audi',
'model': 'Q3',
'odometer': 95775,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/063fa184790d4060a42cd04670b78be6.jpg',
'https://m.atcdn.co.uk/a/media/8c1ad8aa7017431295827f869c4dc3ac.jpg',
'https://m.atcdn.co.uk/a/media/03949f106bd04d1f9204347695f5a2ea.jpg',
'https://m.atcdn.co.uk/a/media/8593aab05392475a8fad1080b636c2c9.jpg',
'https://m.atcdn.co.uk/a/media/8a196f74b1434303b0f350ac09775ea0.jpg',
'https://m.atcdn.co.uk/a/media/438967fc4ba34b94bdb917fd0c0b7221.jpg',
'https://m.atcdn.co.uk/a/media/8802e14448cc4e1aba715e2db92c4f55.jpg',
'https://m.atcdn.co.uk/a/media/99b52ede3d234667aa41653996a1bd4d.jpg',
'https://m.atcdn.co.uk/a/media/e4f9f987fec743e989d8329e930dbbae.jpg',
'https://m.atcdn.co.uk/a/media/1b5c9fe46ff74269b938873ca321bb91.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96806,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/063fa184790d4060a42cd04670b78be6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93743,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c1ad8aa7017431295827f869c4dc3ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103624,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/03949f106bd04d1f9204347695f5a2ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99183,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8593aab05392475a8fad1080b636c2c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97609,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8a196f74b1434303b0f350ac09775ea0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92249,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/438967fc4ba34b94bdb917fd0c0b7221.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100429,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8802e14448cc4e1aba715e2db92c4f55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96613,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/99b52ede3d234667aa41653996a1bd4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71805,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e4f9f987fec743e989d8329e930dbbae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f795b322-df6d-5b4e-8909-63cbf5012b91/f795b322-df6d-5b4e-8909-63cbf5012b91_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87050,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b5c9fe46ff74269b938873ca321bb91.jpg',
'Width': 800}],
'price': 9990,
'price_includes_vat': True,
'registration_date': '2017-08-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 TDI S LINE EDITION 2.0 5dr',
'transmission': 'manual',
'trim': 'S line Edition',
'year': 2017}
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281085222%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603281085222: {'created_time': 1774883248.887868, 'last_price_update_time': 1774883248.887883}
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603281085222') HTTP/1.1" 204 0
2026-03-30 15:07:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d289096-3eb4-5734-8d61-541116670ada with identifier: 202603281085221
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d289096-3eb4-5734-8d61-541116670ada
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e0a006537b041b8a61945ce19810280.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e0a006537b041b8a61945ce19810280.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe4ddcf0abe4b4b3aae22b281ed2a9e32.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e4ddcf0abe4b4b3aae22b281ed2a9e32.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ef48bfdcdc04b5f8b086e69c92173ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ef48bfdcdc04b5f8b086e69c92173ad.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3c673f0a5ed1423890fdf1bad0b1dd5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3c673f0a5ed1423890fdf1bad0b1dd5b.jpg already downloaded
2026-03-30 15:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F678068c717084a57bc1628865645f198.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/678068c717084a57bc1628865645f198.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa002a6d703b54f6386e0ec38fabe33c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a002a6d703b54f6386e0ec38fabe33c5.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F396a1d8931604a8a87d2ecf623bbdbc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/396a1d8931604a8a87d2ecf623bbdbc1.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0cb47fb4211f4007a9452d4e96e6ac69.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0cb47fb4211f4007a9452d4e96e6ac69.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7dc1090ed334ff8bb3a12b4cb8e446e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7dc1090ed334ff8bb3a12b4cb8e446e.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb3b12bc04e54975bd7a054cb639a077.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb3b12bc04e54975bd7a054cb639a077.jpg already downloaded
2026-03-30 15:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:29 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2d289096-3eb4-5734-8d61-541116670ada with identifier 202603281085221
2026-03-30 15:07:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:29 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2d289096-3eb4-5734-8d61-541116670ada
2026-03-30 15:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': 'Grey',
'currency': 'GBP',
'description': 'Cruise In Style In This Exquisite Mercedes C Class C250 '
'BlueTec AMG Line | 2.1 Diesel | Automatic | Full HPI Clear '
'| Excellent Service History With 8 Records | Low Mileage | '
'Euro 6, Ulez Compliant | Only 2 Former Keepers From New, Last '
'Keeper Owned Since 2018 | 2 Keys | Will Come With 12 Months '
'MOT | Very Well Maintained | Excellent Spec Including '
'Satellite Navigation, Bluetooth & More | Free Interim Service '
'Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection '
'Or Test Drive Welcome | Nationwide Delivery Service Available '
'| Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ** All Major Debit And Credit Cards '
'Accepted | Open 7 Days A Week With No Appointments Necessary '
'| Late Night Viewings Available By Appointment Only | All Of '
'Our Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.1L',
'engine_horse_power': 201,
'fuel_type': 'Diesel',
'id': '2d289096-3eb4-5734-8d61-541116670ada',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603281085221',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Mercedes-Benz',
'model': 'C Class',
'odometer': 75293,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/2e0a006537b041b8a61945ce19810280.jpg',
'https://m.atcdn.co.uk/a/media/e4ddcf0abe4b4b3aae22b281ed2a9e32.jpg',
'https://m.atcdn.co.uk/a/media/4ef48bfdcdc04b5f8b086e69c92173ad.jpg',
'https://m.atcdn.co.uk/a/media/3c673f0a5ed1423890fdf1bad0b1dd5b.jpg',
'https://m.atcdn.co.uk/a/media/678068c717084a57bc1628865645f198.jpg',
'https://m.atcdn.co.uk/a/media/a002a6d703b54f6386e0ec38fabe33c5.jpg',
'https://m.atcdn.co.uk/a/media/396a1d8931604a8a87d2ecf623bbdbc1.jpg',
'https://m.atcdn.co.uk/a/media/0cb47fb4211f4007a9452d4e96e6ac69.jpg',
'https://m.atcdn.co.uk/a/media/c7dc1090ed334ff8bb3a12b4cb8e446e.jpg',
'https://m.atcdn.co.uk/a/media/eb3b12bc04e54975bd7a054cb639a077.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103705,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e0a006537b041b8a61945ce19810280.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99609,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e4ddcf0abe4b4b3aae22b281ed2a9e32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108118,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ef48bfdcdc04b5f8b086e69c92173ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102574,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3c673f0a5ed1423890fdf1bad0b1dd5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102191,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/678068c717084a57bc1628865645f198.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101329,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a002a6d703b54f6386e0ec38fabe33c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105496,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/396a1d8931604a8a87d2ecf623bbdbc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100518,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0cb47fb4211f4007a9452d4e96e6ac69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78046,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7dc1090ed334ff8bb3a12b4cb8e446e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d289096-3eb4-5734-8d61-541116670ada/2d289096-3eb4-5734-8d61-541116670ada_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91272,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eb3b12bc04e54975bd7a054cb639a077.jpg',
'Width': 800}],
'price': 10990,
'price_includes_vat': True,
'registration_date': '2014-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C Class C250 BLUETEC AMG LINE 2.2 4dr',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2014}
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281085221%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603281085221: {'created_time': 1774883249.153122, 'last_price_update_time': 1774883249.153134}
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603281085221') HTTP/1.1" 204 0
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Page: 3/3, total results: 46
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510217312850%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510217312850: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510086984451%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510086984451: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510016774252%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510016774252: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509196469354%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509196469354: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509196469352%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509196469352: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202408243230944%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202408243230944: 1
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 6 detail requests (batch 1)
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:29 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2 with identifier: 202602039644347
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa89bcbdac2a6445f8f307c1fe1a60781.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a89bcbdac2a6445f8f307c1fe1a60781.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9eb0f2a63b0e48cfb419ca4fce0c0515.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9eb0f2a63b0e48cfb419ca4fce0c0515.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ecf1586d55c429fae024e914f22306e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ecf1586d55c429fae024e914f22306e.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b8f3384b270488db0a1d1e6d2608b14.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b8f3384b270488db0a1d1e6d2608b14.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb20d8fc80f9c4d84a633d76e771f0a41.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b20d8fc80f9c4d84a633d76e771f0a41.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0c5bbf3236b49bf9c26b5c96992255f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0c5bbf3236b49bf9c26b5c96992255f.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fee3c3477c08642cdb54272e6a4a132b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ee3c3477c08642cdb54272e6a4a132b9.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd15137738a6d4a0abbcdaf9e84e66e94.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d15137738a6d4a0abbcdaf9e84e66e94.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F038683c438694f54ad6f4ed7486b9cbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/038683c438694f54ad6f4ed7486b9cbb.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F67819cd8eccc45dfbd1f6eaad2702ae5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/67819cd8eccc45dfbd1f6eaad2702ae5.jpg already downloaded
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:29 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b057278-d7aa-51e3-b961-39c770eae47e with identifier: 202603250981324
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b057278-d7aa-51e3-b961-39c770eae47e
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78d60275c797419ea5f73f72d1226fe9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78d60275c797419ea5f73f72d1226fe9.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F59eb39a1f6634750bd8959feba221c98.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/59eb39a1f6634750bd8959feba221c98.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6576ebdf010d446088fdd4aaeba92f4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6576ebdf010d446088fdd4aaeba92f4c.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbff139a0a2bd44cfa20689ea39fdc292.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bff139a0a2bd44cfa20689ea39fdc292.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F08d983cb10d44a4394459c40241fa21d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/08d983cb10d44a4394459c40241fa21d.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7ab66bc7cf348c7bf042332dc1c95a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7ab66bc7cf348c7bf042332dc1c95a0.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6168cb056efc4d7bb60589276d084cb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6168cb056efc4d7bb60589276d084cb0.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F832f0eee027948cbb2fdb2dda4f68a00.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/832f0eee027948cbb2fdb2dda4f68a00.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F766a75a90b8d4f82a0c1a631bf43e1d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/766a75a90b8d4f82a0c1a631bf43e1d1.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7e0ae4081b74171856f0aa0dfb7e370.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7e0ae4081b74171856f0aa0dfb7e370.jpg already downloaded
2026-03-30 15:07:29 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2 with identifier 202602039644347
2026-03-30 15:07:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:29 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2
2026-03-30 15:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Grey',
'currency': 'GBP',
'description': 'Cruise In Style In This Exquisite Alfa Romeo Giulia TB Super '
'| 2.0 Petrol | Automatic | Full HPI Clear | Good Service '
'History With 4 Records | Euro 6, Ulez Compliant | Only 2 '
'Former Keepers From New | 2 Keys | Will Come With 12 Months '
'MOT | Well Maintained | Excellent Spec Including Satellite '
'Navigation, Bluetooth, Cruise Control & More | Free Interim '
'Service Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Rear Parking Sensors ++ Full Leather '
'Interior With Matching Accent Trim ++ Keyless Start ++ '
'Satellite Navigation ++ DAB Radio ++ Bluetooth ++ USB/AUX ++ '
'Adjustable Drive Modes ++ Cruise Control ++ Dual Climate '
'Control ++ Stop/Start System ++ Multi-functional Steering '
'Wheel ++ Electric Parking Brake ++ Automatic Headlights & '
'Windscreen Wipers ++ Electric Wing Mirrors ++ ** All Major '
'Debit And Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 197,
'fuel_type': 'Petrol',
'id': 'bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602039644347',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 60552,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/a89bcbdac2a6445f8f307c1fe1a60781.jpg',
'https://m.atcdn.co.uk/a/media/9eb0f2a63b0e48cfb419ca4fce0c0515.jpg',
'https://m.atcdn.co.uk/a/media/4ecf1586d55c429fae024e914f22306e.jpg',
'https://m.atcdn.co.uk/a/media/7b8f3384b270488db0a1d1e6d2608b14.jpg',
'https://m.atcdn.co.uk/a/media/b20d8fc80f9c4d84a633d76e771f0a41.jpg',
'https://m.atcdn.co.uk/a/media/b0c5bbf3236b49bf9c26b5c96992255f.jpg',
'https://m.atcdn.co.uk/a/media/ee3c3477c08642cdb54272e6a4a132b9.jpg',
'https://m.atcdn.co.uk/a/media/d15137738a6d4a0abbcdaf9e84e66e94.jpg',
'https://m.atcdn.co.uk/a/media/038683c438694f54ad6f4ed7486b9cbb.jpg',
'https://m.atcdn.co.uk/a/media/67819cd8eccc45dfbd1f6eaad2702ae5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98212,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a89bcbdac2a6445f8f307c1fe1a60781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98229,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9eb0f2a63b0e48cfb419ca4fce0c0515.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104592,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ecf1586d55c429fae024e914f22306e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102806,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7b8f3384b270488db0a1d1e6d2608b14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99521,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b20d8fc80f9c4d84a633d76e771f0a41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96989,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0c5bbf3236b49bf9c26b5c96992255f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101884,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee3c3477c08642cdb54272e6a4a132b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100341,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d15137738a6d4a0abbcdaf9e84e66e94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72246,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/038683c438694f54ad6f4ed7486b9cbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2/bfe9ffc7-f008-59fe-b1d8-201c7d19f5d2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79106,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/67819cd8eccc45dfbd1f6eaad2702ae5.jpg',
'Width': 800}],
'price': 11990,
'price_includes_vat': True,
'registration_date': '2017-03-01',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulia TB SUPER 2.0 4dr',
'transmission': 'automatic',
'trim': 'Super',
'year': 2017}
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039644347%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602039644347: {'created_time': 1774883249.698087, 'last_price_update_time': 1774883249.698103}
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039644347') HTTP/1.1" 204 0
2026-03-30 15:07:29 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6b057278-d7aa-51e3-b961-39c770eae47e with identifier 202603250981324
2026-03-30 15:07:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:29 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6b057278-d7aa-51e3-b961-39c770eae47e
2026-03-30 15:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'Red',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Mitsubishi Eclipse Cross First Edition | 1.5 Petrol '
'| Automatic | 4WD | Full HPI Clear | Good Service History '
'With 4 Records | Euro 6, Ulez Compliant | Cheap To Run | Only '
'1 Owner From New! | 2 Keys | Will Come With Long MOT Until '
'31/01/2027 | Well Maintained | Excellent Spec Including '
'Reverse Parking Camera, Full Leather Interior, Bluetooth & '
'More | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great '
'5-Day AA Driveaway Insurance Available From Just £44.99 '
'(Subject To Eligibility) | 10% Off AA Comprehensive Car '
'Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 161,
'fuel_type': 'Petrol',
'id': '6b057278-d7aa-51e3-b961-39c770eae47e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250981324',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Mitsubishi',
'model': 'Eclipse Cross',
'odometer': 72694,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photo_urls': ['https://m.atcdn.co.uk/a/media/78d60275c797419ea5f73f72d1226fe9.jpg',
'https://m.atcdn.co.uk/a/media/59eb39a1f6634750bd8959feba221c98.jpg',
'https://m.atcdn.co.uk/a/media/6576ebdf010d446088fdd4aaeba92f4c.jpg',
'https://m.atcdn.co.uk/a/media/bff139a0a2bd44cfa20689ea39fdc292.jpg',
'https://m.atcdn.co.uk/a/media/08d983cb10d44a4394459c40241fa21d.jpg',
'https://m.atcdn.co.uk/a/media/c7ab66bc7cf348c7bf042332dc1c95a0.jpg',
'https://m.atcdn.co.uk/a/media/6168cb056efc4d7bb60589276d084cb0.jpg',
'https://m.atcdn.co.uk/a/media/832f0eee027948cbb2fdb2dda4f68a00.jpg',
'https://m.atcdn.co.uk/a/media/766a75a90b8d4f82a0c1a631bf43e1d1.jpg',
'https://m.atcdn.co.uk/a/media/c7e0ae4081b74171856f0aa0dfb7e370.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100820,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/78d60275c797419ea5f73f72d1226fe9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95934,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/59eb39a1f6634750bd8959feba221c98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105688,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6576ebdf010d446088fdd4aaeba92f4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99368,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bff139a0a2bd44cfa20689ea39fdc292.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101342,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/08d983cb10d44a4394459c40241fa21d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89148,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7ab66bc7cf348c7bf042332dc1c95a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99733,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6168cb056efc4d7bb60589276d084cb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97318,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/832f0eee027948cbb2fdb2dda4f68a00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74659,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/766a75a90b8d4f82a0c1a631bf43e1d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b057278-d7aa-51e3-b961-39c770eae47e/6b057278-d7aa-51e3-b961-39c770eae47e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76519,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7e0ae4081b74171856f0aa0dfb7e370.jpg',
'Width': 800}],
'price': 10690,
'price_includes_vat': True,
'registration_date': '2018-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Eclipse Cross FIRST EDITION 1.5 5dr',
'transmission': 'automatic',
'trim': 'First Edition',
'year': 2018}
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250981324%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250981324: {'created_time': 1774883249.746372, 'last_price_update_time': 1774883249.746384}
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250981324') HTTP/1.1" 204 0
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:29 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d5756a96-5659-56c3-add3-7858e53fde42 with identifier: 202601289490000
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5756a96-5659-56c3-add3-7858e53fde42
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b4e46667afb47bd99e02e73dcaeb69a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b4e46667afb47bd99e02e73dcaeb69a.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9872887c40aa4095b8a4cde816c0897d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9872887c40aa4095b8a4cde816c0897d.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98c58d071fa148d5a884fa05cb097961.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98c58d071fa148d5a884fa05cb097961.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd008dc5f4bcb4688931aea8ccaca4b29.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d008dc5f4bcb4688931aea8ccaca4b29.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa12359e6ff943a1ac3b110cc24cd23c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa12359e6ff943a1ac3b110cc24cd23c.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa3419004e3994ab4afc7a788c3ec98e2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a3419004e3994ab4afc7a788c3ec98e2.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5db32f74fc9f4cc1a4be2d731a3af290.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5db32f74fc9f4cc1a4be2d731a3af290.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F592b1e2723b74ce5b35f8dc0b5376c4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/592b1e2723b74ce5b35f8dc0b5376c4d.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa52188dee98242c3bec96a03a7460207.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a52188dee98242c3bec96a03a7460207.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40f2759f03cf42edbdd25b223b2bdc66.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40f2759f03cf42edbdd25b223b2bdc66.jpg already downloaded
2026-03-30 15:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:29 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f513183-1c95-5e23-914c-67d6234ab243 with identifier: 202603250981323
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f513183-1c95-5e23-914c-67d6234ab243
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89e0039790e54a0f93c3b92e3de3b57c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89e0039790e54a0f93c3b92e3de3b57c.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2568e97bb1c42bba1aa9b70aace851f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2568e97bb1c42bba1aa9b70aace851f.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fce91159ef8f24ae7994dc26a90419b67.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ce91159ef8f24ae7994dc26a90419b67.jpg already downloaded
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b82dc9489f0421fadc88c95998ee06d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b82dc9489f0421fadc88c95998ee06d.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e0bc7712345450cafbe2e9c9e990a20.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e0bc7712345450cafbe2e9c9e990a20.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1c7f337f235e4aae98f2f963cd7777ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1c7f337f235e4aae98f2f963cd7777ab.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F47865e6237ec4909bcd976ea04a8f50a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/47865e6237ec4909bcd976ea04a8f50a.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e88caf7e0fc4ca0a6603e8f35c996aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e88caf7e0fc4ca0a6603e8f35c996aa.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3aca873f6684420580943a9e20487447.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3aca873f6684420580943a9e20487447.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa04f487e67984d44aeeaf3e5f9e5c3f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a04f487e67984d44aeeaf3e5f9e5c3f3.jpg already downloaded
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d5756a96-5659-56c3-add3-7858e53fde42 with identifier 202601289490000
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d5756a96-5659-56c3-add3-7858e53fde42
2026-03-30 15:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'Red',
'currency': 'GBP',
'description': 'Here We Have A Stunning Example Of A Mercedes A Class A180 D '
'AMG Line Premium | 1.5 Diesel | 6 Speed Manual | Full HPI '
'Clear | Excellent Service History With 7 Records | Euro 6, '
'Ulez Compliant | Cheap To Run With Only £20 Road Tax! | Only '
'2 Former Keepers From New, Last Keeper Owned Since 2023 | 2 '
'Keys | Will Come With 12 Months MOT | Well Maintained | '
'Excellent Spec Including Half Leather, Half Alcantara '
'Interior With Heated Extendable Front Seats, Reverse Parking '
'Camera, Satellite Navigation & More | Free Interim Service '
'Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Reverse Parking Camera ++ Front & Rear '
'Parking Sensors ++ Half Leather, Half Alcantara Interior With '
'Extendable Heated Front seats ++ Satellite Navigation ++ '
'Bluetooth ++ CD Player/USB ++ Dual Climate Control ++ Dynamic '
'Select ++ Stop/Start System ++ Multi-functional Steering '
'Wheel ++ Electric Parking Brake ++ Automatic Headlights & '
'Windscreen Wipers ++ Electric Wing Mirrors ++ Isofix Anchor '
'Points ++ ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': 'd5756a96-5659-56c3-add3-7858e53fde42',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289490000',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Mercedes-Benz',
'model': 'A Class',
'odometer': 87055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 53,
'photo_urls': ['https://m.atcdn.co.uk/a/media/1b4e46667afb47bd99e02e73dcaeb69a.jpg',
'https://m.atcdn.co.uk/a/media/9872887c40aa4095b8a4cde816c0897d.jpg',
'https://m.atcdn.co.uk/a/media/98c58d071fa148d5a884fa05cb097961.jpg',
'https://m.atcdn.co.uk/a/media/d008dc5f4bcb4688931aea8ccaca4b29.jpg',
'https://m.atcdn.co.uk/a/media/fa12359e6ff943a1ac3b110cc24cd23c.jpg',
'https://m.atcdn.co.uk/a/media/a3419004e3994ab4afc7a788c3ec98e2.jpg',
'https://m.atcdn.co.uk/a/media/5db32f74fc9f4cc1a4be2d731a3af290.jpg',
'https://m.atcdn.co.uk/a/media/592b1e2723b74ce5b35f8dc0b5376c4d.jpg',
'https://m.atcdn.co.uk/a/media/a52188dee98242c3bec96a03a7460207.jpg',
'https://m.atcdn.co.uk/a/media/40f2759f03cf42edbdd25b223b2bdc66.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101543,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b4e46667afb47bd99e02e73dcaeb69a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103643,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9872887c40aa4095b8a4cde816c0897d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109844,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98c58d071fa148d5a884fa05cb097961.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104433,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d008dc5f4bcb4688931aea8ccaca4b29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103512,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa12359e6ff943a1ac3b110cc24cd23c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99044,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a3419004e3994ab4afc7a788c3ec98e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106284,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5db32f74fc9f4cc1a4be2d731a3af290.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101867,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/592b1e2723b74ce5b35f8dc0b5376c4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81609,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a52188dee98242c3bec96a03a7460207.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5756a96-5659-56c3-add3-7858e53fde42/d5756a96-5659-56c3-add3-7858e53fde42_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92744,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/40f2759f03cf42edbdd25b223b2bdc66.jpg',
'Width': 800}],
'price': 8990,
'price_includes_vat': True,
'registration_date': '2016-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A Class A 180 D AMG LINE PREMIUM 1.5 5dr',
'transmission': 'manual',
'trim': 'AMG Line',
'year': 2016}
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289490000%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289490000: {'created_time': 1774883250.169182, 'last_price_update_time': 1774883250.169195}
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289490000') HTTP/1.1" 204 0
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6f513183-1c95-5e23-914c-67d6234ab243 with identifier 202603250981323
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6f513183-1c95-5e23-914c-67d6234ab243
2026-03-30 15:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 100,
'color': 'Blue',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Dacia Logan Stepway '
'Laureate DCI | 1.5 Diesel | Manual | Full HPI Clear | '
'Full Service History With 7 Records, Timing Kit & Water Pump '
'Replaced In 2023 | Euro 6, Ulez Compliant | Cheap To Run | '
'Only 1 Owner From New! | 2 Keys | Will Come With Long MOT '
'Until 01/10/2026 | Well Maintained With No Advisories On The '
"Previous 2 MOT's | Excellent Spec Including Bluetooth, Cruise "
'Control & More | Free Interim Service Carried Out Prior To '
'Sale | Free 3 Months Nationwide Warranty, Free 12 Months '
'Breakdown Cover And £75 Off Your Next Service & MOT With All '
'Of Our Vehicles | Well Looked After Example | Looks And '
'Drives Great 5-Day AA Driveaway Insurance Available From '
'Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £249 Giving You That Added Peace Of Mind (6,12,24 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 89,
'fuel_type': 'Diesel',
'id': '6f513183-1c95-5e23-914c-67d6234ab243',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250981323',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Dacia',
'model': 'Logan MCV Stepway',
'odometer': 110172,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 49,
'photo_urls': ['https://m.atcdn.co.uk/a/media/89e0039790e54a0f93c3b92e3de3b57c.jpg',
'https://m.atcdn.co.uk/a/media/d2568e97bb1c42bba1aa9b70aace851f.jpg',
'https://m.atcdn.co.uk/a/media/ce91159ef8f24ae7994dc26a90419b67.jpg',
'https://m.atcdn.co.uk/a/media/6b82dc9489f0421fadc88c95998ee06d.jpg',
'https://m.atcdn.co.uk/a/media/2e0bc7712345450cafbe2e9c9e990a20.jpg',
'https://m.atcdn.co.uk/a/media/1c7f337f235e4aae98f2f963cd7777ab.jpg',
'https://m.atcdn.co.uk/a/media/47865e6237ec4909bcd976ea04a8f50a.jpg',
'https://m.atcdn.co.uk/a/media/6e88caf7e0fc4ca0a6603e8f35c996aa.jpg',
'https://m.atcdn.co.uk/a/media/3aca873f6684420580943a9e20487447.jpg',
'https://m.atcdn.co.uk/a/media/a04f487e67984d44aeeaf3e5f9e5c3f3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99385,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/89e0039790e54a0f93c3b92e3de3b57c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98403,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2568e97bb1c42bba1aa9b70aace851f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103474,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ce91159ef8f24ae7994dc26a90419b67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99090,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b82dc9489f0421fadc88c95998ee06d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102444,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e0bc7712345450cafbe2e9c9e990a20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94398,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1c7f337f235e4aae98f2f963cd7777ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99985,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/47865e6237ec4909bcd976ea04a8f50a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97779,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6e88caf7e0fc4ca0a6603e8f35c996aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69310,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3aca873f6684420580943a9e20487447.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f513183-1c95-5e23-914c-67d6234ab243/6f513183-1c95-5e23-914c-67d6234ab243_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77328,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a04f487e67984d44aeeaf3e5f9e5c3f3.jpg',
'Width': 800}],
'price': 4690,
'price_includes_vat': True,
'registration_date': '2018-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Logan STEPWAY LAUREATE DCI 1.5 5dr',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2018}
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250981323%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250981323: {'created_time': 1774883250.278785, 'last_price_update_time': 1774883250.278795}
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250981323') HTTP/1.1" 204 0
2026-03-30 15:07:30 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:30 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6775cf10-8385-5325-a5b2-f79d7dbde512 with identifier: 202601239373871
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6775cf10-8385-5325-a5b2-f79d7dbde512
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffd281a24ecbf41739eaf6f50f1cc2106.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fd281a24ecbf41739eaf6f50f1cc2106.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0febed0531dc40568c433bf2cd85752e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0febed0531dc40568c433bf2cd85752e.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F030bc455394f4aac926204266568e394.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/030bc455394f4aac926204266568e394.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F59528cdff15b4f98919c7a5069809a92.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/59528cdff15b4f98919c7a5069809a92.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7ba01d5740c2487f9ccd53390854696f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7ba01d5740c2487f9ccd53390854696f.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffefcd79641ef4a21bf4b393a7ebed9ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fefcd79641ef4a21bf4b393a7ebed9ed.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffc0fb9c4f2da4a06adc44a8edf771cec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fc0fb9c4f2da4a06adc44a8edf771cec.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80811afab034499d8130a8766176ac0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80811afab034499d8130a8766176ac0e.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8543c15e9d314ff58ada9adb0edbe859.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8543c15e9d314ff58ada9adb0edbe859.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd3d444416d854be2b445300c1e6930ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d3d444416d854be2b445300c1e6930ff.jpg already downloaded
2026-03-30 15:07:30 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:30 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb with identifier: 202603240966135
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4869d90d8b464c5a992804deafb4977f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4869d90d8b464c5a992804deafb4977f.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8edf0d8cb02f47c98e72c5b61cf04c09.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8edf0d8cb02f47c98e72c5b61cf04c09.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb73be24438eb4e4aa0a6964941509612.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b73be24438eb4e4aa0a6964941509612.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd36e0b0ee41a4df69d1802621e24aff3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d36e0b0ee41a4df69d1802621e24aff3.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7179a75d3c54fadbe90b627e59e849b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7179a75d3c54fadbe90b627e59e849b.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F877fdd9998a84e99a69487092d2c5799.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/877fdd9998a84e99a69487092d2c5799.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ca1343e88184c16b243b220ed9d2984.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ca1343e88184c16b243b220ed9d2984.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe376d4c3cdd449b7b3113d9610589cf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e376d4c3cdd449b7b3113d9610589cf3.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c3393dd103842f39af1060e133213e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c3393dd103842f39af1060e133213e0.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F12761e1bf0a44de3a177610caf612830.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/12761e1bf0a44de3a177610caf612830.jpg already downloaded
2026-03-30 15:07:30 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:30 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a760cbd2-b35a-5222-bc77-eedb8a3efb6f with identifier: 202603240966142
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a760cbd2-b35a-5222-bc77-eedb8a3efb6f
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79719cd627f5446f97c56697dc85b0c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79719cd627f5446f97c56697dc85b0c2.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F50319322401f4cdfaa8f7ede64968d5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/50319322401f4cdfaa8f7ede64968d5c.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d794f91784a4029954a7337d5db9e95.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d794f91784a4029954a7337d5db9e95.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a9eb2ca4f444d59b7d5de64ded9e48a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a9eb2ca4f444d59b7d5de64ded9e48a.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbabc51057ee2407794d15864f036b2de.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/babc51057ee2407794d15864f036b2de.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F541d9e9a79a34914a38343b3bbe0dcf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/541d9e9a79a34914a38343b3bbe0dcf2.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F70a07f840f3d433dbd6fac5c62e91ae4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/70a07f840f3d433dbd6fac5c62e91ae4.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62d8d007c9834230b90e8eeb833a4117.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62d8d007c9834230b90e8eeb833a4117.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6b0c8c9f4e34d7db5f07931d4e1af5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6b0c8c9f4e34d7db5f07931d4e1af5e.jpg already downloaded
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ebff9eca23d4b16ab7015573b914194.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ebff9eca23d4b16ab7015573b914194.jpg already downloaded
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6775cf10-8385-5325-a5b2-f79d7dbde512 with identifier 202601239373871
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6775cf10-8385-5325-a5b2-f79d7dbde512
2026-03-30 15:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 90,
'color': 'Blue',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Peugeot 208 Blue HDI Allure '
'| 1.6 Diesel | Manual | Full HPI Clear | Very Low Mileage '
'| Euro 6, Ulez Compliant | Cheap To Run With Only £20 Road '
'Tax! | Only 2 Owners Keepers From New, Last Keeper Owned '
'Since 2017 | 2 Keys | Will Come With Long MOT Until '
'13/10/2026 | Excellent Spec Including Parking Sensors, '
'Bluetooth & More | Free 3 Months Nationwide Warranty, Free 12 '
'Months Breakdown Cover And £75 Off Your Next Service & MOT '
'With All Of Our Vehicles | Well Looked After Example | Looks '
'And Drives Great 5-Day AA Driveaway Insurance Available '
'From Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £249 Giving You That Added Peace Of Mind (6,12,24 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ++ Rear Parking Sensors ++ Bluetooth ++ DAB Radio ++ '
'MirrorLink ++ Apple CarPlay ++ USB/AUX ++ Cruise Control With '
'Speed Limiter ++ Multi-functional Steering Wheel ++ Automatic '
'Headlights & Windscreen Wipers ++ Rear Privacy Windows ++ '
'Electric Wing Mirrors ++ Daytime Running Lights ++ Spare '
'Wheel ++ ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 98,
'fuel_type': 'Diesel',
'id': '6775cf10-8385-5325-a5b2-f79d7dbde512',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601239373871',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Peugeot',
'model': '208',
'odometer': 32322,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/fd281a24ecbf41739eaf6f50f1cc2106.jpg',
'https://m.atcdn.co.uk/a/media/0febed0531dc40568c433bf2cd85752e.jpg',
'https://m.atcdn.co.uk/a/media/030bc455394f4aac926204266568e394.jpg',
'https://m.atcdn.co.uk/a/media/59528cdff15b4f98919c7a5069809a92.jpg',
'https://m.atcdn.co.uk/a/media/7ba01d5740c2487f9ccd53390854696f.jpg',
'https://m.atcdn.co.uk/a/media/fefcd79641ef4a21bf4b393a7ebed9ed.jpg',
'https://m.atcdn.co.uk/a/media/fc0fb9c4f2da4a06adc44a8edf771cec.jpg',
'https://m.atcdn.co.uk/a/media/80811afab034499d8130a8766176ac0e.jpg',
'https://m.atcdn.co.uk/a/media/8543c15e9d314ff58ada9adb0edbe859.jpg',
'https://m.atcdn.co.uk/a/media/d3d444416d854be2b445300c1e6930ff.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110081,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fd281a24ecbf41739eaf6f50f1cc2106.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104212,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0febed0531dc40568c433bf2cd85752e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112532,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/030bc455394f4aac926204266568e394.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110297,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/59528cdff15b4f98919c7a5069809a92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112495,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7ba01d5740c2487f9ccd53390854696f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101411,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fefcd79641ef4a21bf4b393a7ebed9ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113743,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fc0fb9c4f2da4a06adc44a8edf771cec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107602,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/80811afab034499d8130a8766176ac0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79367,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8543c15e9d314ff58ada9adb0edbe859.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6775cf10-8385-5325-a5b2-f79d7dbde512/6775cf10-8385-5325-a5b2-f79d7dbde512_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48436,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d3d444416d854be2b445300c1e6930ff.jpg',
'Width': 800}],
'price': 6990,
'price_includes_vat': True,
'registration_date': '2016-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 BLUE HDI ALLURE 1.6 5dr',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239373871%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601239373871: {'created_time': 1774883250.928816, 'last_price_update_time': 1774883250.928826}
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239373871') HTTP/1.1" 204 0
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb with identifier 202603240966135
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb
2026-03-30 15:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Blue',
'currency': 'GBP',
'description': 'Here We Have A Stunning Example Of A Jaguar XF D Luxury | 2.2 '
'Diesel | Automatic | Full HPI Clear | Great Service History '
'With 6 Records | Low Mileage | Only 3 Former Keepers From New '
'| 2 Keys | Will Come With 12 Months MOT | Excellent Spec '
'Including Full Leather Interior With Heated Front Seats, '
'Satellite Navigation, Reverse Parking Camera & More | Free '
'Interim Service Carried Out Prior To Sale | Free 3 Months '
'Nationwide Warranty, Free 12 Months Breakdown Cover And £75 '
'Off Your Next Service & MOT With All Of Our Vehicles | Well '
'Looked After Example | Looks And Drives Great 5-Day AA '
'Driveaway Insurance Available From Just £44.99 (Subject To '
'Eligibility) | 10% Off AA Comprehensive Car Insurance Any '
'Inspection Or Test Drive Welcome | Nationwide Delivery '
'Service Available | Viewing Is Highly Recommended | Upgraded '
'Warranty Cover Is Available From Only £249 Giving You That '
'Added Peace Of Mind (6,12,24 Month Covers Available) | '
'Competitive Prices Paid For Part Exchanges | All Of Our '
'Vehicles Are HPI Checked And Mileage Checked ++ Reverse '
'Parking Camera ++ Front & Rear Parking Sensors ++ Keyless '
'Start ++ Full Leather Interior With Heated Front Seats ++ '
'Satellite Navigation ++ DAB Radio ++ Bluetooth ++ CD '
'Player/USB/AUX ++ Cruise Control With Speed Limiter ++ Dual '
'Climate Control ++ Multi-functional Steering Wheel ++ '
'Electric Parking Brake ++ Automatic Headlights & Windscreen '
'Wipers ++ Electric Wing Mirrors ++ Spare Wheel ++ ** All '
'Major Debit And Credit Cards Accepted | Open 7 Days A Week '
'With No Appointments Necessary | Late Night Viewings '
'Available By Appointment Only | All Of Our Cars Are Ready To '
'Drive Away Today | Call Our Sales Team Today on 01709 925272 '
'To Arrange A Test Drive | Leave A Deposit To Secure This '
'Vehicle Today**',
'doors_number': 4,
'emission_standard': 'Euro 5',
'engine': '2.2L',
'engine_horse_power': 197,
'fuel_type': 'Diesel',
'id': '50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240966135',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Jaguar',
'model': 'XF',
'odometer': 76431,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4869d90d8b464c5a992804deafb4977f.jpg',
'https://m.atcdn.co.uk/a/media/8edf0d8cb02f47c98e72c5b61cf04c09.jpg',
'https://m.atcdn.co.uk/a/media/b73be24438eb4e4aa0a6964941509612.jpg',
'https://m.atcdn.co.uk/a/media/d36e0b0ee41a4df69d1802621e24aff3.jpg',
'https://m.atcdn.co.uk/a/media/c7179a75d3c54fadbe90b627e59e849b.jpg',
'https://m.atcdn.co.uk/a/media/877fdd9998a84e99a69487092d2c5799.jpg',
'https://m.atcdn.co.uk/a/media/4ca1343e88184c16b243b220ed9d2984.jpg',
'https://m.atcdn.co.uk/a/media/e376d4c3cdd449b7b3113d9610589cf3.jpg',
'https://m.atcdn.co.uk/a/media/8c3393dd103842f39af1060e133213e0.jpg',
'https://m.atcdn.co.uk/a/media/12761e1bf0a44de3a177610caf612830.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96875,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4869d90d8b464c5a992804deafb4977f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101874,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8edf0d8cb02f47c98e72c5b61cf04c09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102782,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b73be24438eb4e4aa0a6964941509612.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100995,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d36e0b0ee41a4df69d1802621e24aff3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100256,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7179a75d3c54fadbe90b627e59e849b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100459,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/877fdd9998a84e99a69487092d2c5799.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101609,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ca1343e88184c16b243b220ed9d2984.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100708,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e376d4c3cdd449b7b3113d9610589cf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74699,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c3393dd103842f39af1060e133213e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb/50f1be0f-a223-5ef8-8dd0-baf5ed8fabfb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95613,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/12761e1bf0a44de3a177610caf612830.jpg',
'Width': 800}],
'price': 6990,
'price_includes_vat': True,
'registration_date': '2015-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar XF D LUXURY 2.2 4dr',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2015}
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966135%27 HTTP/1.1" 200 None
2026-03-30 15:07:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240966135: {'created_time': 1774883250.970424, 'last_price_update_time': 1774883250.970434}
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240966135') HTTP/1.1" 204 0
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a760cbd2-b35a-5222-bc77-eedb8a3efb6f with identifier 202603240966142
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a760cbd2-b35a-5222-bc77-eedb8a3efb6f
2026-03-30 15:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'White',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Vauxhall Corsa '
'Limited Edition ECOFlex S/S | 1.0 Petrol | 6 Speed Manual | '
'In The Best Colour White | Full HPI Clear | Very Low Mileage '
'With Full Service History Containing 7 Records | Euro 6, Ulez '
'Compliant | Cheap To Run With Only £35 Road Tax! | Only 2 '
'Owners From New, Last Keeper Owned Since 2019 | 2 Keys | Will '
'Come With 12 Months MOT | Excellent Spec Including Bluetooth '
'& More | Free Interim Service Carried Out Prior To Sale | '
'Free 3 Months Nationwide Warranty, Free 12 Months Breakdown '
'Cover And £75 Off Your Next Service & MOT With All Of Our '
'Vehicles | Well Looked After Example | Looks And Drives '
'Great 5-Day AA Driveaway Insurance Available From Just '
'£44.99 (Subject To Eligibility) | 10% Off AA Comprehensive '
'Car Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 113,
'fuel_type': 'Petrol',
'id': 'a760cbd2-b35a-5222-bc77-eedb8a3efb6f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240966142',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 38718,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/79719cd627f5446f97c56697dc85b0c2.jpg',
'https://m.atcdn.co.uk/a/media/50319322401f4cdfaa8f7ede64968d5c.jpg',
'https://m.atcdn.co.uk/a/media/6d794f91784a4029954a7337d5db9e95.jpg',
'https://m.atcdn.co.uk/a/media/4a9eb2ca4f444d59b7d5de64ded9e48a.jpg',
'https://m.atcdn.co.uk/a/media/babc51057ee2407794d15864f036b2de.jpg',
'https://m.atcdn.co.uk/a/media/541d9e9a79a34914a38343b3bbe0dcf2.jpg',
'https://m.atcdn.co.uk/a/media/70a07f840f3d433dbd6fac5c62e91ae4.jpg',
'https://m.atcdn.co.uk/a/media/62d8d007c9834230b90e8eeb833a4117.jpg',
'https://m.atcdn.co.uk/a/media/f6b0c8c9f4e34d7db5f07931d4e1af5e.jpg',
'https://m.atcdn.co.uk/a/media/4ebff9eca23d4b16ab7015573b914194.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87785,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79719cd627f5446f97c56697dc85b0c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87611,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/50319322401f4cdfaa8f7ede64968d5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90155,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d794f91784a4029954a7337d5db9e95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90227,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a9eb2ca4f444d59b7d5de64ded9e48a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88557,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/babc51057ee2407794d15864f036b2de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81166,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/541d9e9a79a34914a38343b3bbe0dcf2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89621,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/70a07f840f3d433dbd6fac5c62e91ae4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87850,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62d8d007c9834230b90e8eeb833a4117.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80975,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f6b0c8c9f4e34d7db5f07931d4e1af5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a760cbd2-b35a-5222-bc77-eedb8a3efb6f/a760cbd2-b35a-5222-bc77-eedb8a3efb6f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80807,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ebff9eca23d4b16ab7015573b914194.jpg',
'Width': 800}],
'price': 7790,
'price_includes_vat': True,
'registration_date': '2016-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Corsa Limited Edition ECOFlex S/S 1.0 5dr',
'transmission': 'manual',
'trim': 'Limited Edition',
'year': 2016}
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966142%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240966142: {'created_time': 1774883251.015552, 'last_price_update_time': 1774883251.015561}
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240966142') HTTP/1.1" 204 0
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c9f77a3e-c5e6-5037-8a20-96f79beb53a5 with identifier: 202601209286701
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9f77a3e-c5e6-5037-8a20-96f79beb53a5
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F859987d28c6e4bb7a6e48896744dfafc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/859987d28c6e4bb7a6e48896744dfafc.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd147a64c9a0748a8b6d618eae71d58d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d147a64c9a0748a8b6d618eae71d58d4.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9500545d4d594bea9420d8832188f37a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9500545d4d594bea9420d8832188f37a.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09defc7fdf814f60abf11d0c5abac2b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09defc7fdf814f60abf11d0c5abac2b4.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ebb7fe5b2354585bc6ea3f9a0f3131b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ebb7fe5b2354585bc6ea3f9a0f3131b.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00611d8b57164bf08567a9554cddd0ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00611d8b57164bf08567a9554cddd0ef.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f912670584642fd84bec39cb92fd640.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f912670584642fd84bec39cb92fd640.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4518ebb15fa84405b9ee13d0aa595dfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4518ebb15fa84405b9ee13d0aa595dfc.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb22e8d3d1dbf46a5bc818264875d8489.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b22e8d3d1dbf46a5bc818264875d8489.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc66100eb4bb40389839180930dbcf90.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc66100eb4bb40389839180930dbcf90.jpg already downloaded
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b3762b02-a356-5e31-9c9b-034a46541496 with identifier: 202603240966131
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3762b02-a356-5e31-9c9b-034a46541496
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ea4bc9ce5d24a81af9d54756824d7dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ea4bc9ce5d24a81af9d54756824d7dc.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbf82556857124f0cac3075d5e47ef682.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bf82556857124f0cac3075d5e47ef682.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b97dd1722ce4292ab0cce0ff516b6ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b97dd1722ce4292ab0cce0ff516b6ee.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9052a8fcd4634a1db12ad4b9862cfe31.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9052a8fcd4634a1db12ad4b9862cfe31.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc68f0b1afd4d4a98a1aa8226a861aae7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c68f0b1afd4d4a98a1aa8226a861aae7.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb34e1ed611dd4896adb32aa24eddf26b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b34e1ed611dd4896adb32aa24eddf26b.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69ca02c627fc48b0a9be61f3c0ca0c2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69ca02c627fc48b0a9be61f3c0ca0c2b.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F055381705fb14c22a1992d3275bbc1bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/055381705fb14c22a1992d3275bbc1bf.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fce86ad53eba3406a8bcdd845bb9d9311.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ce86ad53eba3406a8bcdd845bb9d9311.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F562c02fb48f5406990d155e21ac4b4c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/562c02fb48f5406990d155e21ac4b4c3.jpg already downloaded
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 982ff97e-7b59-52c8-b5e6-60340dc34c7b with identifier: 202603240966140
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 982ff97e-7b59-52c8-b5e6-60340dc34c7b
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83b00fe147554ceea7190a23ad3615a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83b00fe147554ceea7190a23ad3615a6.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ce29fdc2fba419bac58b883796af254.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ce29fdc2fba419bac58b883796af254.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd3bb1b7e120f44acb0e14d4fb4f7577e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d3bb1b7e120f44acb0e14d4fb4f7577e.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F055a3739c0204af383dadb55fac588d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/055a3739c0204af383dadb55fac588d2.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0637ef0eadf43928ccac73e695b230a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0637ef0eadf43928ccac73e695b230a.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f3d7254a6db49c39f10a96122f449f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f3d7254a6db49c39f10a96122f449f6.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F274f7b5426544da1b149e0d03ce1bd1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/274f7b5426544da1b149e0d03ce1bd1f.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20efa6d57d1641b989792fafa87cc159.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20efa6d57d1641b989792fafa87cc159.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd9a032ceec84d0bb806ed0ef253c782.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd9a032ceec84d0bb806ed0ef253c782.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faaef4a4e90d44743b56433715ae2d99e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aaef4a4e90d44743b56433715ae2d99e.jpg already downloaded
2026-03-30 15:07:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c9f77a3e-c5e6-5037-8a20-96f79beb53a5 with identifier 202601209286701
2026-03-30 15:07:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c9f77a3e-c5e6-5037-8a20-96f79beb53a5
2026-03-30 15:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 104,
'color': 'Red',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Nissan Juke Bose Personal Edition DCI | 1.5 Diesel | '
'6 Speed Manual | Full HPI Clear | Full Service History With '
'7 Records! | Low Mileage | Euro 6, Ulez Compliant | Only 2 '
'Former Keepers From New, Last Keeper Owned Since 2020 | Will '
'Come With Long MOT Until 12/08/2026 | Well Maintained | '
'Excellent Spec Including Reverse Parking Camera, Satellite '
'Navigation, Bluetooth, Cruise Control & More | Free Interim '
'Service Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Reverse Parking Camera ++ Keyless Entry '
'++ Satellite Navigation ++ Bluetooth ++ DAB Radio ++ CD '
'Player/USB/AUX ++ Cruise Control With Speed Limiter ++ '
'Stop/Start System ++ Adjustable Drive Modes ++ '
'Multi-functional Steering Wheel ++ Automatic Headlights & '
'Windscreen Wipers ++ Electric Auto Folding Wing Mirrors ++ '
'Tyre Pressure Monitor System ++ Isofix Anchor Points ++ ** '
'All Major Debit And Credit Cards Accepted | Open 7 Days A '
'Week With No Appointments Necessary | Late Night Viewings '
'Available By Appointment Only | All Of Our Cars Are Ready To '
'Drive Away Today | Call Our Sales Team Today on 01709 925272 '
'To Arrange A Test Drive | Leave A Deposit To Secure This '
'Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 108,
'fuel_type': 'Diesel',
'id': 'c9f77a3e-c5e6-5037-8a20-96f79beb53a5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601209286701',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Nissan',
'model': 'Juke',
'odometer': 40742,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photo_urls': ['https://m.atcdn.co.uk/a/media/859987d28c6e4bb7a6e48896744dfafc.jpg',
'https://m.atcdn.co.uk/a/media/d147a64c9a0748a8b6d618eae71d58d4.jpg',
'https://m.atcdn.co.uk/a/media/9500545d4d594bea9420d8832188f37a.jpg',
'https://m.atcdn.co.uk/a/media/09defc7fdf814f60abf11d0c5abac2b4.jpg',
'https://m.atcdn.co.uk/a/media/0ebb7fe5b2354585bc6ea3f9a0f3131b.jpg',
'https://m.atcdn.co.uk/a/media/00611d8b57164bf08567a9554cddd0ef.jpg',
'https://m.atcdn.co.uk/a/media/8f912670584642fd84bec39cb92fd640.jpg',
'https://m.atcdn.co.uk/a/media/4518ebb15fa84405b9ee13d0aa595dfc.jpg',
'https://m.atcdn.co.uk/a/media/b22e8d3d1dbf46a5bc818264875d8489.jpg',
'https://m.atcdn.co.uk/a/media/cc66100eb4bb40389839180930dbcf90.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103632,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/859987d28c6e4bb7a6e48896744dfafc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100395,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d147a64c9a0748a8b6d618eae71d58d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109682,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9500545d4d594bea9420d8832188f37a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102948,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09defc7fdf814f60abf11d0c5abac2b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108851,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0ebb7fe5b2354585bc6ea3f9a0f3131b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102309,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/00611d8b57164bf08567a9554cddd0ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104457,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f912670584642fd84bec39cb92fd640.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102209,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4518ebb15fa84405b9ee13d0aa595dfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74700,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b22e8d3d1dbf46a5bc818264875d8489.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9f77a3e-c5e6-5037-8a20-96f79beb53a5/c9f77a3e-c5e6-5037-8a20-96f79beb53a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75072,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cc66100eb4bb40389839180930dbcf90.jpg',
'Width': 800}],
'price': 8290,
'price_includes_vat': True,
'registration_date': '2018-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke BOSE PERSONAL EDITION DCI 1.5 5dr',
'transmission': 'manual',
'trim': 'Bose Personal Edition',
'year': 2018}
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209286701%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601209286701: {'created_time': 1774883251.573399, 'last_price_update_time': 1774883251.573409}
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601209286701') HTTP/1.1" 204 0
2026-03-30 15:07:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b3762b02-a356-5e31-9c9b-034a46541496 with identifier 202603240966131
2026-03-30 15:07:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b3762b02-a356-5e31-9c9b-034a46541496
2026-03-30 15:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Blue',
'currency': 'GBP',
'description': 'AQ Car Sales Are Proud To Present This Stunning Skoda Enyaq '
'60 | Electric | Automatic | Full HPI Clear | Excellent '
'Service History | Euro 6, Ulez Compliant | Cheap To Run | '
'Only 1 Owner From New! | 2 Keys | Will Come With Long MOT '
'Until 24/01/2027 | Well Maintained | Excellent Spec Including '
'Satellite Navigation, Lane Assist, Bluetooth & More | Free 3 '
'Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great '
'5-Day AA Driveaway Insurance Available From Just £44.99 '
'(Subject To Eligibility) | 10% Off AA Comprehensive Car '
'Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'engine_horse_power': 177,
'fuel_type': 'Electric',
'id': 'b3762b02-a356-5e31-9c9b-034a46541496',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240966131',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Skoda',
'model': 'Enyaq',
'odometer': 82974,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://m.atcdn.co.uk/a/media/2ea4bc9ce5d24a81af9d54756824d7dc.jpg',
'https://m.atcdn.co.uk/a/media/bf82556857124f0cac3075d5e47ef682.jpg',
'https://m.atcdn.co.uk/a/media/3b97dd1722ce4292ab0cce0ff516b6ee.jpg',
'https://m.atcdn.co.uk/a/media/9052a8fcd4634a1db12ad4b9862cfe31.jpg',
'https://m.atcdn.co.uk/a/media/c68f0b1afd4d4a98a1aa8226a861aae7.jpg',
'https://m.atcdn.co.uk/a/media/b34e1ed611dd4896adb32aa24eddf26b.jpg',
'https://m.atcdn.co.uk/a/media/69ca02c627fc48b0a9be61f3c0ca0c2b.jpg',
'https://m.atcdn.co.uk/a/media/055381705fb14c22a1992d3275bbc1bf.jpg',
'https://m.atcdn.co.uk/a/media/ce86ad53eba3406a8bcdd845bb9d9311.jpg',
'https://m.atcdn.co.uk/a/media/562c02fb48f5406990d155e21ac4b4c3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100849,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ea4bc9ce5d24a81af9d54756824d7dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96128,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bf82556857124f0cac3075d5e47ef682.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103988,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b97dd1722ce4292ab0cce0ff516b6ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101582,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9052a8fcd4634a1db12ad4b9862cfe31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100144,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c68f0b1afd4d4a98a1aa8226a861aae7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96616,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b34e1ed611dd4896adb32aa24eddf26b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101742,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/69ca02c627fc48b0a9be61f3c0ca0c2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101237,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/055381705fb14c22a1992d3275bbc1bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75898,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ce86ad53eba3406a8bcdd845bb9d9311.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3762b02-a356-5e31-9c9b-034a46541496/b3762b02-a356-5e31-9c9b-034a46541496_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76327,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/562c02fb48f5406990d155e21ac4b4c3.jpg',
'Width': 800}],
'price': 11990,
'price_includes_vat': True,
'registration_date': '2022-01-25',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Enyaq 60 5dr',
'transmission': 'automatic',
'trim': '60',
'year': 2022}
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966131%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240966131: {'created_time': 1774883251.641172, 'last_price_update_time': 1774883251.64118}
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240966131') HTTP/1.1" 204 0
2026-03-30 15:07:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 982ff97e-7b59-52c8-b5e6-60340dc34c7b with identifier 202603240966140
2026-03-30 15:07:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 982ff97e-7b59-52c8-b5e6-60340dc34c7b
2026-03-30 15:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'White',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Skoda Rapid Spaceback SE Tech TSI | 1.2 Petrol | 6 '
'Speed Manual | In The Best Colour White | Full HPI Clear | '
'Great Service History With 5 Records | Ideal First Car With '
'Low Mileage | Euro 6, Ulez Compliant | Cheap To Run With Only '
'£35 Road Tax | Only 2 Owners From New, Last Keeper Owned '
'Since 2019 | 2 Keys | Will Come With 12 Months MOT | '
'Excellent Spec Including Satellite Navigation, Bluetooth & '
'More | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great 5-Day '
'AA Driveaway Insurance Available From Just £44.99 (Subject To '
'Eligibility) | 10% Off AA Comprehensive Car Insurance Any '
'Inspection Or Test Drive Welcome | Nationwide Delivery '
'Service Available | Viewing Is Highly Recommended | Upgraded '
'Warranty Cover Is Available From Only £249 Giving You That '
'Added Peace Of Mind (6,12,24 Month Covers Available) | '
'Competitive Prices Paid For Part Exchanges | All Of Our '
'Vehicles Are HPI Checked And Mileage Checked ** All Major '
'Debit And Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 108,
'fuel_type': 'Petrol',
'id': '982ff97e-7b59-52c8-b5e6-60340dc34c7b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240966140',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 75670,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/83b00fe147554ceea7190a23ad3615a6.jpg',
'https://m.atcdn.co.uk/a/media/5ce29fdc2fba419bac58b883796af254.jpg',
'https://m.atcdn.co.uk/a/media/d3bb1b7e120f44acb0e14d4fb4f7577e.jpg',
'https://m.atcdn.co.uk/a/media/055a3739c0204af383dadb55fac588d2.jpg',
'https://m.atcdn.co.uk/a/media/e0637ef0eadf43928ccac73e695b230a.jpg',
'https://m.atcdn.co.uk/a/media/0f3d7254a6db49c39f10a96122f449f6.jpg',
'https://m.atcdn.co.uk/a/media/274f7b5426544da1b149e0d03ce1bd1f.jpg',
'https://m.atcdn.co.uk/a/media/20efa6d57d1641b989792fafa87cc159.jpg',
'https://m.atcdn.co.uk/a/media/cd9a032ceec84d0bb806ed0ef253c782.jpg',
'https://m.atcdn.co.uk/a/media/aaef4a4e90d44743b56433715ae2d99e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87391,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/83b00fe147554ceea7190a23ad3615a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90279,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5ce29fdc2fba419bac58b883796af254.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91994,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d3bb1b7e120f44acb0e14d4fb4f7577e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95214,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/055a3739c0204af383dadb55fac588d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91161,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0637ef0eadf43928ccac73e695b230a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86481,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f3d7254a6db49c39f10a96122f449f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92785,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/274f7b5426544da1b149e0d03ce1bd1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90795,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/20efa6d57d1641b989792fafa87cc159.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64766,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd9a032ceec84d0bb806ed0ef253c782.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_982ff97e-7b59-52c8-b5e6-60340dc34c7b/982ff97e-7b59-52c8-b5e6-60340dc34c7b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84908,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aaef4a4e90d44743b56433715ae2d99e.jpg',
'Width': 800}],
'price': 5590,
'price_includes_vat': True,
'registration_date': '2016-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Rapid Spaceback SE Tech TSI 1.2 5dr',
'transmission': 'manual',
'trim': 'SE Tech',
'year': 2016}
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966140%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240966140: {'created_time': 1774883251.688371, 'last_price_update_time': 1774883251.688383}
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240966140') HTTP/1.1" 204 0
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea29b7b-b1a9-567f-9f93-86092737634f with identifier: 202601139113135
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ea29b7b-b1a9-567f-9f93-86092737634f
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3dd1abb1c8a842edbefa4fe0f6b1db35.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3dd1abb1c8a842edbefa4fe0f6b1db35.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1989d2a5a497441f8fe8ed17782ccbdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1989d2a5a497441f8fe8ed17782ccbdb.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F373c810208414955873f40577e2ebde5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/373c810208414955873f40577e2ebde5.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7784ae1478124e53aa6410fac524fe48.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7784ae1478124e53aa6410fac524fe48.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F57731e42aeab4b03839caa22f42d1109.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/57731e42aeab4b03839caa22f42d1109.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55a1928e3651434ea0f2c0c6b92600f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55a1928e3651434ea0f2c0c6b92600f9.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5706f32c9a864de5bbe141e86b538cb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5706f32c9a864de5bbe141e86b538cb9.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8322b4fb00364361b2bfa8907e9d9871.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8322b4fb00364361b2bfa8907e9d9871.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa4413282cc914d7eb7e0b03aca5df900.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a4413282cc914d7eb7e0b03aca5df900.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5a21f899b5c8451ba62b430b8b26ee0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5a21f899b5c8451ba62b430b8b26ee0e.jpg already downloaded
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d with identifier: 202603240946249
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8bb6fc22a33540b7a31abbe857805008.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8bb6fc22a33540b7a31abbe857805008.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30485c74b012464e8199f4a70e12ec63.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30485c74b012464e8199f4a70e12ec63.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb3b93194eb084c799710cf70489864a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b3b93194eb084c799710cf70489864a7.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed7398036ec349888a3abbb375cc8b0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed7398036ec349888a3abbb375cc8b0b.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8d8da8f292b4c8aaa6229e206972f2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8d8da8f292b4c8aaa6229e206972f2a.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc4c2b755b2e42948b8c0cb421c18e6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc4c2b755b2e42948b8c0cb421c18e6e.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F33735fcd594046839b5b85828e0a6711.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/33735fcd594046839b5b85828e0a6711.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb60e31c59a524c37b620dab1ffd02abe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b60e31c59a524c37b620dab1ffd02abe.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F87ed115baa7d4d41bc2c9a0ac6057671.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/87ed115baa7d4d41bc2c9a0ac6057671.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1a3689c9c9994031b2a3f796b4688b29.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1a3689c9c9994031b2a3f796b4688b29.jpg already downloaded
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e04e8d6e-1b21-59f8-94b8-9df5403218f8 with identifier: 202603240966138
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e04e8d6e-1b21-59f8-94b8-9df5403218f8
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc61263ba98084fccb07ebb865be067b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c61263ba98084fccb07ebb865be067b2.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fda11d5a86b61457aa99a488f29252915.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/da11d5a86b61457aa99a488f29252915.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60996251e7cc4bc69ce13425211e4a1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60996251e7cc4bc69ce13425211e4a1c.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2615f069aae042fbb13f41651f8af85f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2615f069aae042fbb13f41651f8af85f.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F806281b7defc4062aea01eae93142460.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/806281b7defc4062aea01eae93142460.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F086293d1af4c4de189103c8fa13a3c21.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/086293d1af4c4de189103c8fa13a3c21.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa880af44af974aca8a63436a4207a8fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a880af44af974aca8a63436a4207a8fb.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbef7def2e2044bde890dd0c526423065.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bef7def2e2044bde890dd0c526423065.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7c03675785914910a3c5cc5f6a341e3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7c03675785914910a3c5cc5f6a341e3e.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39b1002a2b694e2dacac1a92eaac2fdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39b1002a2b694e2dacac1a92eaac2fdf.jpg already downloaded
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9ea29b7b-b1a9-567f-9f93-86092737634f with identifier 202601139113135
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9ea29b7b-b1a9-567f-9f93-86092737634f
2026-03-30 15:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'White',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Kia Sportage CRDI '
'2 ISG | 1.6 Diesel Hybrid | 6 Speed Manual | In The Best '
'Colour White | Full HPI Clear | Full Service History With 8 '
'Records | Euro 6, Ulez Compliant | Only 2 Owners From New, '
'Last Keeper Owned Since 2022 | 2 Keys | Will Come With MOT '
'Until 12/02/2027 | Well Maintained With No Advisories On Any '
"Previous MOT's | Excellent Spec Including Reverse Parking "
'Camera & Sensors, Heated Front Seats, Apple CarPlay & Andriod '
'Auto & More | Free Interim Service Carried Out Prior To Sale '
'| Free 3 Months Nationwide Warranty, Free 12 Months Breakdown '
'Cover And £75 Off Your Next Service & MOT With All Of Our '
'Vehicles | Well Looked After Example | Looks And Drives '
'Great 5-Day AA Driveaway Insurance Available From Just '
'£44.99 (Subject To Eligibility) | 10% Off AA Comprehensive '
'Car Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ++ Rear Parking Camera & Sensors ++ Heated Front '
'Seats ++ Apple CarPlay & Andriod Auto ++ Satellite Navigation '
'Capabilities ++ Bluetooth ++ DAB Radio ++ Dual Climate '
'Control ++ Lane Assist ++ Cruise Control With Speed Limiter '
'++ Stop/start System ++ Mutli-functional Steering Wheel ++ '
'Automatic Headlights & Windscreen Wipers ++ Retractable '
'Parcel Shelf ++ Electric Auto Folding Wing Mirrors ++ Isofix '
'Anchor Points ++ Spare Wheel ++ ** All Major Debit And '
'Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 134,
'fuel_type': 'Diesel Hybrid',
'id': '9ea29b7b-b1a9-567f-9f93-86092737634f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601139113135',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Kia',
'model': 'Sportage',
'odometer': 80362,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3dd1abb1c8a842edbefa4fe0f6b1db35.jpg',
'https://m.atcdn.co.uk/a/media/1989d2a5a497441f8fe8ed17782ccbdb.jpg',
'https://m.atcdn.co.uk/a/media/373c810208414955873f40577e2ebde5.jpg',
'https://m.atcdn.co.uk/a/media/7784ae1478124e53aa6410fac524fe48.jpg',
'https://m.atcdn.co.uk/a/media/57731e42aeab4b03839caa22f42d1109.jpg',
'https://m.atcdn.co.uk/a/media/55a1928e3651434ea0f2c0c6b92600f9.jpg',
'https://m.atcdn.co.uk/a/media/5706f32c9a864de5bbe141e86b538cb9.jpg',
'https://m.atcdn.co.uk/a/media/8322b4fb00364361b2bfa8907e9d9871.jpg',
'https://m.atcdn.co.uk/a/media/a4413282cc914d7eb7e0b03aca5df900.jpg',
'https://m.atcdn.co.uk/a/media/5a21f899b5c8451ba62b430b8b26ee0e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92954,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3dd1abb1c8a842edbefa4fe0f6b1db35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97546,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1989d2a5a497441f8fe8ed17782ccbdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105135,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/373c810208414955873f40577e2ebde5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103220,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7784ae1478124e53aa6410fac524fe48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89896,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/57731e42aeab4b03839caa22f42d1109.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89739,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55a1928e3651434ea0f2c0c6b92600f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95719,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5706f32c9a864de5bbe141e86b538cb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101141,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8322b4fb00364361b2bfa8907e9d9871.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76856,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a4413282cc914d7eb7e0b03aca5df900.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ea29b7b-b1a9-567f-9f93-86092737634f/9ea29b7b-b1a9-567f-9f93-86092737634f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88464,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5a21f899b5c8451ba62b430b8b26ee0e.jpg',
'Width': 800}],
'price': 9990,
'price_includes_vat': True,
'registration_date': '2019-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Sportage CRDI 2 ISG 1.6 5dr',
'transmission': 'manual',
'trim': '2',
'year': 2019}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601139113135%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601139113135: {'created_time': 1774883252.34722, 'last_price_update_time': 1774883252.347229}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601139113135') HTTP/1.1" 204 0
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d with identifier 202603240946249
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d
2026-03-30 15:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'Grey',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Toyota CHR Dynamic | 1.8 Petrol Hybrid | Automatic '
'| Full HPI Clear | Service History With 3 Records | Euro '
'6, Ulez Compliant | Cheap To Run | Only 1 Former Keepers From '
'New | 2 Keys | Will Come With 12 Months MOT | Excellent Spec '
'Including Full Leather Interior, Satellite Navigation, '
'Bluetooth & More | Free Interim Service Carried Out Prior To '
'Sale | Free 3 Months Nationwide Warranty, Free 12 Months '
'Breakdown Cover And £75 Off Your Next Service & MOT With All '
'Of Our Vehicles | Well Looked After Example | Looks And '
'Drives Great 5-Day AA Driveaway Insurance Available From '
'Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £249 Giving You That Added Peace Of Mind (6,12,24 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.8L',
'engine_horse_power': 120,
'fuel_type': 'Petrol Hybrid',
'id': '7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240946249',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 93657,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8bb6fc22a33540b7a31abbe857805008.jpg',
'https://m.atcdn.co.uk/a/media/30485c74b012464e8199f4a70e12ec63.jpg',
'https://m.atcdn.co.uk/a/media/b3b93194eb084c799710cf70489864a7.jpg',
'https://m.atcdn.co.uk/a/media/ed7398036ec349888a3abbb375cc8b0b.jpg',
'https://m.atcdn.co.uk/a/media/a8d8da8f292b4c8aaa6229e206972f2a.jpg',
'https://m.atcdn.co.uk/a/media/bc4c2b755b2e42948b8c0cb421c18e6e.jpg',
'https://m.atcdn.co.uk/a/media/33735fcd594046839b5b85828e0a6711.jpg',
'https://m.atcdn.co.uk/a/media/b60e31c59a524c37b620dab1ffd02abe.jpg',
'https://m.atcdn.co.uk/a/media/87ed115baa7d4d41bc2c9a0ac6057671.jpg',
'https://m.atcdn.co.uk/a/media/1a3689c9c9994031b2a3f796b4688b29.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98747,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8bb6fc22a33540b7a31abbe857805008.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96139,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/30485c74b012464e8199f4a70e12ec63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98408,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b3b93194eb084c799710cf70489864a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97569,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed7398036ec349888a3abbb375cc8b0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102126,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a8d8da8f292b4c8aaa6229e206972f2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96697,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc4c2b755b2e42948b8c0cb421c18e6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100212,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/33735fcd594046839b5b85828e0a6711.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95515,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b60e31c59a524c37b620dab1ffd02abe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67262,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/87ed115baa7d4d41bc2c9a0ac6057671.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d/7b0dec8c-ead6-535c-a7b6-62e4b2d85e0d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73243,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a3689c9c9994031b2a3f796b4688b29.jpg',
'Width': 800}],
'price': 12490,
'price_includes_vat': True,
'registration_date': '2018-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota CHR DYNAMIC 1.8 5dr',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2018}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240946249%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240946249: {'created_time': 1774883252.404616, 'last_price_update_time': 1774883252.404627}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240946249') HTTP/1.1" 204 0
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e04e8d6e-1b21-59f8-94b8-9df5403218f8 with identifier 202603240966138
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e04e8d6e-1b21-59f8-94b8-9df5403218f8
2026-03-30 15:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'Grey',
'currency': 'GBP',
'description': 'Cruise In Style In This Exquisite BMW X1 SDrive18d SE Auto | '
'2.0 Diesel | Automatic | Full HPI Clear | Very Low '
'Mileage With Good Service History | Euro 6, Ulez Compliant | '
'Only 2 Former Keepers From New, Last Keeper Owned Since 2021 '
'| 2 Keys | Will Come With 12 Months MOT | Well Maintained | '
'Excellent Spec Including Satellite Navigation, Front & Rear '
'Parking Sensors, Bluetooth & More | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection '
'Or Test Drive Welcome | Nationwide Delivery Service Available '
'| Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ** All Major Debit And Credit Cards '
'Accepted | Open 7 Days A Week With No Appointments Necessary '
'| Late Night Viewings Available By Appointment Only | All Of '
'Our Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'e04e8d6e-1b21-59f8-94b8-9df5403218f8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240966138',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'BMW',
'model': 'X1',
'odometer': 42780,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c61263ba98084fccb07ebb865be067b2.jpg',
'https://m.atcdn.co.uk/a/media/da11d5a86b61457aa99a488f29252915.jpg',
'https://m.atcdn.co.uk/a/media/60996251e7cc4bc69ce13425211e4a1c.jpg',
'https://m.atcdn.co.uk/a/media/2615f069aae042fbb13f41651f8af85f.jpg',
'https://m.atcdn.co.uk/a/media/806281b7defc4062aea01eae93142460.jpg',
'https://m.atcdn.co.uk/a/media/086293d1af4c4de189103c8fa13a3c21.jpg',
'https://m.atcdn.co.uk/a/media/a880af44af974aca8a63436a4207a8fb.jpg',
'https://m.atcdn.co.uk/a/media/bef7def2e2044bde890dd0c526423065.jpg',
'https://m.atcdn.co.uk/a/media/7c03675785914910a3c5cc5f6a341e3e.jpg',
'https://m.atcdn.co.uk/a/media/39b1002a2b694e2dacac1a92eaac2fdf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100447,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c61263ba98084fccb07ebb865be067b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99129,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/da11d5a86b61457aa99a488f29252915.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103365,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60996251e7cc4bc69ce13425211e4a1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100629,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2615f069aae042fbb13f41651f8af85f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99518,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/806281b7defc4062aea01eae93142460.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93738,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/086293d1af4c4de189103c8fa13a3c21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100459,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a880af44af974aca8a63436a4207a8fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100105,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bef7def2e2044bde890dd0c526423065.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74854,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7c03675785914910a3c5cc5f6a341e3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e04e8d6e-1b21-59f8-94b8-9df5403218f8/e04e8d6e-1b21-59f8-94b8-9df5403218f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74516,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/39b1002a2b694e2dacac1a92eaac2fdf.jpg',
'Width': 800}],
'price': 12490,
'price_includes_vat': True,
'registration_date': '2017-08-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 SDrive18d SE Auto 2.0 5dr',
'transmission': 'automatic',
'trim': 'SE',
'year': 2017}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240966138%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240966138: {'created_time': 1774883252.450435, 'last_price_update_time': 1774883252.450446}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240966138') HTTP/1.1" 204 0
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ea731575-f116-548c-9249-b3dfa43e9687 with identifier: 202601129085042
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea731575-f116-548c-9249-b3dfa43e9687
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc553ddd029054fdaab54c44c31fed926.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c553ddd029054fdaab54c44c31fed926.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe4edc01f07cb486e9aebeed9e1c45bab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e4edc01f07cb486e9aebeed9e1c45bab.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa13849af63464c21b30318718eaaf140.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a13849af63464c21b30318718eaaf140.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24547ddc1d2943ec934abc66a6d78136.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24547ddc1d2943ec934abc66a6d78136.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F86df00fb634b4d3893cd0a45e9332e0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/86df00fb634b4d3893cd0a45e9332e0d.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde3316d7c7e0458ba08dfef529f194f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de3316d7c7e0458ba08dfef529f194f2.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd25fabf251ea46a38e02dd14ee864da6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d25fabf251ea46a38e02dd14ee864da6.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2a7791b8bdc34b6dbffd65fa09066cba.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2a7791b8bdc34b6dbffd65fa09066cba.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0cd3729c46a84cdf9ff7eaefdbb340eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0cd3729c46a84cdf9ff7eaefdbb340eb.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83b7205dea2a4ca097d9fbadae3d7342.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83b7205dea2a4ca097d9fbadae3d7342.jpg already downloaded
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ba852ba3-1c29-5a37-bff2-f128f9512732 with identifier: 202603200870151
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba852ba3-1c29-5a37-bff2-f128f9512732
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F678c81654ab64845b80a97302eb77744.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/678c81654ab64845b80a97302eb77744.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcb89fb212d024bb3a67754d06fbd4ae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cb89fb212d024bb3a67754d06fbd4ae9.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fffd69ed7c5334028b4475bc9cb36edf0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ffd69ed7c5334028b4475bc9cb36edf0.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7254f2931dce4369ba69c71e444ee20f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7254f2931dce4369ba69c71e444ee20f.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4767d8c190d84a47a062fc3dda96efae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4767d8c190d84a47a062fc3dda96efae.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa7714ad863ae48109f001de93a964967.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a7714ad863ae48109f001de93a964967.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0c26c05d58d4ea4879fc23a762ef2ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0c26c05d58d4ea4879fc23a762ef2ce.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F99f3ed7d2c4141e4a893286b445ab817.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/99f3ed7d2c4141e4a893286b445ab817.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e3c251198284188ad4278efe9bab4b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e3c251198284188ad4278efe9bab4b2.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Facf013ffa69c4004bdb1bf6b206e05dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/acf013ffa69c4004bdb1bf6b206e05dc.jpg already downloaded
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ea731575-f116-548c-9249-b3dfa43e9687 with identifier 202601129085042
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ea731575-f116-548c-9249-b3dfa43e9687
2026-03-30 15:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 185,
'color': 'Red',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Kia Sportage '
'GT-Line ISG | 1.6 Petrol | 6 Speed Manual | Full HPI Clear '
'| Very Low Mileage | Euro 6, Ulez Compliant | Cheap To Run | '
'Only 2 Former Keepers From New | Will Come With Long MOT '
'Until 12/01/2027 | Well Maintained | Huge Spec Including Full '
'Leather Interior With Heated Front & Rear Seats, Reverse '
'Parking Camera & Sensors, Satellite Navigation, Lane Assist & '
'Much More! | Free Interim Service Carried Out Prior To Sale | '
'Free 3 Months Nationwide Warranty, Free 12 Months Breakdown '
'Cover And £75 Off Your Next Service & MOT With All Of Our '
'Vehicles | Well Looked After Example | Looks And Drives '
'Great 5-Day AA Driveaway Insurance Available From Just '
'£44.99 (Subject To Eligibility) | 10% Off AA Comprehensive '
'Car Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ++ Reverse Parking Camera & Sensors ++ Keyless Entry '
'& Start ++ Full Leather Interior With Heated Front & Rear '
'Seats ++ Satellite Navigation ++ DAB Radio ++ Bluetooth ++ '
'Apple CarPlay & Android Auto USB Music & Video ++ Sounds Of '
'Nature ++ Lane Assist ++ Traffic Sign Recognition ++ Cruise '
'Control With Speed Limiter ++ Dual Climate Control ++ '
'Stop/Start System ++ Multi-functional Steering Wheel ++ '
'Automatic Headlights & Windscreen Wipers ++ Electric Auto '
'Folding Wing Mirrors ++ Isofix Anchor Points ++ Retractable '
'Parcel Shelf ++ ** All Major Debit And Credit Cards '
'Accepted | Open 7 Days A Week With No Appointments Necessary '
'| Late Night Viewings Available By Appointment Only | All Of '
'Our Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 174,
'fuel_type': 'Petrol',
'id': 'ea731575-f116-548c-9249-b3dfa43e9687',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601129085042',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Kia',
'model': 'Sportage',
'odometer': 20467,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c553ddd029054fdaab54c44c31fed926.jpg',
'https://m.atcdn.co.uk/a/media/e4edc01f07cb486e9aebeed9e1c45bab.jpg',
'https://m.atcdn.co.uk/a/media/a13849af63464c21b30318718eaaf140.jpg',
'https://m.atcdn.co.uk/a/media/24547ddc1d2943ec934abc66a6d78136.jpg',
'https://m.atcdn.co.uk/a/media/86df00fb634b4d3893cd0a45e9332e0d.jpg',
'https://m.atcdn.co.uk/a/media/de3316d7c7e0458ba08dfef529f194f2.jpg',
'https://m.atcdn.co.uk/a/media/d25fabf251ea46a38e02dd14ee864da6.jpg',
'https://m.atcdn.co.uk/a/media/2a7791b8bdc34b6dbffd65fa09066cba.jpg',
'https://m.atcdn.co.uk/a/media/0cd3729c46a84cdf9ff7eaefdbb340eb.jpg',
'https://m.atcdn.co.uk/a/media/83b7205dea2a4ca097d9fbadae3d7342.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111742,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c553ddd029054fdaab54c44c31fed926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113462,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e4edc01f07cb486e9aebeed9e1c45bab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113683,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a13849af63464c21b30318718eaaf140.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119273,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/24547ddc1d2943ec934abc66a6d78136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114883,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/86df00fb634b4d3893cd0a45e9332e0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103514,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/de3316d7c7e0458ba08dfef529f194f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110965,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d25fabf251ea46a38e02dd14ee864da6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113119,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2a7791b8bdc34b6dbffd65fa09066cba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104830,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0cd3729c46a84cdf9ff7eaefdbb340eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea731575-f116-548c-9249-b3dfa43e9687/ea731575-f116-548c-9249-b3dfa43e9687_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78644,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/83b7205dea2a4ca097d9fbadae3d7342.jpg',
'Width': 800}],
'price': 16490,
'price_includes_vat': True,
'registration_date': '2021-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Sportage GT-LINE ISG 1.6 5dr',
'transmission': 'manual',
'trim': 'GT-Line',
'year': 2021}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601129085042%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601129085042: {'created_time': 1774883252.854578, 'last_price_update_time': 1774883252.854587}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601129085042') HTTP/1.1" 204 0
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ba852ba3-1c29-5a37-bff2-f128f9512732 with identifier 202603200870151
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ba852ba3-1c29-5a37-bff2-f128f9512732
2026-03-30 15:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'Silver',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Mercedes C Class C220D AMG Line | 2.1 Diesel | '
'Automatic | Full HPI Clear | Full Service History With 7 '
'Records | Low Mileage | Euro 6, Ulez Compliant | Only 2 '
'Former Keepers From New | 2 Keys | Will Come With Long MOT '
'Until 23/02/2027 | Well Maintained | Excellent Spec Including '
'Satellite Navigation, Bluetooth, Cruise Control & More | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great '
'5-Day AA Driveaway Insurance Available From Just £44.99 '
'(Subject To Eligibility) | 10% Off AA Comprehensive Car '
'Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.1L',
'engine_horse_power': 168,
'fuel_type': 'Diesel',
'id': 'ba852ba3-1c29-5a37-bff2-f128f9512732',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200870151',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Mercedes-Benz',
'model': 'C Class',
'odometer': 67119,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 53,
'photo_urls': ['https://m.atcdn.co.uk/a/media/678c81654ab64845b80a97302eb77744.jpg',
'https://m.atcdn.co.uk/a/media/cb89fb212d024bb3a67754d06fbd4ae9.jpg',
'https://m.atcdn.co.uk/a/media/ffd69ed7c5334028b4475bc9cb36edf0.jpg',
'https://m.atcdn.co.uk/a/media/7254f2931dce4369ba69c71e444ee20f.jpg',
'https://m.atcdn.co.uk/a/media/4767d8c190d84a47a062fc3dda96efae.jpg',
'https://m.atcdn.co.uk/a/media/a7714ad863ae48109f001de93a964967.jpg',
'https://m.atcdn.co.uk/a/media/a0c26c05d58d4ea4879fc23a762ef2ce.jpg',
'https://m.atcdn.co.uk/a/media/99f3ed7d2c4141e4a893286b445ab817.jpg',
'https://m.atcdn.co.uk/a/media/0e3c251198284188ad4278efe9bab4b2.jpg',
'https://m.atcdn.co.uk/a/media/acf013ffa69c4004bdb1bf6b206e05dc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94771,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/678c81654ab64845b80a97302eb77744.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93242,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cb89fb212d024bb3a67754d06fbd4ae9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100196,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ffd69ed7c5334028b4475bc9cb36edf0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100406,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7254f2931dce4369ba69c71e444ee20f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94781,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4767d8c190d84a47a062fc3dda96efae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93877,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a7714ad863ae48109f001de93a964967.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96899,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0c26c05d58d4ea4879fc23a762ef2ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97780,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/99f3ed7d2c4141e4a893286b445ab817.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74336,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0e3c251198284188ad4278efe9bab4b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba852ba3-1c29-5a37-bff2-f128f9512732/ba852ba3-1c29-5a37-bff2-f128f9512732_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84816,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/acf013ffa69c4004bdb1bf6b206e05dc.jpg',
'Width': 800}],
'price': 12990,
'price_includes_vat': True,
'registration_date': '2017-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C Class C 220 D AMG LINE 2.2 4dr',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200870151%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200870151: {'created_time': 1774883252.90324, 'last_price_update_time': 1774883252.903255}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200870151') HTTP/1.1" 204 0
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d39399ef-9599-5a83-aee3-f1fde06c16dd with identifier: 202512198711982
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d39399ef-9599-5a83-aee3-f1fde06c16dd
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d60f672d22b47f896c3d31520dd88b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d60f672d22b47f896c3d31520dd88b5.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed0a994c3f7e494e919505075c82cb9b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed0a994c3f7e494e919505075c82cb9b.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4686695aa4c948fb963010aaeace23a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4686695aa4c948fb963010aaeace23a7.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2de6294a12b244f7ae873311ec8197a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2de6294a12b244f7ae873311ec8197a6.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fada6499824b141f895869209f749e8f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ada6499824b141f895869209f749e8f9.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ee6513f450a4fceb1ec91640075ff2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ee6513f450a4fceb1ec91640075ff2a.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed41b71e1597408391b9016153446e92.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed41b71e1597408391b9016153446e92.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3201e255170a4d7e89c3a56d392cd33f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3201e255170a4d7e89c3a56d392cd33f.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b518fc8e2cb495691448e3c826560a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b518fc8e2cb495691448e3c826560a6.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd29d3b5b1af444579e91a853ff3b4748.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d29d3b5b1af444579e91a853ff3b4748.jpg already downloaded
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cafb121b-fa54-5493-a9f0-7ad07fa3cd4a with identifier: 202603190838486
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cafb121b-fa54-5493-a9f0-7ad07fa3cd4a
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3324cf7afb4e4a8aac87e59af598a96f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3324cf7afb4e4a8aac87e59af598a96f.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7700448942e45d6b1a615e223e404c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7700448942e45d6b1a615e223e404c3.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd241bf4dcbf448e0a20dda2b337c7fd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d241bf4dcbf448e0a20dda2b337c7fd1.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb00bffd7631c490ca965b9399dcec89d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b00bffd7631c490ca965b9399dcec89d.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fefcc4281dc8f49f6a9c9222ded5ac05c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/efcc4281dc8f49f6a9c9222ded5ac05c.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa45e3696ff64261bdbea86ea5efe461.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa45e3696ff64261bdbea86ea5efe461.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e7b37cea99745539e06ccc98e1a582d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e7b37cea99745539e06ccc98e1a582d.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3fc773885f8445f3bb8636c7ca615e0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3fc773885f8445f3bb8636c7ca615e0e.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90a0b851370449fc8a6b6d2f45b137e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90a0b851370449fc8a6b6d2f45b137e6.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80da75f83e004e32acbd5336a8fbb6ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80da75f83e004e32acbd5336a8fbb6ab.jpg already downloaded
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d39399ef-9599-5a83-aee3-f1fde06c16dd with identifier 202512198711982
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d39399ef-9599-5a83-aee3-f1fde06c16dd
2026-03-30 15:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'White',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Fiat 500 MHEV Dolcevita '
'Plus | 1.0 Petrol Mild Hybrid | 6 Speed Manual | Full HPI '
'Clear | Service History With 3 Records | Euro 6, Ulez '
'Compliant | Cheap To Run | Only 1 Former Keepers From New | '
'Will Come With Long MOT Until 30/10/2026 | Well Maintained '
'With No Advisories On The MOT | Excellent Spec Including '
'Bluetooth, Cruise Control & More | Free Interim Service '
'Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Sunroof ++ Half Leather Interior ++ Rear '
'Parking Sensors ++ Satellite Navigation ++ Bluetooth ++ DAB '
'Radio ++ USB ++ City Driving Mode ++ Multi-functional '
'Steering Wheel ++ Automatic Headlights & Windscreen Wipers ++ '
'Electric Wing Mirrors ++ Isofix Anchor Points ++ ** All '
'Major Debit And Credit Cards Accepted | Open 7 Days A Week '
'With No Appointments Necessary | Late Night Viewings '
'Available By Appointment Only | All Of Our Cars Are Ready To '
'Drive Away Today | Call Our Sales Team Today on 01709 925272 '
'To Arrange A Test Drive | Leave A Deposit To Secure This '
'Vehicle Today**',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 70,
'fuel_type': 'Petrol',
'id': 'd39399ef-9599-5a83-aee3-f1fde06c16dd',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512198711982',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Fiat',
'model': '500',
'odometer': 75677,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0d60f672d22b47f896c3d31520dd88b5.jpg',
'https://m.atcdn.co.uk/a/media/ed0a994c3f7e494e919505075c82cb9b.jpg',
'https://m.atcdn.co.uk/a/media/4686695aa4c948fb963010aaeace23a7.jpg',
'https://m.atcdn.co.uk/a/media/2de6294a12b244f7ae873311ec8197a6.jpg',
'https://m.atcdn.co.uk/a/media/ada6499824b141f895869209f749e8f9.jpg',
'https://m.atcdn.co.uk/a/media/5ee6513f450a4fceb1ec91640075ff2a.jpg',
'https://m.atcdn.co.uk/a/media/ed41b71e1597408391b9016153446e92.jpg',
'https://m.atcdn.co.uk/a/media/3201e255170a4d7e89c3a56d392cd33f.jpg',
'https://m.atcdn.co.uk/a/media/6b518fc8e2cb495691448e3c826560a6.jpg',
'https://m.atcdn.co.uk/a/media/d29d3b5b1af444579e91a853ff3b4748.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101283,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d60f672d22b47f896c3d31520dd88b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99063,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed0a994c3f7e494e919505075c82cb9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108051,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4686695aa4c948fb963010aaeace23a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105272,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2de6294a12b244f7ae873311ec8197a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104357,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ada6499824b141f895869209f749e8f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95625,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5ee6513f450a4fceb1ec91640075ff2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79466,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed41b71e1597408391b9016153446e92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67044,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3201e255170a4d7e89c3a56d392cd33f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76864,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b518fc8e2cb495691448e3c826560a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d39399ef-9599-5a83-aee3-f1fde06c16dd/d39399ef-9599-5a83-aee3-f1fde06c16dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79028,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d29d3b5b1af444579e91a853ff3b4748.jpg',
'Width': 800}],
'price': 7390,
'price_includes_vat': True,
'registration_date': '2022-10-31',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 DOLCEVITA PLUS 1.0 3dr',
'transmission': 'manual',
'trim': 'Dolcevita Plus',
'year': 2022}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512198711982%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512198711982: {'created_time': 1774883253.328045, 'last_price_update_time': 1774883253.328057}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512198711982') HTTP/1.1" 204 0
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cafb121b-fa54-5493-a9f0-7ad07fa3cd4a with identifier 202603190838486
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cafb121b-fa54-5493-a9f0-7ad07fa3cd4a
2026-03-30 15:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': 'Here We Have A Stunning Example Of An Audi A4 TDI Ultra Se | '
'2.0 Diesel | Manual | Full HPI Clear | Service History With '
'5 Records | Euro 6, Ulez Compliant | Cheap To Run With Only '
'£20 Road Tax! | Only 2 Owners From New, Last Owner Owned '
'Since 2020 | 2 Keys | Will Come With 12 Months MOT | '
'Excellent Spec Including Front & Rear Parking Sensors, '
'Satellite Navigation, Bluetooth & More | Free Interim Service '
'Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Front & Rear Parking Sensors ++ Keyless '
'Start ++ Extendable Front Seats ++ Satellite Navigation ++ '
'Bluetooth ++ DAB Radio ++ CD Player/USB/AUX ++ Audi Drive '
'Select ++ Audi Pre Sense ++ 3-Zone Climate Control ++ Cruise '
'Control With Speed Limiter ++ Stop/Start System ++ '
'Multi-functional Steering Wheel ++ Electric Parking Brake ++ '
'Automatic Headlights & Windscreen Wipers ++ Isofix Anchor '
'Points ++ Electric Heated Wing Mirrors ++ ** All Major '
'Debit And Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'cafb121b-fa54-5493-a9f0-7ad07fa3cd4a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190838486',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Audi',
'model': 'A4',
'odometer': 83597,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 57,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3324cf7afb4e4a8aac87e59af598a96f.jpg',
'https://m.atcdn.co.uk/a/media/b7700448942e45d6b1a615e223e404c3.jpg',
'https://m.atcdn.co.uk/a/media/d241bf4dcbf448e0a20dda2b337c7fd1.jpg',
'https://m.atcdn.co.uk/a/media/b00bffd7631c490ca965b9399dcec89d.jpg',
'https://m.atcdn.co.uk/a/media/efcc4281dc8f49f6a9c9222ded5ac05c.jpg',
'https://m.atcdn.co.uk/a/media/fa45e3696ff64261bdbea86ea5efe461.jpg',
'https://m.atcdn.co.uk/a/media/4e7b37cea99745539e06ccc98e1a582d.jpg',
'https://m.atcdn.co.uk/a/media/3fc773885f8445f3bb8636c7ca615e0e.jpg',
'https://m.atcdn.co.uk/a/media/90a0b851370449fc8a6b6d2f45b137e6.jpg',
'https://m.atcdn.co.uk/a/media/80da75f83e004e32acbd5336a8fbb6ab.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110947,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3324cf7afb4e4a8aac87e59af598a96f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112088,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7700448942e45d6b1a615e223e404c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117199,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d241bf4dcbf448e0a20dda2b337c7fd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116940,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b00bffd7631c490ca965b9399dcec89d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115378,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/efcc4281dc8f49f6a9c9222ded5ac05c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111701,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa45e3696ff64261bdbea86ea5efe461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112393,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e7b37cea99745539e06ccc98e1a582d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113326,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3fc773885f8445f3bb8636c7ca615e0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75471,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/90a0b851370449fc8a6b6d2f45b137e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cafb121b-fa54-5493-a9f0-7ad07fa3cd4a/cafb121b-fa54-5493-a9f0-7ad07fa3cd4a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81076,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/80da75f83e004e32acbd5336a8fbb6ab.jpg',
'Width': 800}],
'price': 8790,
'price_includes_vat': True,
'registration_date': '2016-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 TDI ULTRA SE 2.0 4dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2016}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190838486%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190838486: {'created_time': 1774883253.37424, 'last_price_update_time': 1774883253.374252}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190838486') HTTP/1.1" 204 0
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 78de597c-e15b-503a-91e7-c387a5805d56 with identifier: 202512138572546
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78de597c-e15b-503a-91e7-c387a5805d56
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80c038f52a024ad1917ae425316181c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80c038f52a024ad1917ae425316181c5.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9f439c452a54f13add8024a6288cdbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9f439c452a54f13add8024a6288cdbb.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa5bb093fffeb4307969be1baf82dd7fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a5bb093fffeb4307969be1baf82dd7fa.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffae1100592be4d8c9aadac93e587ae7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fae1100592be4d8c9aadac93e587ae7c.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a2cdf8d6ee74271b37144f2d672b5f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a2cdf8d6ee74271b37144f2d672b5f6.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8267e1ffab3843c6ad70544c559982d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8267e1ffab3843c6ad70544c559982d7.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F34010e6777c64258a164bce7960ba312.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/34010e6777c64258a164bce7960ba312.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b5b2d7fa82b45299163650a7d57f4e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b5b2d7fa82b45299163650a7d57f4e3.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fadd0ea7dadef45d8bbbf7e69a7b52990.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/add0ea7dadef45d8bbbf7e69a7b52990.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F782e9cf3db4f4f6481c5b84abd0614bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/782e9cf3db4f4f6481c5b84abd0614bf.jpg already downloaded
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d8bc7658-3c1c-532b-91bb-a952339d20ba with identifier: 202603170772337
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8bc7658-3c1c-532b-91bb-a952339d20ba
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F033e37db302840e3938664800dc470d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/033e37db302840e3938664800dc470d3.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdd877f2b66db44daaf0a704970e008c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dd877f2b66db44daaf0a704970e008c2.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fee3071c1eff046e3874aea86aa1ff465.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ee3071c1eff046e3874aea86aa1ff465.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb4f2212c768b41248f7f6ed4f56c1a55.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b4f2212c768b41248f7f6ed4f56c1a55.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb6529361149c4f1aaba99a5243c75139.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b6529361149c4f1aaba99a5243c75139.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa912082b1c4744869beadf7c0398cbac.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a912082b1c4744869beadf7c0398cbac.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1e2b92c14d04e419eea6b3dce9ca041.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1e2b92c14d04e419eea6b3dce9ca041.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3bdf8d89331b40fb84fed6c2dd01d4d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3bdf8d89331b40fb84fed6c2dd01d4d9.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F155e31a6208c479abc39b229d5dc6f8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/155e31a6208c479abc39b229d5dc6f8b.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa6f058e925746489335aa18646f5203.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa6f058e925746489335aa18646f5203.jpg already downloaded
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 78de597c-e15b-503a-91e7-c387a5805d56 with identifier 202512138572546
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 78de597c-e15b-503a-91e7-c387a5805d56
2026-03-30 15:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 157,
'color': 'White',
'currency': 'GBP',
'description': 'Here We Have A Stunning Example Of A Nissan Juke Bose '
'Personal Edition | 1.6 Petrol | Manual | Very Low Mileage | '
'Euro 6, Ulez Compliant | Only 1 Former Keepers From New | '
'Will Come With 12 Months MOT | Registered As Category N, '
'Minor Damage, Fully Repaired, Photos Available Upon Request | '
'Excellent Spec Including Satellite Navigation, Parking '
'Camera, Cruise Control, Bluetooth & More | Free Interim '
'Service Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Reverse Parking Camera ++ Keyless Start '
'++ Bose Personal Speaker System ++ Satellite Navigation ++ '
'Bluetooth ++ DAB Radio ++ CD Player/AUX ++ Cruise Control '
'With Speed Limiter ++ Adjustable Drive Modes ++ '
'Multi-functional Steering Wheel ++ Automatic Headlights & '
'Windscreen Wipers ++ Isofix Anchor Points ++ Electric Auto '
'Folding Wing Mirrors ++ Tyre Pressure Monitor System ++ ** '
'All Major Debit And Credit Cards Accepted | Open 7 Days A '
'Week With No Appointments Necessary | Late Night Viewings '
'Available By Appointment Only | All Of Our Cars Are Ready To '
'Drive Away Today | Call Our Sales Team Today on 01709 925272 '
'To Arrange A Test Drive | Leave A Deposit To Secure This '
'Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 110,
'fuel_type': 'Petrol',
'id': '78de597c-e15b-503a-91e7-c387a5805d56',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512138572546',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Nissan',
'model': 'Juke',
'odometer': 30713,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photo_urls': ['https://m.atcdn.co.uk/a/media/80c038f52a024ad1917ae425316181c5.jpg',
'https://m.atcdn.co.uk/a/media/c9f439c452a54f13add8024a6288cdbb.jpg',
'https://m.atcdn.co.uk/a/media/a5bb093fffeb4307969be1baf82dd7fa.jpg',
'https://m.atcdn.co.uk/a/media/fae1100592be4d8c9aadac93e587ae7c.jpg',
'https://m.atcdn.co.uk/a/media/3a2cdf8d6ee74271b37144f2d672b5f6.jpg',
'https://m.atcdn.co.uk/a/media/8267e1ffab3843c6ad70544c559982d7.jpg',
'https://m.atcdn.co.uk/a/media/34010e6777c64258a164bce7960ba312.jpg',
'https://m.atcdn.co.uk/a/media/0b5b2d7fa82b45299163650a7d57f4e3.jpg',
'https://m.atcdn.co.uk/a/media/add0ea7dadef45d8bbbf7e69a7b52990.jpg',
'https://m.atcdn.co.uk/a/media/782e9cf3db4f4f6481c5b84abd0614bf.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102846,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/80c038f52a024ad1917ae425316181c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98745,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9f439c452a54f13add8024a6288cdbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104521,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a5bb093fffeb4307969be1baf82dd7fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103951,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fae1100592be4d8c9aadac93e587ae7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95425,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3a2cdf8d6ee74271b37144f2d672b5f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93330,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8267e1ffab3843c6ad70544c559982d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97988,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/34010e6777c64258a164bce7960ba312.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104664,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b5b2d7fa82b45299163650a7d57f4e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78473,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/add0ea7dadef45d8bbbf7e69a7b52990.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78de597c-e15b-503a-91e7-c387a5805d56/78de597c-e15b-503a-91e7-c387a5805d56_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53506,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/782e9cf3db4f4f6481c5b84abd0614bf.jpg',
'Width': 800}],
'price': 6990,
'price_includes_vat': True,
'registration_date': '2019-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke BOSE PERSONAL EDITION 1.6 5dr',
'transmission': 'manual',
'trim': 'Bose Personal Edition',
'year': 2019}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512138572546%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512138572546: {'created_time': 1774883253.822361, 'last_price_update_time': 1774883253.822373}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512138572546') HTTP/1.1" 204 0
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d8bc7658-3c1c-532b-91bb-a952339d20ba with identifier 202603170772337
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d8bc7658-3c1c-532b-91bb-a952339d20ba
2026-03-30 15:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'White',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Volvo XC60 D4 SE '
'| 2.0 Diesel | 6 Speed Manual | In The Best Colour White '
'| Full HPI Clear | Euro 6, Ulez Compliant | Cheap To Run With '
'Only £35 Road Tax! | Only 2 Former Keepers From New, Last '
'Keeper Owned Since 2020 | Will Come With 12 Months MOT | Well '
"Maintained With No Advisories On The Previous 2 MOT's | "
'Excellent Spec Including Bluetooth, Cruise Control & More | '
'Free Interim Service Carried Out Prior To Sale | Free 3 '
'Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great '
'5-Day AA Driveaway Insurance Available From Just £44.99 '
'(Subject To Eligibility) | 10% Off AA Comprehensive Car '
'Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'id': 'd8bc7658-3c1c-532b-91bb-a952339d20ba',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170772337',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Volvo',
'model': 'XC60',
'odometer': 95010,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photo_urls': ['https://m.atcdn.co.uk/a/media/033e37db302840e3938664800dc470d3.jpg',
'https://m.atcdn.co.uk/a/media/dd877f2b66db44daaf0a704970e008c2.jpg',
'https://m.atcdn.co.uk/a/media/ee3071c1eff046e3874aea86aa1ff465.jpg',
'https://m.atcdn.co.uk/a/media/b4f2212c768b41248f7f6ed4f56c1a55.jpg',
'https://m.atcdn.co.uk/a/media/b6529361149c4f1aaba99a5243c75139.jpg',
'https://m.atcdn.co.uk/a/media/a912082b1c4744869beadf7c0398cbac.jpg',
'https://m.atcdn.co.uk/a/media/d1e2b92c14d04e419eea6b3dce9ca041.jpg',
'https://m.atcdn.co.uk/a/media/3bdf8d89331b40fb84fed6c2dd01d4d9.jpg',
'https://m.atcdn.co.uk/a/media/155e31a6208c479abc39b229d5dc6f8b.jpg',
'https://m.atcdn.co.uk/a/media/fa6f058e925746489335aa18646f5203.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87295,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/033e37db302840e3938664800dc470d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85409,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dd877f2b66db44daaf0a704970e008c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91742,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee3071c1eff046e3874aea86aa1ff465.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90842,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b4f2212c768b41248f7f6ed4f56c1a55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86419,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b6529361149c4f1aaba99a5243c75139.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77643,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a912082b1c4744869beadf7c0398cbac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86068,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1e2b92c14d04e419eea6b3dce9ca041.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88225,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3bdf8d89331b40fb84fed6c2dd01d4d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67634,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/155e31a6208c479abc39b229d5dc6f8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8bc7658-3c1c-532b-91bb-a952339d20ba/d8bc7658-3c1c-532b-91bb-a952339d20ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78327,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa6f058e925746489335aa18646f5203.jpg',
'Width': 800}],
'price': 8690,
'price_includes_vat': True,
'registration_date': '2015-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 D4 SE 2.0 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2015}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170772337%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170772337: {'created_time': 1774883253.872154, 'last_price_update_time': 1774883253.872167}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170772337') HTTP/1.1" 204 0
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 012bcf8e-a612-58f9-a0b8-8cd1c27ea182 with identifier: 202511157907841
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 012bcf8e-a612-58f9-a0b8-8cd1c27ea182
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7acb8b1b97f14594a81299b2d6b0bc75.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7acb8b1b97f14594a81299b2d6b0bc75.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec2a0f80e3bb4b07b591bc9d955d8a5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec2a0f80e3bb4b07b591bc9d955d8a5e.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b1b00deca2b4a3b8a8cafb4d2d9be19.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b1b00deca2b4a3b8a8cafb4d2d9be19.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb02dad8977484cb79a481d29b34bb7cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b02dad8977484cb79a481d29b34bb7cd.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb1fd8c8547b9474682bf51c0005fceed.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b1fd8c8547b9474682bf51c0005fceed.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3cee0502b79e460ebb3ef1c352dd65df.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3cee0502b79e460ebb3ef1c352dd65df.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcb14a1d819734ffc8caf543ea88a80e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cb14a1d819734ffc8caf543ea88a80e9.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feae87741ec92477e83298a1c3127430c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eae87741ec92477e83298a1c3127430c.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F197c43f770da437792200c11ed125ff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/197c43f770da437792200c11ed125ff1.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F47e476dc520c49cb8eb4a1d62b6411ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/47e476dc520c49cb8eb4a1d62b6411ab.jpg already downloaded
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9 with identifier: 202603170772333
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F12d7dd4b5b804a3a898899839414bc2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/12d7dd4b5b804a3a898899839414bc2a.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F728e4d744a5c4234a86ec8d1c749656e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/728e4d744a5c4234a86ec8d1c749656e.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1acec83cf7724570b7c83867b36863f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1acec83cf7724570b7c83867b36863f8.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8681cd9c87b24720a10eebb78a758c0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8681cd9c87b24720a10eebb78a758c0a.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8556bcca87c241348a40a8ba3c2b099e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8556bcca87c241348a40a8ba3c2b099e.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ded34b6d5ef40da8b8ec0bf9c9fa4f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ded34b6d5ef40da8b8ec0bf9c9fa4f3.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc277637f89ef4aa181272049becfd195.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c277637f89ef4aa181272049becfd195.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43c5add2899c4155a6293115425d289e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43c5add2899c4155a6293115425d289e.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85edc620c2404a15a55b6c8374f35ff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85edc620c2404a15a55b6c8374f35ff1.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ce0ff4a4cda48ff9bf7819f639057ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ce0ff4a4cda48ff9bf7819f639057ad.jpg already downloaded
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 012bcf8e-a612-58f9-a0b8-8cd1c27ea182 with identifier 202511157907841
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 012bcf8e-a612-58f9-a0b8-8cd1c27ea182
2026-03-30 15:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'Blue',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Volkswagen Golf GT TSI DSG '
'| 1.4 Petrol | Automatic | Full HPI Clear | Full Service '
'History With 10 Records! | Low Mileage | Euro 6, Ulez '
'Compliant | Cheap To Run | Only 2 Former Keepers From New, '
'Last Keeper Owned Since 2021 | 2 Keys | Will Come With Long '
'MOT Until 20/10/2026 | Excellent Spec Including Reverse '
'Parking Camera & Sensors, Adaptive Cruise Control, Bluetooth '
'& More | Free Interim Service Carried Out Prior To Sale | '
'Free 3 Months Nationwide Warranty, Free 12 Months Breakdown '
'Cover And £75 Off Your Next Service & MOT With All Of Our '
'Vehicles | Well Looked After Example | Looks And Drives '
'Great 5-Day AA Driveaway Insurance Available From Just '
'£44.99 (Subject To Eligibility) | 10% Off AA Comprehensive '
'Car Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£200 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ++ Reverse Parking Camera ++ Front & Rear Parking '
'Sensors ++ Satellite Navigation Capabilities ++ Bluetooth ++ '
'DAB Radio ++ CD Player/USB/AUX ++ Adjustable Drive Modes ++ '
'Adaptive Cruise Control ++ Stop/Start System ++ '
'Multi-functional Steering Wheel ++ Steering Mounted Gear '
'Shifting Paddles ++ Electric Parking Brake With Auto Hold '
'Function ++ Automatic Headlights & Windscreen Wipers ++ Rear '
'Folding Tray Tables ++ Cooled Glove Compartment ++ Electric '
'Heated Folding Wing Mirrors ++ Towbar ++ Spare Wheel ++ ** '
'All Major Debit And Credit Cards Accepted | Open 7 Days A '
'Week With No Appointments Necessary | Late Night Viewings '
'Available By Appointment Only | All Of Our Cars Are Ready To '
'Drive Away Today | Call Our Sales Team Today on 01709 925272 '
'To Arrange A Test Drive | Leave A Deposit To Secure This '
'Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': '012bcf8e-a612-58f9-a0b8-8cd1c27ea182',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157907841',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Volkswagen',
'model': 'Golf SV',
'odometer': 54574,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 58,
'photo_urls': ['https://m.atcdn.co.uk/a/media/7acb8b1b97f14594a81299b2d6b0bc75.jpg',
'https://m.atcdn.co.uk/a/media/ec2a0f80e3bb4b07b591bc9d955d8a5e.jpg',
'https://m.atcdn.co.uk/a/media/1b1b00deca2b4a3b8a8cafb4d2d9be19.jpg',
'https://m.atcdn.co.uk/a/media/b02dad8977484cb79a481d29b34bb7cd.jpg',
'https://m.atcdn.co.uk/a/media/b1fd8c8547b9474682bf51c0005fceed.jpg',
'https://m.atcdn.co.uk/a/media/3cee0502b79e460ebb3ef1c352dd65df.jpg',
'https://m.atcdn.co.uk/a/media/cb14a1d819734ffc8caf543ea88a80e9.jpg',
'https://m.atcdn.co.uk/a/media/eae87741ec92477e83298a1c3127430c.jpg',
'https://m.atcdn.co.uk/a/media/197c43f770da437792200c11ed125ff1.jpg',
'https://m.atcdn.co.uk/a/media/47e476dc520c49cb8eb4a1d62b6411ab.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105830,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7acb8b1b97f14594a81299b2d6b0bc75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103864,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec2a0f80e3bb4b07b591bc9d955d8a5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114915,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b1b00deca2b4a3b8a8cafb4d2d9be19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109439,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b02dad8977484cb79a481d29b34bb7cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111743,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b1fd8c8547b9474682bf51c0005fceed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101206,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3cee0502b79e460ebb3ef1c352dd65df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109393,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cb14a1d819734ffc8caf543ea88a80e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108917,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eae87741ec92477e83298a1c3127430c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79553,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/197c43f770da437792200c11ed125ff1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772685c9-1573-5866-971b-a9ba36bf2024/772685c9-1573-5866-971b-a9ba36bf2024_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84188,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/47e476dc520c49cb8eb4a1d62b6411ab.jpg',
'Width': 800}],
'price': 9990,
'price_includes_vat': True,
'registration_date': '2015-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf GT TSI DSG 1.4 5dr',
'transmission': 'automatic',
'trim': 'GT',
'year': 2015}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157907841%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511157907841: {'created_time': 1774883254.3614, 'last_price_update_time': 1774883254.361413}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511157907841') HTTP/1.1" 204 0
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9 with identifier 202603170772333
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9
2026-03-30 15:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 40,
'color': 'White',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Mitsubishi Outlander PHEV 4H | 2.4 Petrol Plug-In '
'Hybrid | Automatic | 4WD | In The Best Colour White | '
'Full HPI Clear | Excellent Service History With 6 Records | '
'Euro 6, Ulez Compliant | Only 1 Former Keepers From New | '
'Will Come With 12 Months MOT | Well Maintained | Excellent '
'Spec Including Remote Key Climate Control, Bluetooth, Cruise '
'Control & More | Free Interim Service Carried Out Prior To '
'Sale | Free 3 Months Nationwide Warranty, Free 12 Months '
'Breakdown Cover And £75 Off Your Next Service & MOT With All '
'Of Our Vehicles | Well Looked After Example | Looks And '
'Drives Great 5-Day AA Driveaway Insurance Available From '
'Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £249 Giving You That Added Peace Of Mind (6,12,24 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 206,
'fuel_type': 'Petrol Plug-in Hybrid',
'id': 'd1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170772333',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 82830,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 51,
'photo_urls': ['https://m.atcdn.co.uk/a/media/12d7dd4b5b804a3a898899839414bc2a.jpg',
'https://m.atcdn.co.uk/a/media/728e4d744a5c4234a86ec8d1c749656e.jpg',
'https://m.atcdn.co.uk/a/media/1acec83cf7724570b7c83867b36863f8.jpg',
'https://m.atcdn.co.uk/a/media/8681cd9c87b24720a10eebb78a758c0a.jpg',
'https://m.atcdn.co.uk/a/media/8556bcca87c241348a40a8ba3c2b099e.jpg',
'https://m.atcdn.co.uk/a/media/0ded34b6d5ef40da8b8ec0bf9c9fa4f3.jpg',
'https://m.atcdn.co.uk/a/media/c277637f89ef4aa181272049becfd195.jpg',
'https://m.atcdn.co.uk/a/media/43c5add2899c4155a6293115425d289e.jpg',
'https://m.atcdn.co.uk/a/media/85edc620c2404a15a55b6c8374f35ff1.jpg',
'https://m.atcdn.co.uk/a/media/6ce0ff4a4cda48ff9bf7819f639057ad.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88897,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/12d7dd4b5b804a3a898899839414bc2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83756,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/728e4d744a5c4234a86ec8d1c749656e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91344,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1acec83cf7724570b7c83867b36863f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88101,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8681cd9c87b24720a10eebb78a758c0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83998,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8556bcca87c241348a40a8ba3c2b099e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79450,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0ded34b6d5ef40da8b8ec0bf9c9fa4f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82803,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c277637f89ef4aa181272049becfd195.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86514,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/43c5add2899c4155a6293115425d289e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71135,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85edc620c2404a15a55b6c8374f35ff1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9/d1c5fa4e-cf6a-5944-aa6b-36e366aa5ef9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78958,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ce0ff4a4cda48ff9bf7819f639057ad.jpg',
'Width': 800}],
'price': 11990,
'price_includes_vat': True,
'registration_date': '2019-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Outlander PHEV 4H 2.4 5dr',
'transmission': 'automatic',
'trim': '4h',
'year': 2019}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170772333%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170772333: {'created_time': 1774883254.440613, 'last_price_update_time': 1774883254.440627}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170772333') HTTP/1.1" 204 0
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9f8cf9-d667-54c3-b730-d209ecf4a144 with identifier: 202511087746249
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a9f8cf9-d667-54c3-b730-d209ecf4a144
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ba7956b6d3f416db8f6273c3c0b0a9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ba7956b6d3f416db8f6273c3c0b0a9c.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38de92861bb24fc6be5566486cd445e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38de92861bb24fc6be5566486cd445e0.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fee50331b975d4957b899f6a9809821c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ee50331b975d4957b899f6a9809821c9.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5d7e9d41b354b1bab3356d1d5975323.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5d7e9d41b354b1bab3356d1d5975323.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe8e830ff4fd54e12ac6ac01893f1402a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e8e830ff4fd54e12ac6ac01893f1402a.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40acfc1f8f8d4f9e904eff21e8558fa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40acfc1f8f8d4f9e904eff21e8558fa9.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc820ced6f3924d839db55a4f6e06e53d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c820ced6f3924d839db55a4f6e06e53d.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd45463b8bf49455b99c90dff811819f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d45463b8bf49455b99c90dff811819f3.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4f51e4f2000a45bcb586369972d7d00e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4f51e4f2000a45bcb586369972d7d00e.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea8b7f3c33d44e558b5afc3aebd0164d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea8b7f3c33d44e558b5afc3aebd0164d.jpg already downloaded
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 205fb6bc-98f0-570a-9f95-1b229e4327db with identifier: 202603170754059
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 205fb6bc-98f0-570a-9f95-1b229e4327db
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb80dbd9606b34548bfa2b95c80c998e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b80dbd9606b34548bfa2b95c80c998e6.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F04c0948303f6480b9de116d83ff1d276.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb678f5c4b17944f6a01788862b10a8e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc962ad07c08f4098b1a5ac8b654215bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0761a9bcbbaf4aeaae32285689e4dbb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b437fe35e9a49399a64d5fcb86ef9cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54878105cefd4b1dbc9e78672589fda0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43dfc279ab3549939780fc6d4c86309d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe4e83531cc84f61ab5655b61faa4e35.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd868903c70384a62858e1e0a8ea7c36c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg already downloaded
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9a9f8cf9-d667-54c3-b730-d209ecf4a144 with identifier 202511087746249
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9a9f8cf9-d667-54c3-b730-d209ecf4a144
2026-03-30 15:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Blue',
'currency': 'GBP',
'description': 'AQ Car Sales Are Proud To Present This Stunning Volkswagen '
'Polo SE EVO | 1.0 Petrol | Manual | Full HPI Clear | Great '
'Service History With 4 Records, Clutch Just Replaced In Aug '
'2025 At 94k Miles | Euro 6, Ulez Compliant | Cheap To Run | '
'Only 2 Former Keepers From New, Last Keeper Owned Since 2023 '
'| 2 Keys | Will Come With 12 Months MOT | Well Maintained | '
'Great Spec Including Bluetooth, Apple Car Play, Andriod Auto '
'& Mirror Link & More | Free Interim Service Carried Out Prior '
'To Sale | Free 3 Months Nationwide Warranty, Free 12 Months '
'Breakdown Cover And £75 Off Your Next Service & MOT With All '
'Of Our Vehicles | Well Looked After Example | Looks And '
'Drives Great 5-Day AA Driveaway Insurance Available From '
'Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £200 Giving You That Added Peace Of Mind (6,12,24 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ++ DAB Radio ++ Bluetooth ++ Apple CarPlay, Andriod '
'Auto & Mirror Link ++ CD Player/USB ++ Brake Assist ++ '
'Stop/Start System ++ Cruise Control With Speed Limiter ++ '
'Multi-functional Steering Wheel ++ Automatic Headlights & '
'Windscreen Wipers ++ Isofix Anchor Points ++ Electric Heated '
'Wing Mirrors ++ Adjustable Load Shelf ++ Spare Wheel ++ ** '
'All Major Debit And Credit Cards Accepted | Open 7 Days A '
'Week With No Appointments Necessary | Late Night Viewings '
'Available By Appointment Only | All Of Our Cars Are Ready To '
'Drive Away Today | Call Our Sales Team Today on 01709 925272 '
'To Arrange A Test Drive | Leave A Deposit To Secure This '
'Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 79,
'fuel_type': 'Petrol',
'id': '9a9f8cf9-d667-54c3-b730-d209ecf4a144',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511087746249',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 97507,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 53,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6ba7956b6d3f416db8f6273c3c0b0a9c.jpg',
'https://m.atcdn.co.uk/a/media/38de92861bb24fc6be5566486cd445e0.jpg',
'https://m.atcdn.co.uk/a/media/ee50331b975d4957b899f6a9809821c9.jpg',
'https://m.atcdn.co.uk/a/media/c5d7e9d41b354b1bab3356d1d5975323.jpg',
'https://m.atcdn.co.uk/a/media/e8e830ff4fd54e12ac6ac01893f1402a.jpg',
'https://m.atcdn.co.uk/a/media/40acfc1f8f8d4f9e904eff21e8558fa9.jpg',
'https://m.atcdn.co.uk/a/media/c820ced6f3924d839db55a4f6e06e53d.jpg',
'https://m.atcdn.co.uk/a/media/d45463b8bf49455b99c90dff811819f3.jpg',
'https://m.atcdn.co.uk/a/media/4f51e4f2000a45bcb586369972d7d00e.jpg',
'https://m.atcdn.co.uk/a/media/ea8b7f3c33d44e558b5afc3aebd0164d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105006,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ba7956b6d3f416db8f6273c3c0b0a9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105643,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/38de92861bb24fc6be5566486cd445e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106879,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee50331b975d4957b899f6a9809821c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108217,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c5d7e9d41b354b1bab3356d1d5975323.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107710,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e8e830ff4fd54e12ac6ac01893f1402a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100470,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/40acfc1f8f8d4f9e904eff21e8558fa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105815,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c820ced6f3924d839db55a4f6e06e53d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108729,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d45463b8bf49455b99c90dff811819f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82209,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4f51e4f2000a45bcb586369972d7d00e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a788514-15ae-5236-a1c7-10812e66e08f/8a788514-15ae-5236-a1c7-10812e66e08f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78310,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea8b7f3c33d44e558b5afc3aebd0164d.jpg',
'Width': 800}],
'price': 8290,
'price_includes_vat': True,
'registration_date': '2019-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo SE EVO 1.0 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2019}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511087746249%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511087746249: {'created_time': 1774883254.869714, 'last_price_update_time': 1774883254.869728}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511087746249') HTTP/1.1" 204 0
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 205fb6bc-98f0-570a-9f95-1b229e4327db with identifier 202603170754059
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 205fb6bc-98f0-570a-9f95-1b229e4327db
2026-03-30 15:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Black',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Volkswagen Polo '
'SEL TSI | 1.2 Petrol | 6 Speed Manual | Full HPI Clear | '
'Excellent Service History With 8 Records, Timing Belt & Water '
'Pump Replaced By VW In 2023 At 62K Miles | Euro 6, Ulez '
'Compliant | Cheap To Run With Only £20 Road Tax! | Only 2 '
'Owners From New, Last Keeper Owned Since 2021 | Will Come '
'With Long MOT Until 09/10/2026 | Well Maintained | Great Spec '
'Including Bluetooth & More | Free Interim Service Carried Out '
'Prior To Sale | Free 3 Months Nationwide Warranty, Free 12 '
'Months Breakdown Cover And £75 Off Your Next Service & MOT '
'With All Of Our Vehicles | Well Looked After Example | Looks '
'And Drives Great 5-Day AA Driveaway Insurance Available '
'From Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £249 Giving You That Added Peace Of Mind (6,12,24 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 108,
'fuel_type': 'Petrol',
'id': '205fb6bc-98f0-570a-9f95-1b229e4327db',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170754059',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 80512,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 14,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b80dbd9606b34548bfa2b95c80c998e6.jpg',
'https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg',
'https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg',
'https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg',
'https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg',
'https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg',
'https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg',
'https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg',
'https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg',
'https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_205fb6bc-98f0-570a-9f95-1b229e4327db/205fb6bc-98f0-570a-9f95-1b229e4327db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104680,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b80dbd9606b34548bfa2b95c80c998e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38080,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/04c0948303f6480b9de116d83ff1d276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76384,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b678f5c4b17944f6a01788862b10a8e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32158,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c962ad07c08f4098b1a5ac8b654215bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29694,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0761a9bcbbaf4aeaae32285689e4dbb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28089,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b437fe35e9a49399a64d5fcb86ef9cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63190,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/54878105cefd4b1dbc9e78672589fda0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39564,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/43dfc279ab3549939780fc6d4c86309d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42355,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe4e83531cc84f61ab5655b61faa4e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2463f01c-4802-550c-ae71-000e02d57048/2463f01c-4802-550c-ae71-000e02d57048_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 29431,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d868903c70384a62858e1e0a8ea7c36c.jpg',
'Width': 800}],
'price': 6590,
'price_includes_vat': True,
'registration_date': '2014-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo SEL TSI 1.2 5dr',
'transmission': 'manual',
'trim': 'SEL',
'year': 2014}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170754059%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170754059: {'created_time': 1774883254.92161, 'last_price_update_time': 1774883254.921623}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170754059') HTTP/1.1" 204 0
2026-03-30 15:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 208f09c2-000a-5b78-9b78-00d8615c4578 with identifier: 202603170754058
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 208f09c2-000a-5b78-9b78-00d8615c4578
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d7ada98644c49ad9a4e96eb38592ed1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d7ada98644c49ad9a4e96eb38592ed1.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F228c93874f01403b9784b770b1413829.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/228c93874f01403b9784b770b1413829.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fedb46b798a294de29fecca52991a2512.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/edb46b798a294de29fecca52991a2512.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e8f7c922c3c4051b2153eb3f398af36.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e8f7c922c3c4051b2153eb3f398af36.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1386f756d9340939486f920926b140f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1386f756d9340939486f920926b140f.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F861267ad47da45b39855f7f2f60b7936.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/861267ad47da45b39855f7f2f60b7936.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2858adf09d34844ae7576ab9e27e175.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2858adf09d34844ae7576ab9e27e175.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe08c698184544941b7dba399e042fd95.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e08c698184544941b7dba399e042fd95.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F080262b186724464b3449d4e0deb99f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/080262b186724464b3449d4e0deb99f6.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63ad87a463514c949296f6fa2c7e6dea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63ad87a463514c949296f6fa2c7e6dea.jpg already downloaded
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 208f09c2-000a-5b78-9b78-00d8615c4578 with identifier 202603170754058
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 208f09c2-000a-5b78-9b78-00d8615c4578
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 167,
'color': 'Red',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Nissan Navara DCI Acenta Plus 4X4 | 2.3 Diesel | 6 '
'Speed Manual | 4WD | NO VAT | Full HPI Clear | Excellent '
'Service History With 7 Records | Low Mileage | Euro 6, Ulez '
'Compliant | Only 3 Former Keepers From New | 2 Keys | Will '
'Come With Long MOT Until 21/11/2026 | Well Maintained With No '
"Advisories On Any Previous MOT's! | Excellent Spec Including "
'Bluetooth, Cruise Control & More | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection '
'Or Test Drive Welcome | Nationwide Delivery Service Available '
'| Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ** All Major Debit And Credit Cards '
'Accepted | Open 7 Days A Week With No Appointments Necessary '
'| Late Night Viewings Available By Appointment Only | All Of '
'Our Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.3L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'id': '208f09c2-000a-5b78-9b78-00d8615c4578',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170754058',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Nissan',
'model': 'Navara',
'odometer': 73455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0d7ada98644c49ad9a4e96eb38592ed1.jpg',
'https://m.atcdn.co.uk/a/media/228c93874f01403b9784b770b1413829.jpg',
'https://m.atcdn.co.uk/a/media/edb46b798a294de29fecca52991a2512.jpg',
'https://m.atcdn.co.uk/a/media/6e8f7c922c3c4051b2153eb3f398af36.jpg',
'https://m.atcdn.co.uk/a/media/d1386f756d9340939486f920926b140f.jpg',
'https://m.atcdn.co.uk/a/media/861267ad47da45b39855f7f2f60b7936.jpg',
'https://m.atcdn.co.uk/a/media/a2858adf09d34844ae7576ab9e27e175.jpg',
'https://m.atcdn.co.uk/a/media/e08c698184544941b7dba399e042fd95.jpg',
'https://m.atcdn.co.uk/a/media/080262b186724464b3449d4e0deb99f6.jpg',
'https://m.atcdn.co.uk/a/media/63ad87a463514c949296f6fa2c7e6dea.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96904,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d7ada98644c49ad9a4e96eb38592ed1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96378,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/228c93874f01403b9784b770b1413829.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101685,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/edb46b798a294de29fecca52991a2512.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100271,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6e8f7c922c3c4051b2153eb3f398af36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96422,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1386f756d9340939486f920926b140f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89964,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/861267ad47da45b39855f7f2f60b7936.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97190,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2858adf09d34844ae7576ab9e27e175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97324,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e08c698184544941b7dba399e042fd95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65600,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/080262b186724464b3449d4e0deb99f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_208f09c2-000a-5b78-9b78-00d8615c4578/208f09c2-000a-5b78-9b78-00d8615c4578_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87247,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/63ad87a463514c949296f6fa2c7e6dea.jpg',
'Width': 800}],
'price': 12690,
'price_includes_vat': True,
'registration_date': '2016-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Navara DCI ACENTA PLUS 4X4 SHR DCB 2.3 4dr',
'transmission': 'manual',
'trim': 'Acenta+',
'year': 2016}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170754058%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170754058: {'created_time': 1774883255.137973, 'last_price_update_time': 1774883255.137983}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170754058') HTTP/1.1" 204 0
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d04594a8-5332-516e-ae2b-95e25c0440a4 with identifier: 202603100573780
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d04594a8-5332-516e-ae2b-95e25c0440a4
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fc02c02179f414fbaef2c2e8b0548db.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fc02c02179f414fbaef2c2e8b0548db.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F982d08d1327743d299aef75cefc570ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/982d08d1327743d299aef75cefc570ab.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c639311fcef44a285614662d8ef8874.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c639311fcef44a285614662d8ef8874.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5cd548774e4b4e4f9f25885c4fae71d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5cd548774e4b4e4f9f25885c4fae71d8.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fae4e752fd3c54d6f8cba228bff5ef93c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ae4e752fd3c54d6f8cba228bff5ef93c.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73b779f9d9d24e48bae3b4167555b2bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73b779f9d9d24e48bae3b4167555b2bd.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe2f41d6a891d4060a3bc01c80282bbf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e2f41d6a891d4060a3bc01c80282bbf7.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feba8939889894faca6b639010ea26b08.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eba8939889894faca6b639010ea26b08.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3c40e653b23841ab9ce262603d3651d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3c40e653b23841ab9ce262603d3651d0.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5a903b87e6e24eafa6f6f02b8e882013.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5a903b87e6e24eafa6f6f02b8e882013.jpg already downloaded
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d04594a8-5332-516e-ae2b-95e25c0440a4 with identifier 202603100573780
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d04594a8-5332-516e-ae2b-95e25c0440a4
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'Blue',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Seat Ateca TSI SE '
'Technology | 1.0 Petrol | 6 Speed Manual | Full HPI Clear '
'| Good Service History With 5 Records | Euro 6, Ulez '
'Compliant | Cheap To Run | Only 1 Former Keepers From New | 2 '
'Keys | Will Come With Long MOT Until 05/12/2026 | Well '
"Maintained With No Advisories On The Previous 2 MOT's | "
'Excellent Spec Including Satellite Navigation, Bluetooth & '
'More | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great '
'5-Day AA Driveaway Insurance Available From Just £44.99 '
'(Subject To Eligibility) | 10% Off AA Comprehensive Car '
'Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 113,
'fuel_type': 'Petrol',
'id': 'd04594a8-5332-516e-ae2b-95e25c0440a4',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100573780',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'SEAT',
'model': 'Ateca',
'odometer': 80623,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4fc02c02179f414fbaef2c2e8b0548db.jpg',
'https://m.atcdn.co.uk/a/media/982d08d1327743d299aef75cefc570ab.jpg',
'https://m.atcdn.co.uk/a/media/0c639311fcef44a285614662d8ef8874.jpg',
'https://m.atcdn.co.uk/a/media/5cd548774e4b4e4f9f25885c4fae71d8.jpg',
'https://m.atcdn.co.uk/a/media/ae4e752fd3c54d6f8cba228bff5ef93c.jpg',
'https://m.atcdn.co.uk/a/media/73b779f9d9d24e48bae3b4167555b2bd.jpg',
'https://m.atcdn.co.uk/a/media/e2f41d6a891d4060a3bc01c80282bbf7.jpg',
'https://m.atcdn.co.uk/a/media/eba8939889894faca6b639010ea26b08.jpg',
'https://m.atcdn.co.uk/a/media/3c40e653b23841ab9ce262603d3651d0.jpg',
'https://m.atcdn.co.uk/a/media/5a903b87e6e24eafa6f6f02b8e882013.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101307,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4fc02c02179f414fbaef2c2e8b0548db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100497,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/982d08d1327743d299aef75cefc570ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109598,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c639311fcef44a285614662d8ef8874.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100639,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5cd548774e4b4e4f9f25885c4fae71d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101829,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ae4e752fd3c54d6f8cba228bff5ef93c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92767,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73b779f9d9d24e48bae3b4167555b2bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101178,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e2f41d6a891d4060a3bc01c80282bbf7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97748,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eba8939889894faca6b639010ea26b08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68570,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5a903b87e6e24eafa6f6f02b8e882013.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d04594a8-5332-516e-ae2b-95e25c0440a4/d04594a8-5332-516e-ae2b-95e25c0440a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87589,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3c40e653b23841ab9ce262603d3651d0.jpg',
'Width': 800}],
'price': 8890,
'price_includes_vat': True,
'registration_date': '2019-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT Ateca TSI SE TECHNOLOGY 1.0 5dr',
'transmission': 'manual',
'trim': 'SE Technology',
'year': 2019}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100573780%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100573780: {'created_time': 1774883255.385288, 'last_price_update_time': 1774883255.385297}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100573780') HTTP/1.1" 204 0
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ce64940-3659-5263-a16c-8b06e948bb94 with identifier: 202510217312850
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ce64940-3659-5263-a16c-8b06e948bb94
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39af0289ca8641cfbbb4ee80c53a1eda.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39af0289ca8641cfbbb4ee80c53a1eda.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e9ecb7cbdeb4135af89541823437341.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e9ecb7cbdeb4135af89541823437341.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98b7fc9e1ccf45dea7a2612c17597c29.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98b7fc9e1ccf45dea7a2612c17597c29.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc8fd43d5eb694c0cb045af3b9b1dcaa4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c8fd43d5eb694c0cb045af3b9b1dcaa4.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F94a5bdcd240e4e41a85a60f296c21cd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/94a5bdcd240e4e41a85a60f296c21cd6.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6c1f02a854404c04821d889426a2491e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6c1f02a854404c04821d889426a2491e.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7605f6105f4d49938593cab4fbdb34b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7605f6105f4d49938593cab4fbdb34b4.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe1ca1e97e267496ea0f0977beb2be0a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e1ca1e97e267496ea0f0977beb2be0a1.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F870410bd8f504714a24723490a899225.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/870410bd8f504714a24723490a899225.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F085ecea0bfa64592946bc22203d54020.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/085ecea0bfa64592946bc22203d54020.jpg already downloaded
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0ce64940-3659-5263-a16c-8b06e948bb94 with identifier 202510217312850
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0ce64940-3659-5263-a16c-8b06e948bb94
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 177,
'color': 'Brown',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Honda CR-V I-VTec SR | 2.0 '
'Petrol | 6 Speed Manual | 4WD | Full HPI Clear | Service '
'History With 4 Records | Euro 6, Ulez Compliant | Only 2 '
'Owners From New, Last Keeper Owned Since 2016 | 2 Keys | Will '
'Come With 12 Months MOT | Excellent Spec Including Reverse '
'Parking Camera, Half Leather Interior With Heated Front '
'Seats, Bluetooth & More | Free Interim Service Carried Out '
'Prior To Sale | Free 3 Months Nationwide Warranty, Free 12 '
'Months Breakdown Cover And £75 Off Your Next Service & MOT '
'With All Of Our Vehicles | Well Looked After Example | Looks '
'And Drives Great 5-Day AA Driveaway Insurance Available '
'From Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £200 Giving You That Added Peace Of Mind (6,12,24 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ++ Reverse Parking Camera ++ Front & Rear Parking '
'Sensors ++ Half Leather Interior With Heated Front Seats ++ '
'Bluetooth ++ DAB Radio ++ CD Player/USB/AUX ++ Cruise Control '
'With Speed Limiter ++ Dual Climate Control ++ Stop/Start '
'System ++ ECO Drive Mode ++ Multi-functional Steering Wheel '
'++ Automatic Headlights & Windscreen Wipers ++ Electric '
'Folding Wing Mirrors ++ Isofix Anchor Points ++ Spare Wheel '
'++ ** All Major Debit And Credit Cards Accepted | Open 7 '
'Days A Week With No Appointments Necessary | Late Night '
'Viewings Available By Appointment Only | All Of Our Cars Are '
'Ready To Drive Away Today | Call Our Sales Team Today on '
'01709 925272 To Arrange A Test Drive | Leave A Deposit To '
'Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 153,
'fuel_type': 'Petrol',
'id': '0ce64940-3659-5263-a16c-8b06e948bb94',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510217312850',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Honda',
'model': 'CR-V',
'odometer': 93422,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/39af0289ca8641cfbbb4ee80c53a1eda.jpg',
'https://m.atcdn.co.uk/a/media/2e9ecb7cbdeb4135af89541823437341.jpg',
'https://m.atcdn.co.uk/a/media/98b7fc9e1ccf45dea7a2612c17597c29.jpg',
'https://m.atcdn.co.uk/a/media/c8fd43d5eb694c0cb045af3b9b1dcaa4.jpg',
'https://m.atcdn.co.uk/a/media/94a5bdcd240e4e41a85a60f296c21cd6.jpg',
'https://m.atcdn.co.uk/a/media/6c1f02a854404c04821d889426a2491e.jpg',
'https://m.atcdn.co.uk/a/media/7605f6105f4d49938593cab4fbdb34b4.jpg',
'https://m.atcdn.co.uk/a/media/e1ca1e97e267496ea0f0977beb2be0a1.jpg',
'https://m.atcdn.co.uk/a/media/870410bd8f504714a24723490a899225.jpg',
'https://m.atcdn.co.uk/a/media/085ecea0bfa64592946bc22203d54020.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110751,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/39af0289ca8641cfbbb4ee80c53a1eda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115512,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e9ecb7cbdeb4135af89541823437341.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117897,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98b7fc9e1ccf45dea7a2612c17597c29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116542,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c8fd43d5eb694c0cb045af3b9b1dcaa4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113689,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/94a5bdcd240e4e41a85a60f296c21cd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107394,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6c1f02a854404c04821d889426a2491e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111088,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7605f6105f4d49938593cab4fbdb34b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113468,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e1ca1e97e267496ea0f0977beb2be0a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100156,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/870410bd8f504714a24723490a899225.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d16a91b-a7c4-5844-af01-1df334323e9d/9d16a91b-a7c4-5844-af01-1df334323e9d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99558,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/085ecea0bfa64592946bc22203d54020.jpg',
'Width': 800}],
'price': 6990,
'price_includes_vat': True,
'registration_date': '2013-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Cr-V I-VTEC SR 2.0 5dr',
'transmission': 'manual',
'trim': 'SR',
'year': 2013}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510217312850%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510217312850: {'created_time': 1774883255.63971, 'last_price_update_time': 1774883255.639721}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510217312850') HTTP/1.1" 204 0
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 93af286e-86ae-5e4f-85f4-afbff6ea1a68 with identifier: 202510086984451
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93af286e-86ae-5e4f-85f4-afbff6ea1a68
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff24ec78ee56c46289e86b1ca85e66da0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f24ec78ee56c46289e86b1ca85e66da0.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3c921babf6f045b787ddb8aa2b21c6c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3c921babf6f045b787ddb8aa2b21c6c3.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F566e2e97d45244519d0b5fea324ed068.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/566e2e97d45244519d0b5fea324ed068.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7eccc16139414499b6f9ee3b48db23a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7eccc16139414499b6f9ee3b48db23a1.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7294e8b175d341dbade2b2f89b195f23.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7294e8b175d341dbade2b2f89b195f23.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe58f83d0ef4a44d4bfce3dc655561a33.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e58f83d0ef4a44d4bfce3dc655561a33.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0cf755089cda4e549f3f3b27d9307e78.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0cf755089cda4e549f3f3b27d9307e78.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1fa785b2d0c240d099bab3d8dec86c36.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1fa785b2d0c240d099bab3d8dec86c36.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F42eb5206ebb7463591881838fba6d1f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/42eb5206ebb7463591881838fba6d1f4.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25aeb9d835a2425fa87c666a6dcae1a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25aeb9d835a2425fa87c666a6dcae1a7.jpg already downloaded
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 93af286e-86ae-5e4f-85f4-afbff6ea1a68 with identifier 202510086984451
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 93af286e-86ae-5e4f-85f4-afbff6ea1a68
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'Blue',
'currency': 'GBP',
'description': 'AQ Car Sales Are Proud To Present This Stunning Lexus NX 300H '
'F Sport | 2.5 Petrol Hybrid | Automatic | Full HPI Clear | '
'Full Service History With 12 Records! | Ulez Compliant | Only '
'2 Owners From New | 2 Keys | Will Come With Long MOT Until '
'22/12/2026 | Well Maintained | Huge Spec Including Full '
'Leather Interior With Heated Electric Front Seats, Reverse '
'Parking Camera & Sensors, Wireless Charging Pad, Satellite '
'Navigation & Much More! | Free Interim Service Carried Out '
'Prior To Sale | Free 3 Months Nationwide Warranty, Free 12 '
'Months Breakdown Cover And £75 Off Your Next Service & MOT '
'With All Of Our Vehicles | Well Looked After Example | Looks '
'And Drives Great 5-Day AA Driveaway Insurance Available '
'From Just £44.99 (Subject To Eligibility) | 10% Off AA '
'Comprehensive Car Insurance Any Inspection Or Test Drive '
'Welcome | Nationwide Delivery Service Available | Viewing Is '
'Highly Recommended | Upgraded Warranty Cover Is Available '
'From Only £200 Giving You That Added Peace Of Mind (6 And 12 '
'Month Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ++ Reverse Parking Camera ++ Keyless Entry & Start '
'++ Full Leather Interior With Electric Heated Front Seats ++ '
'Remote Touchpad ++ Wireless Charging Pad ++ Electric Tailgate '
'++ Satellite Navigation ++ Bluetooth ++ DAB Radio ++ '
'Micracast ++ CD Player/USB/AUX ++ Lane Assist ++ Sport/ECO '
'Mode ++ EV Mode ++ Collision Alert ++ Cruise Control With '
'Speed Limiter ++ Dual Climate Control ++ Multi-functional '
'Steering Wheel ++ Steering Mounted Gear Shifting Paddles ++ '
'Electric Parking Brake With Auto Hold Function ++ Automatic '
'Headlights & Windscreen Wipers ++ Automatic High Beam ++ '
'Chilled Center Console ++ Removable Compact Mirror ++ '
'Electric Adjustable Steering Wheel ++ Electric Auto Folding '
'Wing Mirrors ++ Plastic Boot Cover ++ Isofix Anchor Points ++ '
'Spare Wheel ++ ** All Major Debit And Credit Cards Accepted '
'| Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 194,
'fuel_type': 'Petrol Hybrid',
'id': '93af286e-86ae-5e4f-85f4-afbff6ea1a68',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510086984451',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Lexus',
'model': 'NX',
'odometer': 108986,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 67,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f24ec78ee56c46289e86b1ca85e66da0.jpg',
'https://m.atcdn.co.uk/a/media/3c921babf6f045b787ddb8aa2b21c6c3.jpg',
'https://m.atcdn.co.uk/a/media/566e2e97d45244519d0b5fea324ed068.jpg',
'https://m.atcdn.co.uk/a/media/7eccc16139414499b6f9ee3b48db23a1.jpg',
'https://m.atcdn.co.uk/a/media/7294e8b175d341dbade2b2f89b195f23.jpg',
'https://m.atcdn.co.uk/a/media/e58f83d0ef4a44d4bfce3dc655561a33.jpg',
'https://m.atcdn.co.uk/a/media/0cf755089cda4e549f3f3b27d9307e78.jpg',
'https://m.atcdn.co.uk/a/media/1fa785b2d0c240d099bab3d8dec86c36.jpg',
'https://m.atcdn.co.uk/a/media/42eb5206ebb7463591881838fba6d1f4.jpg',
'https://m.atcdn.co.uk/a/media/25aeb9d835a2425fa87c666a6dcae1a7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107549,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f24ec78ee56c46289e86b1ca85e66da0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115638,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3c921babf6f045b787ddb8aa2b21c6c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116357,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/566e2e97d45244519d0b5fea324ed068.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116553,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7eccc16139414499b6f9ee3b48db23a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111930,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7294e8b175d341dbade2b2f89b195f23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112805,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0cf755089cda4e549f3f3b27d9307e78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98306,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e58f83d0ef4a44d4bfce3dc655561a33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114407,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1fa785b2d0c240d099bab3d8dec86c36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80749,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/42eb5206ebb7463591881838fba6d1f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72950bf7-6517-564e-9451-1fb6e09e0774/72950bf7-6517-564e-9451-1fb6e09e0774_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79834,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/25aeb9d835a2425fa87c666a6dcae1a7.jpg',
'Width': 800}],
'price': 15490,
'price_includes_vat': True,
'registration_date': '2018-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'Lexus NX 300H F SPORT 2.5 5dr',
'transmission': 'automatic',
'trim': 'F Sport',
'year': 2018}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510086984451%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510086984451: {'created_time': 1774883255.889768, 'last_price_update_time': 1774883255.889781}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510086984451') HTTP/1.1" 204 0
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc0bfa5-df65-59cd-a3df-eb8dd940f4d5 with identifier: 202510016774252
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3cc0bfa5-df65-59cd-a3df-eb8dd940f4d5
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbe39daad3fc4453f8f2a029fea86c704.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/be39daad3fc4453f8f2a029fea86c704.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe357a482ac04bee8fee2c6506691a15.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe357a482ac04bee8fee2c6506691a15.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa7092f4488fd4f06aa059a9cefe9e21b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a7092f4488fd4f06aa059a9cefe9e21b.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F46890b9251344eaaa91abf91fd37bbd1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/46890b9251344eaaa91abf91fd37bbd1.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b7ae25f8dc9432b9125aae14040b20b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b7ae25f8dc9432b9125aae14040b20b.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F94a307b0b58f4fb7a13bf8b73ec75a5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/94a307b0b58f4fb7a13bf8b73ec75a5d.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11b42be558884701865b46f2163a7418.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11b42be558884701865b46f2163a7418.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc33ee99e0ae6444eb85ccc3ec6598272.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c33ee99e0ae6444eb85ccc3ec6598272.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc8e9ea0b9df4afeaf1ed713069f603d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc8e9ea0b9df4afeaf1ed713069f603d.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F472db85aa8d441c39bb32511a627c19f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/472db85aa8d441c39bb32511a627c19f.jpg already downloaded
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3cc0bfa5-df65-59cd-a3df-eb8dd940f4d5 with identifier 202510016774252
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3cc0bfa5-df65-59cd-a3df-eb8dd940f4d5
2026-03-30 15:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 202,
'color': 'Silver',
'currency': 'GBP',
'description': 'Cruise In Style In This Exquisite Land Rover Range Rover '
'Sport SDV6 Autobiography Dynamic | 3.0 Diesel | Automatic | '
'4WD | Full HPI Clear | Excellent Service History With 7 '
'Records, Mostly From Range Rover | Euro 6, Ulez Compliant | '
'Only 2 Former Keepers From New | 2 Keys | Will Come With Long '
'MOT Until 23/12/2026 | Well Maintained With No Advisories On '
"Any Previous MOT's! | Huge Spec Including Sliding Panoramic "
'Sunroof, Full Leather Interior With Heated Front Seats, '
'Heated Steering Wheel, Electric Front Seats With Drivers '
'Memory Function, 360 Reverse Parking Camera & Sensors & Much '
'More! | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great 5-Day '
'AA Driveaway Insurance Available From Just £44.99 (Subject To '
'Eligibility) | 10% Off AA Comprehensive Car Insurance Any '
'Inspection Or Test Drive Welcome | Nationwide Delivery '
'Service Available | Viewing Is Highly Recommended | Upgraded '
'Warranty Cover Is Available From Only £200 Giving You That '
'Added Peace Of Mind (6,12,24 Month Covers Available) | '
'Competitive Prices Paid For Part Exchanges | All Of Our '
'Vehicles Are HPI Checked And Mileage Checked ++ Sliding '
'Panoramic Sunroof ++ 360 Cameras & Sensors ++ Full Leather '
'Interior With Heated Front Seats ++ Electric Front Seats With '
'Drivers Memory Function & Folding Arm Rests ++ Heated '
'Steering Wheel ++ Digital Cockpit ++ Keyless Entry & Start ++ '
'Electric Tailgate ++ Satellite Navigation ++ Bluetooth ++ DAB '
'Radio ++ Andriod Auto & Apple CarPlay ++ Lane Assist ++ Blind '
'Spot Cameras ++ Cruise Control With Speed Limiter ++ '
'Adjustable Drive Modes ++ 4-Zone Climate Control ++ Meridian '
'Speaker System ++ Multi-functional Steering Wheel ++ Steering '
'Mounted Gear Shifting Paddles ++ Electric Parking Brake ++ '
'Automatic Headlights & Windscreen Wipers ++ Chilled Center '
'Console ++ Electric Folding Wing Mirrors ++ Retractable '
'Parcel Shelf ++ Isofix Anchor Points ++ Rear Privacy Windows '
'++ Deployable Towbar ++ Spare Wheel ++ ** All Major Debit '
'And Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 302,
'fuel_type': 'Diesel',
'id': '3cc0bfa5-df65-59cd-a3df-eb8dd940f4d5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510016774252',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 84315,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 75,
'photo_urls': ['https://m.atcdn.co.uk/a/media/be39daad3fc4453f8f2a029fea86c704.jpg',
'https://m.atcdn.co.uk/a/media/fe357a482ac04bee8fee2c6506691a15.jpg',
'https://m.atcdn.co.uk/a/media/a7092f4488fd4f06aa059a9cefe9e21b.jpg',
'https://m.atcdn.co.uk/a/media/46890b9251344eaaa91abf91fd37bbd1.jpg',
'https://m.atcdn.co.uk/a/media/6b7ae25f8dc9432b9125aae14040b20b.jpg',
'https://m.atcdn.co.uk/a/media/94a307b0b58f4fb7a13bf8b73ec75a5d.jpg',
'https://m.atcdn.co.uk/a/media/11b42be558884701865b46f2163a7418.jpg',
'https://m.atcdn.co.uk/a/media/c33ee99e0ae6444eb85ccc3ec6598272.jpg',
'https://m.atcdn.co.uk/a/media/cc8e9ea0b9df4afeaf1ed713069f603d.jpg',
'https://m.atcdn.co.uk/a/media/472db85aa8d441c39bb32511a627c19f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104622,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/be39daad3fc4453f8f2a029fea86c704.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94662,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe357a482ac04bee8fee2c6506691a15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108533,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a7092f4488fd4f06aa059a9cefe9e21b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108399,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/46890b9251344eaaa91abf91fd37bbd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103340,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b7ae25f8dc9432b9125aae14040b20b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93347,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/94a307b0b58f4fb7a13bf8b73ec75a5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103654,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/11b42be558884701865b46f2163a7418.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107600,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c33ee99e0ae6444eb85ccc3ec6598272.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78778,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cc8e9ea0b9df4afeaf1ed713069f603d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70b19b7f-54ec-5c0f-9377-b81971a59854/70b19b7f-54ec-5c0f-9377-b81971a59854_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60733,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/472db85aa8d441c39bb32511a627c19f.jpg',
'Width': 800}],
'price': 25990,
'price_includes_vat': True,
'registration_date': '2018-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport SDV6 AUTOBIOGRAPHY DYNAMIC 3.0 5dr',
'transmission': 'automatic',
'trim': 'Autobiography Dynamic',
'year': 2018}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510016774252%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510016774252: {'created_time': 1774883256.134559, 'last_price_update_time': 1774883256.134575}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510016774252') HTTP/1.1" 204 0
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0eab7d81-cbb3-5fc8-ac31-166f870cc670 with identifier: 202509196469354
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0eab7d81-cbb3-5fc8-ac31-166f870cc670
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0e99ef0964f409c99e735d9b4d366ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0e99ef0964f409c99e735d9b4d366ac.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e2cd711b1324257be494d24967fa1cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e2cd711b1324257be494d24967fa1cc.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1f157b134dc0493080bef5940007966d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1f157b134dc0493080bef5940007966d.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a605656a6474b72a63e75041a51a797.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a605656a6474b72a63e75041a51a797.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3fb231d821294bc4b376009984776772.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3fb231d821294bc4b376009984776772.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1437e455fb14b9999464effee869709.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1437e455fb14b9999464effee869709.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9b95973ecd249458b585893498ea6a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9b95973ecd249458b585893498ea6a6.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13353dde1b3648f1bb6d158ff3816c9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13353dde1b3648f1bb6d158ff3816c9f.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3692c2828f154d19964ca06e1e7741a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3692c2828f154d19964ca06e1e7741a7.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5884134c4ced44f9a532a194892a245d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5884134c4ced44f9a532a194892a245d.jpg already downloaded
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0eab7d81-cbb3-5fc8-ac31-166f870cc670 with identifier 202509196469354
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0eab7d81-cbb3-5fc8-ac31-166f870cc670
2026-03-30 15:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 170,
'color': 'White',
'currency': 'GBP',
'description': 'AQ Car Sales Are Proud To Present This Stunning Audi Q5 TDI '
'Quattro S Line | 2.0 Diesel | Automatic | Full HPI Clear | '
'Service History | Euro 6, Ulez Compliant | Only 1 Former '
'Keepers From New | 2 Keys | Will Come With 12 Months MOT | '
'Well Maintained | Huge Spec Including Half Leather S Line '
'Interior With Heated Extendable Front Seats, Wireless '
'Charging Pad, Satellite Navigation, Electric Tailgate & Much '
'More! | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great 5-Day '
'AA Driveaway Insurance Available From Just £44.99 (Subject To '
'Eligibility) | 10% Off AA Comprehensive Car Insurance Any '
'Inspection Or Test Drive Welcome | Nationwide Delivery '
'Service Available | Viewing Is Highly Recommended | Upgraded '
'Warranty Cover Is Available From Only £200 Giving You That '
'Added Peace Of Mind (6,12,24 Month Covers Available) | '
'Competitive Prices Paid For Part Exchanges | All Of Our '
'Vehicles Are HPI Checked And Mileage Checked ++ Reverse '
'Parking Camera ++ Front & Rear Parking Sensors ++ Wireless '
'Charging Pad ++ Keyless Start ++ Half Leather S Line Interior '
'With Heated Extendable Front Seats ++ Electric Tailgate ++ '
'Digital Cockpit ++ Satellite Navigation ++ Bluetooth ++ DAB '
'Radio ++ Apple CarPlay & Andriod Auto ++ USC ++ Audi Drive '
'Select ++ Speed Warning ++ Audi Pre Sense ++ 3-Zone Climate '
'Control ++ Stop/Start System ++ Multi-functional Steering '
'Wheel ++ Electric Parking Brake With Auto Hold Function ++ '
'Steering Mounted Gear Shifting Paddles ++ Automatic '
'Headlights & Windscreen Wipers ++ Isofix Anchor Points ++ '
'Electric Heated Folding Wing Mirrors ++ Retractable Parcel '
'Shelf ++ Daytime Running Lights ++ ** All Major Debit And '
'Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 201,
'fuel_type': 'Diesel',
'id': '0eab7d81-cbb3-5fc8-ac31-166f870cc670',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509196469354',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Audi',
'model': 'Q5',
'odometer': 91640,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 58,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b0e99ef0964f409c99e735d9b4d366ac.jpg',
'https://m.atcdn.co.uk/a/media/9e2cd711b1324257be494d24967fa1cc.jpg',
'https://m.atcdn.co.uk/a/media/1f157b134dc0493080bef5940007966d.jpg',
'https://m.atcdn.co.uk/a/media/4a605656a6474b72a63e75041a51a797.jpg',
'https://m.atcdn.co.uk/a/media/3fb231d821294bc4b376009984776772.jpg',
'https://m.atcdn.co.uk/a/media/c1437e455fb14b9999464effee869709.jpg',
'https://m.atcdn.co.uk/a/media/c9b95973ecd249458b585893498ea6a6.jpg',
'https://m.atcdn.co.uk/a/media/13353dde1b3648f1bb6d158ff3816c9f.jpg',
'https://m.atcdn.co.uk/a/media/3692c2828f154d19964ca06e1e7741a7.jpg',
'https://m.atcdn.co.uk/a/media/5884134c4ced44f9a532a194892a245d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92056,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0e99ef0964f409c99e735d9b4d366ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90854,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e2cd711b1324257be494d24967fa1cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95610,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1f157b134dc0493080bef5940007966d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95924,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a605656a6474b72a63e75041a51a797.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94985,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3fb231d821294bc4b376009984776772.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87761,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c1437e455fb14b9999464effee869709.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91350,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9b95973ecd249458b585893498ea6a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96538,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13353dde1b3648f1bb6d158ff3816c9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74961,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3692c2828f154d19964ca06e1e7741a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_610262b2-a894-5ee6-9124-cb8941d4272a/610262b2-a894-5ee6-9124-cb8941d4272a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65656,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5884134c4ced44f9a532a194892a245d.jpg',
'Width': 800}],
'price': 20990,
'price_includes_vat': True,
'registration_date': '2021-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 TDI QUATTRO S LINE 2.0 5dr',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509196469354%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509196469354: {'created_time': 1774883256.914018, 'last_price_update_time': 1774883256.914029}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509196469354') HTTP/1.1" 204 0
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 556740ea-4682-5046-b939-84c8eb66b3eb with identifier: 202509196469352
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 556740ea-4682-5046-b939-84c8eb66b3eb
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0fd3e473d6ca4cd492b9fcd0610304bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0fd3e473d6ca4cd492b9fcd0610304bb.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5d1d32a503b4585bb968c24d1af2e3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5d1d32a503b4585bb968c24d1af2e3e.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F64a58ed7dc084d6685edc88ae963318f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/64a58ed7dc084d6685edc88ae963318f.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9942f5cb3014016ad9b3cf6b4b11770.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9942f5cb3014016ad9b3cf6b4b11770.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F475a3a2b0ce84b698e7c581d233e22ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/475a3a2b0ce84b698e7c581d233e22ad.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fee813a560b014ff8999a5f808b5463d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ee813a560b014ff8999a5f808b5463d7.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F531e9da21f8c47a090bf3cb6ea99e854.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/531e9da21f8c47a090bf3cb6ea99e854.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8dcd29bc1ad4f5e8b415bd9d7359bb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8dcd29bc1ad4f5e8b415bd9d7359bb3.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e2cced304bc4e5a97b0db037a3b6ff2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e2cced304bc4e5a97b0db037a3b6ff2.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6f2ced1ddc1a47b881d3069e58a41c6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6f2ced1ddc1a47b881d3069e58a41c6b.jpg already downloaded
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 556740ea-4682-5046-b939-84c8eb66b3eb with identifier 202509196469352
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 556740ea-4682-5046-b939-84c8eb66b3eb
2026-03-30 15:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 144,
'color': 'Grey',
'currency': 'GBP',
'description': 'AQ Car Sales Are Proud To Present This Stunning Audi Q3 TDI '
'Quattro S Line Plus | 2.0 Diesel | Automatic | Full HPI '
'Clear | Good Service History With 3 Recent Records | Low '
'Mileage | Euro 6, Ulez Compliant | Only 2 Former Keepers From '
'New, Last Keeper Owned Since 2022 | 2 Keys | Will Come With '
'12 Months MOT | Well Maintained | Excellent Spec Including '
'Half Leather S Line Interior With Extendable Front Seats, '
'Front & Rear Parking Sensors, Electric Tailgate, Bluetooth & '
'More | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great 5-Day '
'AA Driveaway Insurance Available From Just £44.99 (Subject To '
'Eligibility) | 10% Off AA Comprehensive Car Insurance Any '
'Inspection Or Test Drive Welcome | Nationwide Delivery '
'Service Available | Viewing Is Highly Recommended | Upgraded '
'Warranty Cover Is Available From Only £200 Giving You That '
'Added Peace Of Mind (6,12,24 Month Covers Available) | '
'Competitive Prices Paid For Part Exchanges | All Of Our '
'Vehicles Are HPI Checked And Mileage Checked ++ Front & Rear '
'Parking Sensors ++ Half Leather S Line Interior With '
'Extendable Front Seats ++ Electric Tailgate ++ Satellite '
'Navigation Capabilities ++ Bluetooth ++ CD Player ++ Audi '
'Drive Select ++ Cruise Control ++ Dual Climate Control ++ '
'Stop/Start System ++ Multi-functional Steering Wheel ++ '
'Steering Mounted Gear Shifting Paddles ++ Automatic '
'Headlights & Windscreen Wipers ++ Isofix Anchor Points ++ '
'Electric Heated Wing Mirrors ++ Chilled Glove Compartment ++ '
'Retractable Parcel Shelf ++ Daytime Running Lights ++ ** '
'All Major Debit And Credit Cards Accepted | Open 7 Days A '
'Week With No Appointments Necessary | Late Night Viewings '
'Available By Appointment Only | All Of Our Cars Are Ready To '
'Drive Away Today | Call Our Sales Team Today on 01709 925272 '
'To Arrange A Test Drive | Leave A Deposit To Secure This '
'Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': '556740ea-4682-5046-b939-84c8eb66b3eb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509196469352',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Audi',
'model': 'Q3',
'odometer': 60582,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 51,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0fd3e473d6ca4cd492b9fcd0610304bb.jpg',
'https://m.atcdn.co.uk/a/media/f5d1d32a503b4585bb968c24d1af2e3e.jpg',
'https://m.atcdn.co.uk/a/media/64a58ed7dc084d6685edc88ae963318f.jpg',
'https://m.atcdn.co.uk/a/media/c9942f5cb3014016ad9b3cf6b4b11770.jpg',
'https://m.atcdn.co.uk/a/media/475a3a2b0ce84b698e7c581d233e22ad.jpg',
'https://m.atcdn.co.uk/a/media/ee813a560b014ff8999a5f808b5463d7.jpg',
'https://m.atcdn.co.uk/a/media/531e9da21f8c47a090bf3cb6ea99e854.jpg',
'https://m.atcdn.co.uk/a/media/a8dcd29bc1ad4f5e8b415bd9d7359bb3.jpg',
'https://m.atcdn.co.uk/a/media/8e2cced304bc4e5a97b0db037a3b6ff2.jpg',
'https://m.atcdn.co.uk/a/media/6f2ced1ddc1a47b881d3069e58a41c6b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100585,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0fd3e473d6ca4cd492b9fcd0610304bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97982,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f5d1d32a503b4585bb968c24d1af2e3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105077,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/64a58ed7dc084d6685edc88ae963318f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102019,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9942f5cb3014016ad9b3cf6b4b11770.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103368,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/475a3a2b0ce84b698e7c581d233e22ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96406,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee813a560b014ff8999a5f808b5463d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102543,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/531e9da21f8c47a090bf3cb6ea99e854.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100171,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a8dcd29bc1ad4f5e8b415bd9d7359bb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75694,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8e2cced304bc4e5a97b0db037a3b6ff2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8a04867-bdd8-54d2-8de3-f404b841fba3/f8a04867-bdd8-54d2-8de3-f404b841fba3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92242,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6f2ced1ddc1a47b881d3069e58a41c6b.jpg',
'Width': 800}],
'price': 12990,
'price_includes_vat': True,
'registration_date': '2015-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 TDI QUATTRO S LINE PLUS 2.0 5dr',
'transmission': 'automatic',
'trim': 'S line Plus',
'year': 2015}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509196469352%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509196469352: {'created_time': 1774883257.20329, 'last_price_update_time': 1774883257.203303}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509196469352') HTTP/1.1" 204 0
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 78e3f365-d3e6-5270-9809-db87a922ac64 with identifier: 202408243230944
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78e3f365-d3e6-5270-9809-db87a922ac64
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb47f21d3a2d4628830b678c4f053e3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb47f21d3a2d4628830b678c4f053e3a.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F912a2b6ad64e434397857e907ee77930.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/912a2b6ad64e434397857e907ee77930.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1bf1296acc504ee7a19a86a56a3854b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1bf1296acc504ee7a19a86a56a3854b9.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1d1aa6eed5f5483a84dd2e248403e5ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1d1aa6eed5f5483a84dd2e248403e5ec.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffccbbd9eb2c04fc28135e1ac7588c7fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fccbbd9eb2c04fc28135e1ac7588c7fd.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b5132d56db54e908662d3bd29dac49e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b5132d56db54e908662d3bd29dac49e.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff29b5a7b27c74d3da77fbcc0f55676c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f29b5a7b27c74d3da77fbcc0f55676c1.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79ba2631778d446fa1f547ced3bd4547.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79ba2631778d446fa1f547ced3bd4547.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa369e3ca85048e7925fb5f945bf80c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa369e3ca85048e7925fb5f945bf80c7.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4162c184da24d9e8a3305802823edd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4162c184da24d9e8a3305802823edd3.jpg already downloaded
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 78e3f365-d3e6-5270-9809-db87a922ac64 with identifier 202408243230944
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 78e3f365-d3e6-5270-9809-db87a922ac64
2026-03-30 15:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Black',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Renault Clio Iconic DCI | '
'1.5 Diesel | 6 Speed Manual Full HPI Clear | Service History '
'| Euro 6, Ulez Compliant | Cheap To Run | Only 1 Former '
'Keepers From New | 2 Keys | Will Come With 12 Months MOT | '
'Well Maintained | Excellent Spec Including Satellite '
'Navigation, Bluetooth, Cruise Control & More | Free Interim '
'Service Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6 & 12 Month Covers Available) | Competitive Prices Paid For '
'Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Rear Parking Sensors ++ Keyless Start ++ '
'Satellite Navigation ++ Bluetooth ++ USB/AUX ++ Stop/Start '
'System ++ ECO Drive Mode ++ Lane Assist ++ Adaptive Cruise '
'Cotntrol ++ Speed Limiter ++ Traffic Sign Recognition ++ '
'Brake Assist ++ Multi-functional Steering Wheel ++ Isofix '
'Anchor Points ++ Automatic Headlights & Windscreen Wipers ++ '
'Electric Folding Wing Mirrors ++ Spare Wheel ++ ** All Major '
'Debit And Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 84,
'fuel_type': 'Diesel',
'id': '78e3f365-d3e6-5270-9809-db87a922ac64',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202408243230944',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Renault',
'model': 'Clio',
'odometer': 91917,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 58,
'photo_urls': ['https://m.atcdn.co.uk/a/media/eb47f21d3a2d4628830b678c4f053e3a.jpg',
'https://m.atcdn.co.uk/a/media/912a2b6ad64e434397857e907ee77930.jpg',
'https://m.atcdn.co.uk/a/media/1bf1296acc504ee7a19a86a56a3854b9.jpg',
'https://m.atcdn.co.uk/a/media/1d1aa6eed5f5483a84dd2e248403e5ec.jpg',
'https://m.atcdn.co.uk/a/media/fccbbd9eb2c04fc28135e1ac7588c7fd.jpg',
'https://m.atcdn.co.uk/a/media/6b5132d56db54e908662d3bd29dac49e.jpg',
'https://m.atcdn.co.uk/a/media/f29b5a7b27c74d3da77fbcc0f55676c1.jpg',
'https://m.atcdn.co.uk/a/media/79ba2631778d446fa1f547ced3bd4547.jpg',
'https://m.atcdn.co.uk/a/media/aa369e3ca85048e7925fb5f945bf80c7.jpg',
'https://m.atcdn.co.uk/a/media/c4162c184da24d9e8a3305802823edd3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108722,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eb47f21d3a2d4628830b678c4f053e3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108732,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/912a2b6ad64e434397857e907ee77930.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109047,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1bf1296acc504ee7a19a86a56a3854b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106488,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1d1aa6eed5f5483a84dd2e248403e5ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110343,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fccbbd9eb2c04fc28135e1ac7588c7fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94383,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b5132d56db54e908662d3bd29dac49e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108323,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f29b5a7b27c74d3da77fbcc0f55676c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104763,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79ba2631778d446fa1f547ced3bd4547.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74332,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa369e3ca85048e7925fb5f945bf80c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1/26b6491a-a65a-5bac-b59f-bd3b7ee8a2d1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74083,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c4162c184da24d9e8a3305802823edd3.jpg',
'Width': 800}],
'price': 6990,
'price_includes_vat': True,
'registration_date': '2020-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio ICONIC DCI 1.5 5dr',
'transmission': 'manual',
'trim': 'Iconic',
'year': 2020}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202408243230944%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202408243230944: {'created_time': 1774883257.443537, 'last_price_update_time': 1774883257.443547}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202408243230944') HTTP/1.1" 204 0
2026-03-30 15:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fec8230-e665-59e1-8d2e-30ef0eb337b8 with identifier: 202603100573779
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fec8230-e665-59e1-8d2e-30ef0eb337b8
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0a547bbf29c4acbbe971ab7d25c428f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0a547bbf29c4acbbe971ab7d25c428f.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd5c52c01854642788db6589d921f95cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d5c52c01854642788db6589d921f95cf.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F70fdca5bbc264a339b0d199e7ab39927.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/70fdca5bbc264a339b0d199e7ab39927.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3450dd2922a14cf9ba3b307dc20c0795.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3450dd2922a14cf9ba3b307dc20c0795.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5684d3e50544368b48bb05d6644c335.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5684d3e50544368b48bb05d6644c335.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5217207391e5415f924cfda86a61622b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5217207391e5415f924cfda86a61622b.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdd04a867de9c4214bcfbd09dbd79a656.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dd04a867de9c4214bcfbd09dbd79a656.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa85ecb117a94712bbce12fc42010939.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa85ecb117a94712bbce12fc42010939.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Facadff4771da44c4b5cec38a67081d32.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/acadff4771da44c4b5cec38a67081d32.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73e90a450c8640e983f87a2a14d3e4f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73e90a450c8640e983f87a2a14d3e4f5.jpg already downloaded
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3fec8230-e665-59e1-8d2e-30ef0eb337b8 with identifier 202603100573779
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3fec8230-e665-59e1-8d2e-30ef0eb337b8
2026-03-30 15:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'White',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Kia Sportage CRDI KX-3 | 2.0 Diesel | Automatic | '
'AWD | In The Best Colour White | Full Service History With '
'10 Records | Full HPI Clear | Euro 6, Ulez Compliant | Only 2 '
'Owners From New, Last Keeper Owned Since 2019 | 2 Keys | Will '
'Come With 12 Months MOT | Well Maintained With No Advisories '
"On The Previous 4 MOT's! | Excellent Spec Including Full "
'Leather Interior With Heated Front Seats, Satellite '
'Navigation, Bluetooth, Cruise Control & More | Free Interim '
'Service Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ** All Major Debit And Credit Cards Accepted '
'| Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 136,
'fuel_type': 'Diesel',
'id': '3fec8230-e665-59e1-8d2e-30ef0eb337b8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100573779',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Kia',
'model': 'Sportage',
'odometer': 79905,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 56,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f0a547bbf29c4acbbe971ab7d25c428f.jpg',
'https://m.atcdn.co.uk/a/media/d5c52c01854642788db6589d921f95cf.jpg',
'https://m.atcdn.co.uk/a/media/70fdca5bbc264a339b0d199e7ab39927.jpg',
'https://m.atcdn.co.uk/a/media/3450dd2922a14cf9ba3b307dc20c0795.jpg',
'https://m.atcdn.co.uk/a/media/f5684d3e50544368b48bb05d6644c335.jpg',
'https://m.atcdn.co.uk/a/media/5217207391e5415f924cfda86a61622b.jpg',
'https://m.atcdn.co.uk/a/media/dd04a867de9c4214bcfbd09dbd79a656.jpg',
'https://m.atcdn.co.uk/a/media/fa85ecb117a94712bbce12fc42010939.jpg',
'https://m.atcdn.co.uk/a/media/acadff4771da44c4b5cec38a67081d32.jpg',
'https://m.atcdn.co.uk/a/media/73e90a450c8640e983f87a2a14d3e4f5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88213,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f0a547bbf29c4acbbe971ab7d25c428f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86566,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d5c52c01854642788db6589d921f95cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94202,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/70fdca5bbc264a339b0d199e7ab39927.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92720,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3450dd2922a14cf9ba3b307dc20c0795.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86568,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f5684d3e50544368b48bb05d6644c335.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81240,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5217207391e5415f924cfda86a61622b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87107,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dd04a867de9c4214bcfbd09dbd79a656.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90979,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa85ecb117a94712bbce12fc42010939.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77170,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/acadff4771da44c4b5cec38a67081d32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fec8230-e665-59e1-8d2e-30ef0eb337b8/3fec8230-e665-59e1-8d2e-30ef0eb337b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78899,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73e90a450c8640e983f87a2a14d3e4f5.jpg',
'Width': 800}],
'price': 9990,
'price_includes_vat': True,
'registration_date': '2017-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Sportage CRDI KX-3 2.0 5dr',
'transmission': 'automatic',
'trim': 'KX-3',
'year': 2017}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100573779%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100573779: {'created_time': 1774883258.172566, 'last_price_update_time': 1774883258.172577}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100573779') HTTP/1.1" 204 0
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d8e1140c-5c09-5bc0-9b64-b43277087429 with identifier: 202603100573778
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8e1140c-5c09-5bc0-9b64-b43277087429
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1a4cf7f9303e4772817b4618a6dc9b3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1a4cf7f9303e4772817b4618a6dc9b3a.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11421fe3186b4a61969fbd252c6fd02d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11421fe3186b4a61969fbd252c6fd02d.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89850417bb36493b85ce691bc7af81f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89850417bb36493b85ce691bc7af81f9.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28cb2920a02a48f7b850cbe0afdf99c7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28cb2920a02a48f7b850cbe0afdf99c7.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48a2d4be68194bae96e6cc4b932ab4e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48a2d4be68194bae96e6cc4b932ab4e3.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F862081d546fb44fb9d1bc9a826b01e6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/862081d546fb44fb9d1bc9a826b01e6c.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fab63ec6b78074a61a873092bd636d0cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ab63ec6b78074a61a873092bd636d0cc.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa653ce7e86ed4331a86d9c6632c6a464.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a653ce7e86ed4331a86d9c6632c6a464.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1a0693d995ad4f078a80ad67a78eb320.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1a0693d995ad4f078a80ad67a78eb320.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F70e3d0c464a84fed88d00b031c162b99.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/70e3d0c464a84fed88d00b031c162b99.jpg already downloaded
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d8e1140c-5c09-5bc0-9b64-b43277087429 with identifier 202603100573778
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d8e1140c-5c09-5bc0-9b64-b43277087429
2026-03-30 15:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'Grey',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Kia XCeed 2 ISG | '
'1.0 Petrol | 6 Speed Manual | Full HPI Clear | Good '
'Service History With 3 Records | Euro 6, Ulez Compliant | '
'Cheap To Run | Only 1 Former Keepers From New | 2 Keys | Will '
'Come With Long MOT Until 21/09/2026 | Excellent Spec '
'Including Bluetooth, Cruise Control & More | Free Interim '
'Service Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection '
'Or Test Drive Welcome | Nationwide Delivery Service Available '
'| Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ** All Major Debit And Credit Cards '
'Accepted | Open 7 Days A Week With No Appointments Necessary '
'| Late Night Viewings Available By Appointment Only | All Of '
'Our Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 118,
'fuel_type': 'Petrol',
'id': 'd8e1140c-5c09-5bc0-9b64-b43277087429',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100573778',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Kia',
'model': 'XCeed',
'odometer': 98850,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photo_urls': ['https://m.atcdn.co.uk/a/media/1a4cf7f9303e4772817b4618a6dc9b3a.jpg',
'https://m.atcdn.co.uk/a/media/11421fe3186b4a61969fbd252c6fd02d.jpg',
'https://m.atcdn.co.uk/a/media/89850417bb36493b85ce691bc7af81f9.jpg',
'https://m.atcdn.co.uk/a/media/28cb2920a02a48f7b850cbe0afdf99c7.jpg',
'https://m.atcdn.co.uk/a/media/48a2d4be68194bae96e6cc4b932ab4e3.jpg',
'https://m.atcdn.co.uk/a/media/862081d546fb44fb9d1bc9a826b01e6c.jpg',
'https://m.atcdn.co.uk/a/media/ab63ec6b78074a61a873092bd636d0cc.jpg',
'https://m.atcdn.co.uk/a/media/a653ce7e86ed4331a86d9c6632c6a464.jpg',
'https://m.atcdn.co.uk/a/media/1a0693d995ad4f078a80ad67a78eb320.jpg',
'https://m.atcdn.co.uk/a/media/70e3d0c464a84fed88d00b031c162b99.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100298,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a4cf7f9303e4772817b4618a6dc9b3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98783,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/11421fe3186b4a61969fbd252c6fd02d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108107,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/89850417bb36493b85ce691bc7af81f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100378,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/28cb2920a02a48f7b850cbe0afdf99c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102729,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/48a2d4be68194bae96e6cc4b932ab4e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94113,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/862081d546fb44fb9d1bc9a826b01e6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101191,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab63ec6b78074a61a873092bd636d0cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97883,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a653ce7e86ed4331a86d9c6632c6a464.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78059,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a0693d995ad4f078a80ad67a78eb320.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8e1140c-5c09-5bc0-9b64-b43277087429/d8e1140c-5c09-5bc0-9b64-b43277087429_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84794,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/70e3d0c464a84fed88d00b031c162b99.jpg',
'Width': 800}],
'price': 7990,
'price_includes_vat': True,
'registration_date': '2020-01-06',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Ceed XCEED 2 ISG 1.0 5dr',
'transmission': 'manual',
'trim': '2',
'year': 2020}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100573778%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100573778: {'created_time': 1774883258.433062, 'last_price_update_time': 1774883258.433072}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100573778') HTTP/1.1" 204 0
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: dcfe77f1-4c82-5817-a4a5-85faaec162e8 with identifier: 202603100573777
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcfe77f1-4c82-5817-a4a5-85faaec162e8
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6f83f218f06f490387a76a0bfae0a569.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6f83f218f06f490387a76a0bfae0a569.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F59c2d03f61a04b10998f0c5a3044b7de.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/59c2d03f61a04b10998f0c5a3044b7de.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9ed0f7d5c83a4b239ceb40cbd946e9ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9ed0f7d5c83a4b239ceb40cbd946e9ba.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a4ef212c048416ba179268a0c00a604.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a4ef212c048416ba179268a0c00a604.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff94d6d9b072946d9952cc457a93047d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f94d6d9b072946d9952cc457a93047d9.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F05864d3e27324ed1bfc96d65ebccaf21.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/05864d3e27324ed1bfc96d65ebccaf21.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcab66f9358ff49c9b219b9b54b9180ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cab66f9358ff49c9b219b9b54b9180ea.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fda96cad07d40481b8eeaeaaea81aee30.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/da96cad07d40481b8eeaeaaea81aee30.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ee3745cf49a4883847ef8a28f972368.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ee3745cf49a4883847ef8a28f972368.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F592fd16f8a4545d78483344a7c1a58ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/592fd16f8a4545d78483344a7c1a58ec.jpg already downloaded
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: dcfe77f1-4c82-5817-a4a5-85faaec162e8 with identifier 202603100573777
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item dcfe77f1-4c82-5817-a4a5-85faaec162e8
2026-03-30 15:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'Silver',
'currency': 'GBP',
'description': 'Here We Have A Stunning Example Of A Seat Ibiza TSI Connect | '
'1.2 Petrol | Manual | Full HPI Clear | Good Service '
'History With 4 Records | Low Mileage | Ulez Compliant | Cheap '
'To Run With Only £35 Road Tax! | Only 1 Former Keepers From '
'New | 2 Keys | Will Come With Long MOT Until 23/02/2027 | '
'Excellent Spec Including Satellite Navigation, Bluetooth & '
'More | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great '
'5-Day AA Driveaway Insurance Available From Just £44.99 '
'(Subject To Eligibility) | 10% Off AA Comprehensive Car '
'Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': 'dcfe77f1-4c82-5817-a4a5-85faaec162e8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100573777',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'SEAT',
'model': 'Ibiza',
'odometer': 72856,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6f83f218f06f490387a76a0bfae0a569.jpg',
'https://m.atcdn.co.uk/a/media/59c2d03f61a04b10998f0c5a3044b7de.jpg',
'https://m.atcdn.co.uk/a/media/9ed0f7d5c83a4b239ceb40cbd946e9ba.jpg',
'https://m.atcdn.co.uk/a/media/6a4ef212c048416ba179268a0c00a604.jpg',
'https://m.atcdn.co.uk/a/media/f94d6d9b072946d9952cc457a93047d9.jpg',
'https://m.atcdn.co.uk/a/media/05864d3e27324ed1bfc96d65ebccaf21.jpg',
'https://m.atcdn.co.uk/a/media/cab66f9358ff49c9b219b9b54b9180ea.jpg',
'https://m.atcdn.co.uk/a/media/da96cad07d40481b8eeaeaaea81aee30.jpg',
'https://m.atcdn.co.uk/a/media/6ee3745cf49a4883847ef8a28f972368.jpg',
'https://m.atcdn.co.uk/a/media/592fd16f8a4545d78483344a7c1a58ec.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98059,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6f83f218f06f490387a76a0bfae0a569.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92207,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/59c2d03f61a04b10998f0c5a3044b7de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106651,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9ed0f7d5c83a4b239ceb40cbd946e9ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100841,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6a4ef212c048416ba179268a0c00a604.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103407,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f94d6d9b072946d9952cc457a93047d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93126,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/05864d3e27324ed1bfc96d65ebccaf21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103457,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cab66f9358ff49c9b219b9b54b9180ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97867,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/da96cad07d40481b8eeaeaaea81aee30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77035,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ee3745cf49a4883847ef8a28f972368.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcfe77f1-4c82-5817-a4a5-85faaec162e8/dcfe77f1-4c82-5817-a4a5-85faaec162e8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76114,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/592fd16f8a4545d78483344a7c1a58ec.jpg',
'Width': 800}],
'price': 5890,
'price_includes_vat': True,
'registration_date': '2016-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT Ibiza TSI CONNECT 1.2 5dr',
'transmission': 'manual',
'trim': 'Connect',
'year': 2016}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100573777%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100573777: {'created_time': 1774883258.688989, 'last_price_update_time': 1774883258.689002}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100573777') HTTP/1.1" 204 0
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c367a2f5-30c5-50b0-ad40-674b0fbc7d73 with identifier: 202603030369944
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c367a2f5-30c5-50b0-ad40-674b0fbc7d73
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6409694caac46af99bb641be0abc2f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6409694caac46af99bb641be0abc2f9.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9217cb993ec44609b54285d8bac621fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9217cb993ec44609b54285d8bac621fd.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2dc59bce48c94e6893765461913dadfe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2dc59bce48c94e6893765461913dadfe.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3057c6fc0b484453adcb9b2144461cc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3057c6fc0b484453adcb9b2144461cc0.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F282df735e9b541819fbab6305c25ec65.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/282df735e9b541819fbab6305c25ec65.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbcd36414f6f747448380c50b8e59d770.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bcd36414f6f747448380c50b8e59d770.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F76f4a2e151524b4d90e270a5d1dd31f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/76f4a2e151524b4d90e270a5d1dd31f6.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ea8fb8efd0a447da09f33b9f7533483.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ea8fb8efd0a447da09f33b9f7533483.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1e44e59ffae94ad79d860e57dcbda09b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1e44e59ffae94ad79d860e57dcbda09b.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7abe31a04bde46e98a97633008cdc14b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7abe31a04bde46e98a97633008cdc14b.jpg already downloaded
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c367a2f5-30c5-50b0-ad40-674b0fbc7d73 with identifier 202603030369944
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c367a2f5-30c5-50b0-ad40-674b0fbc7d73
2026-03-30 15:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'White',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Vauxhall Mokka Elite Nav | '
'1.4 Petrol | Automatic | Top Of The Range | In The Best '
'Colour White | Full HPI Clear | Very Low Mileage With Full '
'Service History 8 Records | Euro 6, Ulez Compliant | Cheap To '
'Run | Only 1 Former Keepers From New | Will Come With 12 '
'Months MOT | Well Maintained With No Advisories On Any '
'Previous MOT | Excellent Spec Including Full Leather Interior '
'With Heated Front Seats, Heated Steering Wheel, Satellite '
'Navigation & More | Free 3 Months Nationwide Warranty And '
'Free 12 Months Breakdown Cover With All Of Our Vehicles | '
'Well Looked After Example | Looks And Drives Great 5-Day AA '
'Driveaway Insurance Available For Just £44.99 (Subject To '
'Eligibility) | 10% Off AA Comprehensive Car Insurance Any '
'Inspection Or Test Drive Welcome | Nationwide Delivery '
'Service Available | Viewing Is Highly Recommended | Upgraded '
'Warranty Cover Is Available Giving You That Added Peace Of '
'Mind (6,12, Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Front & Rear Parking Sensors ++ Full '
'Leather Interior With Heated Extendable Front Seats ++ Heated '
'Steering Wheel ++ Satellite Navigation ++ DAB Radio ++ '
'Bluetooth ++ USB/AUX ++ Phone Projection ++ Cruise Control '
'With Speed Limiter ++ Stop/Start System ++ Mult-functional '
'Steering Wheel ++ Automatic Headlights & Windscreen Wipers ++ '
'Electric Folding Wing Mirrors ++ Folding Drivers Arm Rest ++ '
'Rear Privacy Windows ++ Daytime Running Lights ++ Spare Wheel '
'++ ** All Major Debit And Credit Cards Accepted | Open 7 '
'Days A Week With No Appointments Necessary | Late Night '
'Viewings Available By Appointment Only | All Of Our Cars Are '
'Ready To Drive Away Today | Call Our Sales Team Today on '
'01709 925272 To Arrange A Test Drive | Leave A Deposit To '
'Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.4L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': 'c367a2f5-30c5-50b0-ad40-674b0fbc7d73',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030369944',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Vauxhall',
'model': 'Mokka X',
'odometer': 36071,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f6409694caac46af99bb641be0abc2f9.jpg',
'https://m.atcdn.co.uk/a/media/9217cb993ec44609b54285d8bac621fd.jpg',
'https://m.atcdn.co.uk/a/media/2dc59bce48c94e6893765461913dadfe.jpg',
'https://m.atcdn.co.uk/a/media/3057c6fc0b484453adcb9b2144461cc0.jpg',
'https://m.atcdn.co.uk/a/media/282df735e9b541819fbab6305c25ec65.jpg',
'https://m.atcdn.co.uk/a/media/bcd36414f6f747448380c50b8e59d770.jpg',
'https://m.atcdn.co.uk/a/media/76f4a2e151524b4d90e270a5d1dd31f6.jpg',
'https://m.atcdn.co.uk/a/media/8ea8fb8efd0a447da09f33b9f7533483.jpg',
'https://m.atcdn.co.uk/a/media/1e44e59ffae94ad79d860e57dcbda09b.jpg',
'https://m.atcdn.co.uk/a/media/7abe31a04bde46e98a97633008cdc14b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84625,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f6409694caac46af99bb641be0abc2f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87009,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9217cb993ec44609b54285d8bac621fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91133,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2dc59bce48c94e6893765461913dadfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88375,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3057c6fc0b484453adcb9b2144461cc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86476,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/282df735e9b541819fbab6305c25ec65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84258,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bcd36414f6f747448380c50b8e59d770.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86226,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/76f4a2e151524b4d90e270a5d1dd31f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87098,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8ea8fb8efd0a447da09f33b9f7533483.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72276,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1e44e59ffae94ad79d860e57dcbda09b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c367a2f5-30c5-50b0-ad40-674b0fbc7d73/c367a2f5-30c5-50b0-ad40-674b0fbc7d73_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73583,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7abe31a04bde46e98a97633008cdc14b.jpg',
'Width': 800}],
'price': 9990,
'price_includes_vat': True,
'registration_date': '2016-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Vauxhall Mokka ELITE NAV 1.4 5dr',
'transmission': 'automatic',
'trim': 'Elite Nav',
'year': 2016}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030369944%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030369944: {'created_time': 1774883258.965796, 'last_price_update_time': 1774883258.965807}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030369944') HTTP/1.1" 204 0
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 547c5aaa-356c-5410-aeea-bcb89023caf3 with identifier: 202602240177729
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 547c5aaa-356c-5410-aeea-bcb89023caf3
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8d8652b3513644b195bb4957a0f033ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8d8652b3513644b195bb4957a0f033ff.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5917bb496aaf40a49aa79f2356574e19.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5917bb496aaf40a49aa79f2356574e19.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53d8ce5af1154877b4defeb7bd2b3805.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53d8ce5af1154877b4defeb7bd2b3805.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbbddb02a83514ed88e2e7790f0f193fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bbddb02a83514ed88e2e7790f0f193fe.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe1b8fd28398474d80cec541e938d21b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe1b8fd28398474d80cec541e938d21b.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F57761ce4a8604995a5ec84d6f92476bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/57761ce4a8604995a5ec84d6f92476bb.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F21e3f78e21194af9be1abc2f3cde54a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/21e3f78e21194af9be1abc2f3cde54a9.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa6f2d3dda07545fda115c69476d09340.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a6f2d3dda07545fda115c69476d09340.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff468939adb954ac1a2c76852e8a874f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f468939adb954ac1a2c76852e8a874f0.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0ffb509dbdb40748bd5c41154fcd2a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0ffb509dbdb40748bd5c41154fcd2a6.jpg already downloaded
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 547c5aaa-356c-5410-aeea-bcb89023caf3 with identifier 202602240177729
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 547c5aaa-356c-5410-aeea-bcb89023caf3
2026-03-30 15:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'White',
'currency': 'GBP',
'description': 'Drive Away Today In This Stunning Mazda 3 Sport Nav | 2.0 '
'Petrol | 6 Speed Manual | Full HPI Clear | Service History '
'| Ulez Compliant | Cheap To Run With Only £35 Road Tax | Only '
'2 Owners From New, Last Keeper Owned Since 2020 | 2 Keys | '
'Will Come With 12 Months MOT | Excellent Spec Including '
'Reverse Parking Camera & Sensors, Heated Front Seats, '
'Heads-Up Display, Satellite Navigation & More | Free Interim '
'Service Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Reverse Parking Camera ++ Front & Rear '
'Parking Sensors ++ Heated Front Seats ++ Heads-Up Display ++ '
'Keyless Start ++ Satellite Navigation ++ Bluetooth ++ DAB '
'Radio ++ CD Player/USB ++ Brake Assist ++ Traffic Sign '
'Recognition ++ Cruise Control With Speed Limiter ++ Dual '
'Climate Control ++ Stop/Start System ++ Bose Speaker System '
'++ Multi-functional Steering Wheel ++ Automatic Headlights & '
'Windscreen Wipers ++ Electric Parking Brake ++ Rear Privacy '
'Windows ++ Tyre Pressure Monitor System ++ Electric Wing '
'Mirrors ++ Isofix Anchor Points ++ ** All Major Debit And '
'Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 118,
'fuel_type': 'Petrol',
'id': '547c5aaa-356c-5410-aeea-bcb89023caf3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240177729',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Mazda',
'model': 'Mazda3',
'odometer': 122853,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 57,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8d8652b3513644b195bb4957a0f033ff.jpg',
'https://m.atcdn.co.uk/a/media/5917bb496aaf40a49aa79f2356574e19.jpg',
'https://m.atcdn.co.uk/a/media/53d8ce5af1154877b4defeb7bd2b3805.jpg',
'https://m.atcdn.co.uk/a/media/bbddb02a83514ed88e2e7790f0f193fe.jpg',
'https://m.atcdn.co.uk/a/media/fe1b8fd28398474d80cec541e938d21b.jpg',
'https://m.atcdn.co.uk/a/media/57761ce4a8604995a5ec84d6f92476bb.jpg',
'https://m.atcdn.co.uk/a/media/21e3f78e21194af9be1abc2f3cde54a9.jpg',
'https://m.atcdn.co.uk/a/media/a6f2d3dda07545fda115c69476d09340.jpg',
'https://m.atcdn.co.uk/a/media/f468939adb954ac1a2c76852e8a874f0.jpg',
'https://m.atcdn.co.uk/a/media/e0ffb509dbdb40748bd5c41154fcd2a6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82148,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8d8652b3513644b195bb4957a0f033ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81691,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5917bb496aaf40a49aa79f2356574e19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83874,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53d8ce5af1154877b4defeb7bd2b3805.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89054,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bbddb02a83514ed88e2e7790f0f193fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80541,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe1b8fd28398474d80cec541e938d21b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79775,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/57761ce4a8604995a5ec84d6f92476bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82355,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/21e3f78e21194af9be1abc2f3cde54a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85364,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a6f2d3dda07545fda115c69476d09340.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54398,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f468939adb954ac1a2c76852e8a874f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_547c5aaa-356c-5410-aeea-bcb89023caf3/547c5aaa-356c-5410-aeea-bcb89023caf3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69289,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0ffb509dbdb40748bd5c41154fcd2a6.jpg',
'Width': 800}],
'price': 5190,
'price_includes_vat': True,
'registration_date': '2016-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda 3 SPORT NAV 2.0 5dr',
'transmission': 'manual',
'trim': 'Sport Nav',
'year': 2016}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240177729%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240177729: {'created_time': 1774883259.188409, 'last_price_update_time': 1774883259.18842}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240177729') HTTP/1.1" 204 0
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 06ed7167-f93b-5073-bb5d-20fb72ff0f80 with identifier: 202602240177726
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06ed7167-f93b-5073-bb5d-20fb72ff0f80
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7835a8b899b4e3c856baf6d62bf507a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7835a8b899b4e3c856baf6d62bf507a.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F458d67274ae14891b3670442837828fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/458d67274ae14891b3670442837828fe.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff746906187f14b57a867ec419c5bb657.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f746906187f14b57a867ec419c5bb657.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa38b84c7a90e4ad89970234c118ea889.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a38b84c7a90e4ad89970234c118ea889.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13a2b060fc804bda878a72ca7d53288c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13a2b060fc804bda878a72ca7d53288c.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9807379a0d4640db987e46d96a484fd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9807379a0d4640db987e46d96a484fd3.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5495ee56ba2b4dcc9eb7ee79c0747a8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5495ee56ba2b4dcc9eb7ee79c0747a8e.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff35683e7843547c1bba2facbb8897dfa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f35683e7843547c1bba2facbb8897dfa.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9bd7f23484a6417ca5a782f6213b8587.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9bd7f23484a6417ca5a782f6213b8587.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc74afaa68ed44b8398713cca8e50a4f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c74afaa68ed44b8398713cca8e50a4f8.jpg already downloaded
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 06ed7167-f93b-5073-bb5d-20fb72ff0f80 with identifier 202602240177726
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 06ed7167-f93b-5073-bb5d-20fb72ff0f80
2026-03-30 15:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 168,
'color': 'Black',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Audi TT TTS TFSI Quattro | 2.0 Petrol | 6 Speed '
'Manual | Excellent Service History With 8 Records | Record '
'of Clutch Kit And Slave Cylinder Replacement | Ghost Alarm '
'Fitted | Low Mileage | Euro 6, Ulez Compliant | Registered As '
'Category S Back In Feb 2023, Side Damage, Fully Repaired To A '
'High Standard, Photos Available Upon Request | Only 2 Former '
'Keepers From New, Last Keeper Owned Since 2023 | 2 Keys | '
'Will Come With Long MOT Until 27/09/2026 | Well Maintained | '
'Excellent Spec Including Full Leather Interior With Heated '
'Front Seats, Digital Cockpit, Bluetooth, Lane Assist & More | '
'Free 3 Months Nationwide Warranty, Free 12 Months Breakdown '
'Cover And £75 Off Your Next Service & MOT With All Of Our '
'Vehicles | Well Looked After Example | Looks And Drives '
'Great 5-Day AA Driveaway Insurance Available From Just '
'£44.99 (Subject To Eligibility) | 10% Off AA Comprehensive '
'Car Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ++ Rear Parking Sensors ++ Keyless Start ++ Digital '
'Cockpit ++ Full Leather Interior With Heated Extendable Front '
'Seats ++ DAB Radio ++ Bluetooth ++ CD Player/USB/AUX ++ '
'Cruise Control With Speed Limiter ++ Lane Assist ++ Audi '
'Drive Select ++ Electric Spoiler ++ Bang & Olufsen Speaker '
'System ++ Stop/Start System ++ Flat Bottom Multi-functional '
'Steering Wheel ++ Automatic Headlights & Windscreen Wipers ++ '
'Electric Folding Heated Wing Mirrors ++ Isofix Anchor Points '
'++ ** All Major Debit And Credit Cards Accepted | Open 7 '
'Days A Week With No Appointments Necessary | Late Night '
'Viewings Available By Appointment Only | All Of Our Cars Are '
'Ready To Drive Away Today | Call Our Sales Team Today on '
'01709 925272 To Arrange A Test Drive | Leave A Deposit To '
'Secure This Vehicle Today**',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 306,
'fuel_type': 'Petrol',
'id': '06ed7167-f93b-5073-bb5d-20fb72ff0f80',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240177726',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Audi',
'model': 'TTS',
'odometer': 63948,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b7835a8b899b4e3c856baf6d62bf507a.jpg',
'https://m.atcdn.co.uk/a/media/458d67274ae14891b3670442837828fe.jpg',
'https://m.atcdn.co.uk/a/media/f746906187f14b57a867ec419c5bb657.jpg',
'https://m.atcdn.co.uk/a/media/a38b84c7a90e4ad89970234c118ea889.jpg',
'https://m.atcdn.co.uk/a/media/13a2b060fc804bda878a72ca7d53288c.jpg',
'https://m.atcdn.co.uk/a/media/9807379a0d4640db987e46d96a484fd3.jpg',
'https://m.atcdn.co.uk/a/media/5495ee56ba2b4dcc9eb7ee79c0747a8e.jpg',
'https://m.atcdn.co.uk/a/media/f35683e7843547c1bba2facbb8897dfa.jpg',
'https://m.atcdn.co.uk/a/media/9bd7f23484a6417ca5a782f6213b8587.jpg',
'https://m.atcdn.co.uk/a/media/c74afaa68ed44b8398713cca8e50a4f8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98073,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7835a8b899b4e3c856baf6d62bf507a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97841,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/458d67274ae14891b3670442837828fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99629,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f746906187f14b57a867ec419c5bb657.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98137,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a38b84c7a90e4ad89970234c118ea889.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97870,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13a2b060fc804bda878a72ca7d53288c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92437,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9807379a0d4640db987e46d96a484fd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98193,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5495ee56ba2b4dcc9eb7ee79c0747a8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94711,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f35683e7843547c1bba2facbb8897dfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67112,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9bd7f23484a6417ca5a782f6213b8587.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06ed7167-f93b-5073-bb5d-20fb72ff0f80/06ed7167-f93b-5073-bb5d-20fb72ff0f80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65646,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c74afaa68ed44b8398713cca8e50a4f8.jpg',
'Width': 800}],
'price': 12490,
'price_includes_vat': True,
'registration_date': '2015-12-16',
'seats_number': 4,
'seller_name': None,
'title': 'Audi TT TTS TFSI QUATTRO 2.0 3dr',
'transmission': 'manual',
'year': 2015}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240177726%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240177726: {'created_time': 1774883259.446845, 'last_price_update_time': 1774883259.446857}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240177726') HTTP/1.1" 204 0
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd with identifier: 202602180028362
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28f985daeefd4f6199136bf0241de593.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28f985daeefd4f6199136bf0241de593.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11d39d992d5a4eee9fd80282ff9b3027.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11d39d992d5a4eee9fd80282ff9b3027.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb6cd9ff9f0d34b29ad8b1eeab2c32e05.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b6cd9ff9f0d34b29ad8b1eeab2c32e05.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1e4793654e35444fb7c1be473a58c386.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1e4793654e35444fb7c1be473a58c386.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c910f103ad34bf19fd50df834003052.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c910f103ad34bf19fd50df834003052.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbe2328741f374269a1827f584c64ea2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/be2328741f374269a1827f584c64ea2d.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3005a04679fa4491baa4eb641f1c9a47.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3005a04679fa4491baa4eb641f1c9a47.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ad093ea1e094f8cb96fbbc1e6c0c300.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ad093ea1e094f8cb96fbbc1e6c0c300.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F376fdcd07863460c8f16b8e7b3612f9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/376fdcd07863460c8f16b8e7b3612f9d.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73f93dfe45444035a06c5cbf5709bbdd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73f93dfe45444035a06c5cbf5709bbdd.jpg already downloaded
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd with identifier 202602180028362
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd
2026-03-30 15:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'Grey',
'currency': 'GBP',
'description': 'Here We Have A Stunning Example Of An Audi A4 Avant TDI Ultra '
'Sport | 2.0 Diesel | Automatic | Estate | Full HPI Clear | '
'Good Service History With 5 Records | Euro 6, Ulez Compliant '
'| Cheap To Run With Only £20 Road Tax! | Only 2 Owners From '
'New, Last Keeper Owned Since 2021 | 2 Keys | Will Come With '
'12 Months MOT | Excellent Spec Including Front & Rear Parking '
'Sensors, Satellite Navigation, Electric Tailgate, Bluetooth & '
'More | Free Interim Service Carried Out Prior To Sale | Free '
'3 Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great 5-Day '
'AA Driveaway Insurance Available From Just £44.99 (Subject To '
'Eligibility) | 10% Off AA Comprehensive Car Insurance Any '
'Inspection Or Test Drive Welcome | Nationwide Delivery '
'Service Available | Viewing Is Highly Recommended | Upgraded '
'Warranty Cover Is Available From Only £249 Giving You That '
'Added Peace Of Mind (6,12,24 Month Covers Available) | '
'Competitive Prices Paid For Part Exchanges | All Of Our '
'Vehicles Are HPI Checked And Mileage Checked ++ Front & Rear '
'Parking Sensors ++ Keyless Start ++ Electric Tailgate ++ '
'Extendable Front Seats ++ Satellite Navigation ++ Bluetooth '
'++ DAB Radio ++ CD Player/USB/AUX ++ Audi Drive Select ++ '
'Audi Pre Sense ++ 3-Zone Climate Control ++ Cruise Control '
'With Speed Limiter ++ Stop/Start System ++ Multi-functional '
'Steering Wheel ++ Electric Parking Brake ++ Automatic '
'Headlights & Windscreen Wipers ++ Isofix Anchor Points ++ '
'Electric Heated Wing Mirrors ++ Retractable Parcel Shelf ++ '
'** All Major Debit And Credit Cards Accepted | Open 7 Days A '
'Week With No Appointments Necessary | Late Night Viewings '
'Available By Appointment Only | All Of Our Cars Are Ready To '
'Drive Away Today | Call Our Sales Team Today on 01709 925272 '
'To Arrange A Test Drive | Leave A Deposit To Secure This '
'Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'id': '13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602180028362',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Audi',
'model': 'A4 Avant',
'odometer': 115030,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 54,
'photo_urls': ['https://m.atcdn.co.uk/a/media/28f985daeefd4f6199136bf0241de593.jpg',
'https://m.atcdn.co.uk/a/media/11d39d992d5a4eee9fd80282ff9b3027.jpg',
'https://m.atcdn.co.uk/a/media/b6cd9ff9f0d34b29ad8b1eeab2c32e05.jpg',
'https://m.atcdn.co.uk/a/media/1e4793654e35444fb7c1be473a58c386.jpg',
'https://m.atcdn.co.uk/a/media/5c910f103ad34bf19fd50df834003052.jpg',
'https://m.atcdn.co.uk/a/media/be2328741f374269a1827f584c64ea2d.jpg',
'https://m.atcdn.co.uk/a/media/3005a04679fa4491baa4eb641f1c9a47.jpg',
'https://m.atcdn.co.uk/a/media/2ad093ea1e094f8cb96fbbc1e6c0c300.jpg',
'https://m.atcdn.co.uk/a/media/376fdcd07863460c8f16b8e7b3612f9d.jpg',
'https://m.atcdn.co.uk/a/media/73f93dfe45444035a06c5cbf5709bbdd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97999,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/28f985daeefd4f6199136bf0241de593.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97566,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/11d39d992d5a4eee9fd80282ff9b3027.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99598,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b6cd9ff9f0d34b29ad8b1eeab2c32e05.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102719,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1e4793654e35444fb7c1be473a58c386.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94966,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c910f103ad34bf19fd50df834003052.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87995,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/be2328741f374269a1827f584c64ea2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96259,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3005a04679fa4491baa4eb641f1c9a47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99047,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ad093ea1e094f8cb96fbbc1e6c0c300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56042,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/376fdcd07863460c8f16b8e7b3612f9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd/13c160c6-5b2f-5dba-9921-ba2cbb3ab0dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68677,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73f93dfe45444035a06c5cbf5709bbdd.jpg',
'Width': 800}],
'price': 8990,
'price_includes_vat': True,
'registration_date': '2017-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 AVANT TDI ULTRA SPORT 2.0 5dr',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602180028362%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602180028362: {'created_time': 1774883259.665027, 'last_price_update_time': 1774883259.665037}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602180028362') HTTP/1.1" 204 0
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 298c8edd-c800-5a2f-849a-c421e469e12f with identifier: 202602179996986
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 298c8edd-c800-5a2f-849a-c421e469e12f
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F95e9d505b8a946e0b2024c9b11d46145.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/95e9d505b8a946e0b2024c9b11d46145.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0f9dcf24aaf4b80805fd86f8fcbdfb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0f9dcf24aaf4b80805fd86f8fcbdfb9.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a7a5a0ffc2845159325e14de08f5ffa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a7a5a0ffc2845159325e14de08f5ffa.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7e50e8de90374d59b4b8a3f9aa28fd3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7e50e8de90374d59b4b8a3f9aa28fd3a.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e9968fa037e410586f5a6d3af7659e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e9968fa037e410586f5a6d3af7659e5.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ba4ae0bef334930af7d77955b747882.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ba4ae0bef334930af7d77955b747882.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F43cb77905a384b959efe688ff4a000a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/43cb77905a384b959efe688ff4a000a0.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F942e2170acb7423b8295fa36179d3f1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/942e2170acb7423b8295fa36179d3f1b.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcb8d426f932b4093b0ca8bc603939714.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cb8d426f932b4093b0ca8bc603939714.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F48aca9194e5246ba9f9f2da830d8dee7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/48aca9194e5246ba9f9f2da830d8dee7.jpg already downloaded
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 298c8edd-c800-5a2f-849a-c421e469e12f with identifier 202602179996986
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 298c8edd-c800-5a2f-849a-c421e469e12f
2026-03-30 15:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Black',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Kia ProCeed CRDI GT-Line ISG | 1.6 Diesel | '
'Automatic | Estate | Full HPI Clear | Excellent Service '
'History With 7 Records | Euro 6, Ulez Compliant | Cheap To '
'Run | Only 1 Former Keepers From New | 2 Keys | Will Come '
'With 12 Months MOT | Huge Spec Including Half Leather GT Line '
'Interior With Heated Front Seats, Heated Steering Wheel, '
'Satellite Navigation & Much More! | Free Interim Service '
'Carried Out Prior To Sale | Free 3 Months Nationwide '
'Warranty, Free 12 Months Breakdown Cover And £75 Off Your '
'Next Service & MOT With All Of Our Vehicles | Well Looked '
'After Example | Looks And Drives Great 5-Day AA Driveaway '
'Insurance Available From Just £44.99 (Subject To Eligibility) '
'| 10% Off AA Comprehensive Car Insurance Any Inspection Or '
'Test Drive Welcome | Nationwide Delivery Service Available | '
'Viewing Is Highly Recommended | Upgraded Warranty Cover Is '
'Available From Only £249 Giving You That Added Peace Of Mind '
'(6,12,24 Month Covers Available) | Competitive Prices Paid '
'For Part Exchanges | All Of Our Vehicles Are HPI Checked And '
'Mileage Checked ++ Reverse Parking Camera & Sensors ++ '
'Keyless Start ++ Half Leather GT Line Interior With Heated '
'Front Seats ++ Heated Steering Wheel ++ Satellite Navigation '
'++ Bluetooth ++ Apple CarPlay & Android Auto ++ DAB Radio ++ '
'USB/AUX ++ Lane Assist ++ Sport Drive Mode ++ Stop/Start '
'System ++ Cruise Control With Speed Limiter ++ Dual Climate '
'Control ++ Multi-functional Steering Wheel ++ Steering '
'Mounted Gear Shifting Paddles ++ Electric Parking Brake With '
'Auto Hold Function ++ Automatic Headlights & Windscreen '
'Wipers ++ Isofix Anchor Points ++ Electric Folding Wing '
'Mirrors ++ Retractable Parcel Shelf ++ ** All Major Debit '
'And Credit Cards Accepted | Open 7 Days A Week With No '
'Appointments Necessary | Late Night Viewings Available By '
'Appointment Only | All Of Our Cars Are Ready To Drive Away '
'Today | Call Our Sales Team Today on 01709 925272 To Arrange '
'A Test Drive | Leave A Deposit To Secure This Vehicle '
'Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 134,
'fuel_type': 'Diesel',
'id': '298c8edd-c800-5a2f-849a-c421e469e12f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179996986',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Kia',
'model': 'ProCeed',
'odometer': 103267,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 55,
'photo_urls': ['https://m.atcdn.co.uk/a/media/95e9d505b8a946e0b2024c9b11d46145.jpg',
'https://m.atcdn.co.uk/a/media/c0f9dcf24aaf4b80805fd86f8fcbdfb9.jpg',
'https://m.atcdn.co.uk/a/media/3a7a5a0ffc2845159325e14de08f5ffa.jpg',
'https://m.atcdn.co.uk/a/media/7e50e8de90374d59b4b8a3f9aa28fd3a.jpg',
'https://m.atcdn.co.uk/a/media/4e9968fa037e410586f5a6d3af7659e5.jpg',
'https://m.atcdn.co.uk/a/media/3ba4ae0bef334930af7d77955b747882.jpg',
'https://m.atcdn.co.uk/a/media/43cb77905a384b959efe688ff4a000a0.jpg',
'https://m.atcdn.co.uk/a/media/942e2170acb7423b8295fa36179d3f1b.jpg',
'https://m.atcdn.co.uk/a/media/cb8d426f932b4093b0ca8bc603939714.jpg',
'https://m.atcdn.co.uk/a/media/48aca9194e5246ba9f9f2da830d8dee7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101241,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/95e9d505b8a946e0b2024c9b11d46145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100252,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c0f9dcf24aaf4b80805fd86f8fcbdfb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107492,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3a7a5a0ffc2845159325e14de08f5ffa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102563,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7e50e8de90374d59b4b8a3f9aa28fd3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104314,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e9968fa037e410586f5a6d3af7659e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95103,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ba4ae0bef334930af7d77955b747882.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103209,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/43cb77905a384b959efe688ff4a000a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99966,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/942e2170acb7423b8295fa36179d3f1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74480,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cb8d426f932b4093b0ca8bc603939714.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_298c8edd-c800-5a2f-849a-c421e469e12f/298c8edd-c800-5a2f-849a-c421e469e12f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88784,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/48aca9194e5246ba9f9f2da830d8dee7.jpg',
'Width': 800}],
'price': 9290,
'price_includes_vat': True,
'registration_date': '2019-07-16',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Proceed CRDI GT-LINE ISG 1.6 5dr',
'transmission': 'automatic',
'trim': 'GT-Line',
'year': 2019}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179996986%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179996986: {'created_time': 1774883259.94147, 'last_price_update_time': 1774883259.94148}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179996986') HTTP/1.1" 204 0
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: af1c3b46-1cc5-5295-8b83-81252458cd6e with identifier: 202602109820050
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af1c3b46-1cc5-5295-8b83-81252458cd6e
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa5ff0b9aa864eccaa41921ceec3f6dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa5ff0b9aa864eccaa41921ceec3f6dc.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe5b888b2545421680f6d9b1f7eb76c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe5b888b2545421680f6d9b1f7eb76c2.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e3eba58f953409bada9cc8baac581fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e3eba58f953409bada9cc8baac581fe.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbd69fc380d5b4d9c82ffeb60cbe1aa28.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bd69fc380d5b4d9c82ffeb60cbe1aa28.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0886bf93900d4860901cc424f8f4e71e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0886bf93900d4860901cc424f8f4e71e.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f4ff657c3414db98537540ea46e39f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f4ff657c3414db98537540ea46e39f7.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e19db0067054f8d8a254d05a57c0bc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e19db0067054f8d8a254d05a57c0bc9.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1215156c6b784027bd76b451a39c857b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1215156c6b784027bd76b451a39c857b.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5a42c663ee30430392eff7bc45d7153f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5a42c663ee30430392eff7bc45d7153f.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9605fe45bdc4f93b8344294e177f355.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9605fe45bdc4f93b8344294e177f355.jpg already downloaded
2026-03-30 15:07:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: af1c3b46-1cc5-5295-8b83-81252458cd6e with identifier 202602109820050
2026-03-30 15:07:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item af1c3b46-1cc5-5295-8b83-81252458cd6e
2026-03-30 15:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'Blue',
'currency': 'GBP',
'description': 'Why Not Book A Test Drive For This Stunning Suzuki Swift SZ-L '
'1.2 Petrol | Manual | Full HPI Clear | Full Service '
'History With 9 Records | Very Low Mileage | Euro 6, Ulez '
'Compliant | Cheap To Run With Only £35 Road Tax! | Only 2 '
'Former Keepers From New, Last Keeper Owned Since 2018 | 2 '
'Keys | Will Come With 12 Months MOT | Well Maintained | '
'Excellent Spec Including Bluetooth, Cruise Control & More | '
'Free 3 Months Nationwide Warranty, Free 12 Months Breakdown '
'Cover And £75 Off Your Next Service & MOT With All Of Our '
'Vehicles | Well Looked After Example | Looks And Drives '
'Great 5-Day AA Driveaway Insurance Available From Just '
'£44.99 (Subject To Eligibility) | 10% Off AA Comprehensive '
'Car Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 93,
'fuel_type': 'Petrol',
'id': 'af1c3b46-1cc5-5295-8b83-81252458cd6e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109820050',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 33575,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 50,
'photo_urls': ['https://m.atcdn.co.uk/a/media/aa5ff0b9aa864eccaa41921ceec3f6dc.jpg',
'https://m.atcdn.co.uk/a/media/fe5b888b2545421680f6d9b1f7eb76c2.jpg',
'https://m.atcdn.co.uk/a/media/5e3eba58f953409bada9cc8baac581fe.jpg',
'https://m.atcdn.co.uk/a/media/bd69fc380d5b4d9c82ffeb60cbe1aa28.jpg',
'https://m.atcdn.co.uk/a/media/0886bf93900d4860901cc424f8f4e71e.jpg',
'https://m.atcdn.co.uk/a/media/5f4ff657c3414db98537540ea46e39f7.jpg',
'https://m.atcdn.co.uk/a/media/2e19db0067054f8d8a254d05a57c0bc9.jpg',
'https://m.atcdn.co.uk/a/media/1215156c6b784027bd76b451a39c857b.jpg',
'https://m.atcdn.co.uk/a/media/5a42c663ee30430392eff7bc45d7153f.jpg',
'https://m.atcdn.co.uk/a/media/c9605fe45bdc4f93b8344294e177f355.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91586,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa5ff0b9aa864eccaa41921ceec3f6dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92743,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe5b888b2545421680f6d9b1f7eb76c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95497,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e3eba58f953409bada9cc8baac581fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92513,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bd69fc380d5b4d9c82ffeb60cbe1aa28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77459,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5a42c663ee30430392eff7bc45d7153f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95500,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0886bf93900d4860901cc424f8f4e71e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84711,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f4ff657c3414db98537540ea46e39f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96749,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e19db0067054f8d8a254d05a57c0bc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63954,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1215156c6b784027bd76b451a39c857b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af1c3b46-1cc5-5295-8b83-81252458cd6e/af1c3b46-1cc5-5295-8b83-81252458cd6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91682,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9605fe45bdc4f93b8344294e177f355.jpg',
'Width': 800}],
'price': 7790,
'price_includes_vat': True,
'registration_date': '2016-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki Swift SZ-L 1.3 5dr',
'transmission': 'manual',
'trim': 'SZ-L',
'year': 2016}
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109820050%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109820050: {'created_time': 1774883260.187386, 'last_price_update_time': 1774883260.187395}
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109820050') HTTP/1.1" 204 0
2026-03-30 15:07:40 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:40 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c573ec2-d8d9-524a-a241-955e2296b15d with identifier: 202602069733711
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c573ec2-d8d9-524a-a241-955e2296b15d
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc8996fa0860e4aa0bbc80e2f17deb62b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c8996fa0860e4aa0bbc80e2f17deb62b.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26208a1b78204ba680a9e77c36bc222b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26208a1b78204ba680a9e77c36bc222b.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3987093e8bd4460e8662abdc2a4b030c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3987093e8bd4460e8662abdc2a4b030c.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd205b0e277004c49bc55b29b7fb287f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d205b0e277004c49bc55b29b7fb287f3.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19ebb1e209894406a9167a49e60a4449.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19ebb1e209894406a9167a49e60a4449.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5da7f7738b94cf3bb3b5881cc75906f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5da7f7738b94cf3bb3b5881cc75906f.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1a395f86bbe346afb7acddf00a044307.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1a395f86bbe346afb7acddf00a044307.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9586d8580234a4bbc56e5dc66ffacd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9586d8580234a4bbc56e5dc66ffacd0.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9dbad50643b740d997133d81e0842855.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9dbad50643b740d997133d81e0842855.jpg already downloaded
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0bbcc7f9b0846a0a7bfe1c402e8e52c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0bbcc7f9b0846a0a7bfe1c402e8e52c.jpg already downloaded
2026-03-30 15:07:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7c573ec2-d8d9-524a-a241-955e2296b15d with identifier 202602069733711
2026-03-30 15:07:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7c573ec2-d8d9-524a-a241-955e2296b15d
2026-03-30 15:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'White',
'currency': 'GBP',
'description': "Don't Miss The Chance To Become The New Owner Of This "
'Stunning Skoda Citigo SE 12V | 1.0 Petrol | Manual | In '
'The Best Colour White | Full HPI Clear | Excellent Service '
'History With 6 Records | Ideal First Car With Very Low '
'Mileage | Ulez Compliant | Cheap To Run With Only £20 Road '
'Tax! | Only 2 Owners From New, Last Keeper Owned Since 2016 | '
'2 Keys | Will Come With 12 Months MOT | Well Maintained | '
'Free Interim Service Carried Out Prior To Sale | Free 3 '
'Months Nationwide Warranty, Free 12 Months Breakdown Cover '
'And £75 Off Your Next Service & MOT With All Of Our Vehicles '
'| Well Looked After Example | Looks And Drives Great '
'5-Day AA Driveaway Insurance Available From Just £44.99 '
'(Subject To Eligibility) | 10% Off AA Comprehensive Car '
'Insurance Any Inspection Or Test Drive Welcome | '
'Nationwide Delivery Service Available | Viewing Is Highly '
'Recommended | Upgraded Warranty Cover Is Available From Only '
'£249 Giving You That Added Peace Of Mind (6,12,24 Month '
'Covers Available) | Competitive Prices Paid For Part '
'Exchanges | All Of Our Vehicles Are HPI Checked And Mileage '
'Checked ** All Major Debit And Credit Cards Accepted | '
'Open 7 Days A Week With No Appointments Necessary | Late '
'Night Viewings Available By Appointment Only | All Of Our '
'Cars Are Ready To Drive Away Today | Call Our Sales Team '
'Today on 01709 925272 To Arrange A Test Drive | Leave A '
'Deposit To Secure This Vehicle Today**',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1L',
'engine_horse_power': 59,
'fuel_type': 'Petrol',
'id': '7c573ec2-d8d9-524a-a241-955e2296b15d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602069733711',
'listing': 'directbuy',
'location': 'Rotherham, South Yorkshire',
'make': 'Skoda',
'model': 'Citigo',
'odometer': 30883,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c8996fa0860e4aa0bbc80e2f17deb62b.jpg',
'https://m.atcdn.co.uk/a/media/26208a1b78204ba680a9e77c36bc222b.jpg',
'https://m.atcdn.co.uk/a/media/3987093e8bd4460e8662abdc2a4b030c.jpg',
'https://m.atcdn.co.uk/a/media/d205b0e277004c49bc55b29b7fb287f3.jpg',
'https://m.atcdn.co.uk/a/media/19ebb1e209894406a9167a49e60a4449.jpg',
'https://m.atcdn.co.uk/a/media/b5da7f7738b94cf3bb3b5881cc75906f.jpg',
'https://m.atcdn.co.uk/a/media/1a395f86bbe346afb7acddf00a044307.jpg',
'https://m.atcdn.co.uk/a/media/f9586d8580234a4bbc56e5dc66ffacd0.jpg',
'https://m.atcdn.co.uk/a/media/9dbad50643b740d997133d81e0842855.jpg',
'https://m.atcdn.co.uk/a/media/a0bbcc7f9b0846a0a7bfe1c402e8e52c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97816,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c8996fa0860e4aa0bbc80e2f17deb62b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93943,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/26208a1b78204ba680a9e77c36bc222b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102128,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3987093e8bd4460e8662abdc2a4b030c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98207,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d205b0e277004c49bc55b29b7fb287f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96203,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/19ebb1e209894406a9167a49e60a4449.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92045,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b5da7f7738b94cf3bb3b5881cc75906f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97992,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a395f86bbe346afb7acddf00a044307.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95274,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9586d8580234a4bbc56e5dc66ffacd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69524,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9dbad50643b740d997133d81e0842855.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c573ec2-d8d9-524a-a241-955e2296b15d/7c573ec2-d8d9-524a-a241-955e2296b15d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83565,
'Height': 600,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0bbcc7f9b0846a0a7bfe1c402e8e52c.jpg',
'Width': 800}],
'price': 5290,
'price_includes_vat': True,
'registration_date': '2015-05-27',
'seats_number': 4,
'seller_name': None,
'title': 'SKODA Citigo SE 12V 1.0 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2015}
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602069733711%27 HTTP/1.1" 200 None
2026-03-30 15:07:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602069733711: {'created_time': 1774883260.428523, 'last_price_update_time': 1774883260.428536}
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602069733711') HTTP/1.1" 204 0
2026-03-30 15:07:40 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:07:40 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:07:40 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:07:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4a5f6c6a2c1f11f18e133aacc95538c6
2026-03-30 15:07:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:07:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:07:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:40 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-30 15:07:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:07:41 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 6, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587261 HTTP/1.1" 200 None
2026-03-30 15:07:41 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (46 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4a5f6c6a2c1f11f18e133aacc95538c6.jl
2026-03-30 15:07:41 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 349051,
'downloader/request_count': 8,
'downloader/request_method_count/POST': 8,
'downloader/response_bytes': 1961057,
'downloader/response_count': 8,
'downloader/response_status_count/200': 8,
'elapsed_time_seconds': 24.051664,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 15, 7, 41, 770120, tzinfo=datetime.timezone.utc),
'item_scraped_count': 46,
'log_count/DEBUG': 1422,
'log_count/INFO': 807,
'memusage/max': 149295104,
'memusage/startup': 149295104,
'request_depth_max': 3,
'response_received_count': 8,
'scheduler/dequeued': 8,
'scheduler/dequeued/memory': 8,
'scheduler/enqueued': 8,
'scheduler/enqueued/memory': 8,
'scrape_type/new': 46,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 8,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.535279866075143,
'scrapy-zyte-api/mean_response_seconds': 3.6534874928183854,
'scrapy-zyte-api/processed': 8,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 8,
'scrapy-zyte-api/request_args/experimental.requestCookies': 7,
'scrapy-zyte-api/request_args/experimental.responseCookies': 8,
'scrapy-zyte-api/request_args/httpRequestBody': 8,
'scrapy-zyte-api/request_args/httpRequestMethod': 8,
'scrapy-zyte-api/request_args/httpResponseBody': 8,
'scrapy-zyte-api/request_args/httpResponseHeaders': 8,
'scrapy-zyte-api/request_args/url': 8,
'scrapy-zyte-api/status_codes/200': 8,
'scrapy-zyte-api/success': 8,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 30, 15, 7, 17, 718456, tzinfo=datetime.timezone.utc)}
2026-03-30 15:07:41 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:07:41 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f49aad9f210>
2026-03-30 15:07:41 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f49aad9fa50>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)