PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2026-03-30 15:07:27 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:07:27 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:07:27 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:07:27 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:07:27 [auto_selling_autotrader.co.uk] INFO: _job: 4a648e482c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:07:27 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:07:27 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:07:27 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:07:27 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:07:27 [scrapy.extensions.telnet] INFO: Telnet Password: 0fb5939e36a3fce9
2026-03-30 15:07:27 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:07:27 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4a648e482c1f11f18e133aacc95538c6.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 15:07:27 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:27 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:27 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:07:27 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:07:27 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:07:27 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:07:27 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:07:27 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:07:27 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:07:27 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:07:27 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:07:27 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2026-03-30 15:07:27 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-30 15:07:27 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:27 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10020829 and multipost_profile_id: 349f68bf-2f22-48ec-9c46-0594a050f44b and job_id: 4a648e482c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=10020829&sort=price-asc
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10020829, page: 1
2026-03-30 15:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 12
2026-03-30 15:07:33 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 15:07:34 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271083483%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603271083483: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271083373%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603271083373: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271083307%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603271083307: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271083266%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603271083266: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070491381%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603070491381: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240189132%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240189132: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602159947425%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602159947425: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602159947182%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602159947182: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512218738308%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512218738308: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512128552788%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512128552788: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511228073580%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511228073580: 1
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202504181494974%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202504181494974: 1
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 2 detail requests (batch 2)
2026-03-30 15:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bccf01bf-c6d4-5117-b659-6b7f94768fd1 with identifier: 202511228073580
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bccf01bf-c6d4-5117-b659-6b7f94768fd1
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F759929008ef94cad8de2fc4411ea9f39.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/759929008ef94cad8de2fc4411ea9f39.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01fbb0697d6544c2a808a24ea542269a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01fbb0697d6544c2a808a24ea542269a.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9c5cabeef8643b3b9451b8de984c491.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9c5cabeef8643b3b9451b8de984c491.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F660f663ba9c74c1bb154068e7f708375.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/660f663ba9c74c1bb154068e7f708375.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec145b0b67b941c5b7bfc2c4b03d1c4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec145b0b67b941c5b7bfc2c4b03d1c4b.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b1a43b4b90743c281911ba16dc6eb7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b1a43b4b90743c281911ba16dc6eb7a.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F51a0711b2ec940e29f100912bc5e64ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/51a0711b2ec940e29f100912bc5e64ab.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69e957b2d0074777a422fad845597ce7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69e957b2d0074777a422fad845597ce7.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F217f77bf5d8f47a68e7a5b7b13affa04.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/217f77bf5d8f47a68e7a5b7b13affa04.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e3ef9fe667a416e998a1a80cb2a939b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e3ef9fe667a416e998a1a80cb2a939b.jpg already downloaded
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bccf01bf-c6d4-5117-b659-6b7f94768fd1 with identifier 202511228073580
2026-03-30 15:07:35 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:07:35 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:07:35 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:07:35 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:07:35 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:07:35 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:35 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:35 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:35 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:35 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:07:35 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:07:35 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2018
2026-03-30 15:07:36 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883256
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883256
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bccf01bf-c6d4-5117-b659-6b7f94768fd1
2026-03-30 15:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'Red',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY\n'
'Boasting an MOT valid until January 2027 and a clear vehicle '
'history check, this 2017 Ford Fiesta Zetec presents a '
'compelling proposition. Powered by an efficient 1.25L petrol '
'engine and meeting Euro 6 emissions standards, this manual '
'transmission model has had only two previous owners. Its last '
'service was completed on 13 January 2026 at 105,000 miles, '
'and it comes with a 3 month warranty for your peace of mind. '
'The Zetec trim includes manual air conditioning, ensuring a '
'comfortable cabin environment.\n'
'This Ford Fiesta Zetec stands out with its low insurance '
'group, making it an economical choice for many drivers. The '
'extended MOT validity and recent service history indicate a '
'well maintained vehicle, offering reassurance for its next '
'owner. With its proven reliability and practical features, '
'this Fiesta is a sensible option for those seeking a '
'dependable and affordable car. Timing belt replaced at 105k '
'miles. Inspection welcome. Test drive available. HPI clear. '
'Debit card or bank transfer available. We can meet from '
'nearest train station. 2 keys. P/X welcome.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.25L',
'engine_horse_power': 81,
'fuel_type': 'Petrol',
'id': 'bccf01bf-c6d4-5117-b659-6b7f94768fd1',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511228073580',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 105000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/759929008ef94cad8de2fc4411ea9f39.jpg',
'https://m.atcdn.co.uk/a/media/01fbb0697d6544c2a808a24ea542269a.jpg',
'https://m.atcdn.co.uk/a/media/e9c5cabeef8643b3b9451b8de984c491.jpg',
'https://m.atcdn.co.uk/a/media/660f663ba9c74c1bb154068e7f708375.jpg',
'https://m.atcdn.co.uk/a/media/ec145b0b67b941c5b7bfc2c4b03d1c4b.jpg',
'https://m.atcdn.co.uk/a/media/2b1a43b4b90743c281911ba16dc6eb7a.jpg',
'https://m.atcdn.co.uk/a/media/51a0711b2ec940e29f100912bc5e64ab.jpg',
'https://m.atcdn.co.uk/a/media/69e957b2d0074777a422fad845597ce7.jpg',
'https://m.atcdn.co.uk/a/media/217f77bf5d8f47a68e7a5b7b13affa04.jpg',
'https://m.atcdn.co.uk/a/media/5e3ef9fe667a416e998a1a80cb2a939b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723844,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/759929008ef94cad8de2fc4411ea9f39.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638803,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/01fbb0697d6544c2a808a24ea542269a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462022,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9c5cabeef8643b3b9451b8de984c491.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644448,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/660f663ba9c74c1bb154068e7f708375.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 814892,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec145b0b67b941c5b7bfc2c4b03d1c4b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 649709,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b1a43b4b90743c281911ba16dc6eb7a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693687,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/51a0711b2ec940e29f100912bc5e64ab.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461692,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/69e957b2d0074777a422fad845597ce7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597293,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/217f77bf5d8f47a68e7a5b7b13affa04.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bccf01bf-c6d4-5117-b659-6b7f94768fd1/bccf01bf-c6d4-5117-b659-6b7f94768fd1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501394,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e3ef9fe667a416e998a1a80cb2a939b.jpg',
'Width': 2048}],
'price': 3450,
'price_includes_vat': True,
'registration_date': '2017-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Zetec Euro 6 3dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2017}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511228073580%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511228073580: {'created_time': 1774883256.593525, 'last_price_update_time': 1774883256.593535}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511228073580') HTTP/1.1" 204 0
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 08232fec-b13c-56ab-ba5d-36087eccbc37 with identifier: 202504181494974
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08232fec-b13c-56ab-ba5d-36087eccbc37
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F76e056a82b2e4eee862eda4fe2012540.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/76e056a82b2e4eee862eda4fe2012540.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4c9d6b3695a94b0dbfa375785941293b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4c9d6b3695a94b0dbfa375785941293b.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffc36bc5ce4494f7e92ee7cc5a95218b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fc36bc5ce4494f7e92ee7cc5a95218b3.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c2115bbb46e44cc9d2a682dd533e8d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c2115bbb46e44cc9d2a682dd533e8d4.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea864a7c9c36461c82add1d70cbc60bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea864a7c9c36461c82add1d70cbc60bc.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff34cda082aaa430eaef73091c7d43b79.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f34cda082aaa430eaef73091c7d43b79.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09dd7b57f06347e796d05935fac98ed7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09dd7b57f06347e796d05935fac98ed7.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F754eb5041d7e418da5d6f9ff485c8847.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/754eb5041d7e418da5d6f9ff485c8847.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd43b8fa731af490a8d16ec574aac2567.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d43b8fa731af490a8d16ec574aac2567.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F801bfccf4a8149ec9eab6f4d090978ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/801bfccf4a8149ec9eab6f4d090978ca.jpg already downloaded
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 08232fec-b13c-56ab-ba5d-36087eccbc37 with identifier 202504181494974
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 08232fec-b13c-56ab-ba5d-36087eccbc37
2026-03-30 15:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'Blue',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY.\n'
'With only 67,440 miles on the clock, this 2013 BMW 3 Series '
'320d Luxury offers exceptionally low mileage for its age. As '
'a car with a 2.0L diesel engine, this BMW comes with an '
'24-month warranty , giving you peace of mind. The vehicle has '
'a clear vehicle history check and partial service history. '
'The Luxury trim includes enhanced Bluetooth telephone '
'preparation with USB audio interface, xenon headlights, and a '
'visibility package. Adaptive headlights and high-beam '
'assistant further enhance the driving experience.\n'
'\n'
'This BMW 3 Series stands out with its impressive fuel '
'economy, achieving around 60 mpg, meaning fewer trips to the '
'petrol station and reduced running costs compared to similar '
'vehicles. Its low CO2 emissions also make it a more '
'environmentally conscious choice. Furthermore, acceleration '
'from 0 to 62mph in just 7.6 seconds ensures a responsive and '
'engaging drive. Test drive available. HPI clear. We can '
'meet from nearest train station. 2 keys. P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 181,
'fuel_type': 'Diesel',
'id': '08232fec-b13c-56ab-ba5d-36087eccbc37',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202504181494974',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'BMW',
'model': '3 Series',
'odometer': 67440,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photo_urls': ['https://m.atcdn.co.uk/a/media/76e056a82b2e4eee862eda4fe2012540.jpg',
'https://m.atcdn.co.uk/a/media/4c9d6b3695a94b0dbfa375785941293b.jpg',
'https://m.atcdn.co.uk/a/media/fc36bc5ce4494f7e92ee7cc5a95218b3.jpg',
'https://m.atcdn.co.uk/a/media/8c2115bbb46e44cc9d2a682dd533e8d4.jpg',
'https://m.atcdn.co.uk/a/media/ea864a7c9c36461c82add1d70cbc60bc.jpg',
'https://m.atcdn.co.uk/a/media/f34cda082aaa430eaef73091c7d43b79.jpg',
'https://m.atcdn.co.uk/a/media/09dd7b57f06347e796d05935fac98ed7.jpg',
'https://m.atcdn.co.uk/a/media/754eb5041d7e418da5d6f9ff485c8847.jpg',
'https://m.atcdn.co.uk/a/media/d43b8fa731af490a8d16ec574aac2567.jpg',
'https://m.atcdn.co.uk/a/media/801bfccf4a8149ec9eab6f4d090978ca.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 737383,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/76e056a82b2e4eee862eda4fe2012540.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657918,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4c9d6b3695a94b0dbfa375785941293b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 460900,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fc36bc5ce4494f7e92ee7cc5a95218b3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501528,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/754eb5041d7e418da5d6f9ff485c8847.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 725136,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c2115bbb46e44cc9d2a682dd533e8d4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697874,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea864a7c9c36461c82add1d70cbc60bc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 739518,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f34cda082aaa430eaef73091c7d43b79.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662355,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09dd7b57f06347e796d05935fac98ed7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538237,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d43b8fa731af490a8d16ec574aac2567.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f476ba4-ae96-5cff-8079-1dc93b813925/5f476ba4-ae96-5cff-8079-1dc93b813925_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300726,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/801bfccf4a8149ec9eab6f4d090978ca.jpg',
'Width': 2048}],
'price': 8350,
'price_includes_vat': True,
'registration_date': '2013-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3 Series 2.0 320d Luxury Touring Auto Euro 5 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2013}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202504181494974%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202504181494974: {'created_time': 1774883256.968447, 'last_price_update_time': 1774883256.968462}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202504181494974') HTTP/1.1" 204 0
2026-03-30 15:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ace56c9-d2ba-51e3-bbe5-7a68384f9184 with identifier: 202603271083483
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ace56c9-d2ba-51e3-bbe5-7a68384f9184
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1a928c039f554b1e9f9f2cde013a0ca9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1a928c039f554b1e9f9f2cde013a0ca9.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f48c1627ce7400fb8f05fd67aeaed12.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f48c1627ce7400fb8f05fd67aeaed12.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F34b895067cf7418cbda7a0930e5f069a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/34b895067cf7418cbda7a0930e5f069a.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F70ba1dc769a74bd5bdf440c1465b40f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/70ba1dc769a74bd5bdf440c1465b40f7.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02ec8952fc1845e38b65288053c00815.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02ec8952fc1845e38b65288053c00815.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe911839a7ab44adeb3b0f899f6c733bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e911839a7ab44adeb3b0f899f6c733bc.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0109b8e5e1ec4b42b7601dc81bfcf835.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0109b8e5e1ec4b42b7601dc81bfcf835.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39d454ab8b3e44ee9784f8b9be8180cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39d454ab8b3e44ee9784f8b9be8180cf.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F841dbaa92fa4433b95b9e72676b24983.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/841dbaa92fa4433b95b9e72676b24983.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2955687c905c4689bda61a8e62fea449.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2955687c905c4689bda61a8e62fea449.jpg already downloaded
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7ace56c9-d2ba-51e3-bbe5-7a68384f9184 with identifier 202603271083483
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7ace56c9-d2ba-51e3-bbe5-7a68384f9184
2026-03-30 15:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Blue',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY, 3 month warranty. Test drive available. HPI '
'clear. Debit card or bank transfer available. We can meet '
'from nearest train or underground station. 2 keys, drives '
'good, no ussues. P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'id': '7ace56c9-d2ba-51e3-bbe5-7a68384f9184',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603271083483',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'Ford',
'model': 'Kuga',
'odometer': 55657,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photo_urls': ['https://m.atcdn.co.uk/a/media/1a928c039f554b1e9f9f2cde013a0ca9.jpg',
'https://m.atcdn.co.uk/a/media/9f48c1627ce7400fb8f05fd67aeaed12.jpg',
'https://m.atcdn.co.uk/a/media/34b895067cf7418cbda7a0930e5f069a.jpg',
'https://m.atcdn.co.uk/a/media/70ba1dc769a74bd5bdf440c1465b40f7.jpg',
'https://m.atcdn.co.uk/a/media/02ec8952fc1845e38b65288053c00815.jpg',
'https://m.atcdn.co.uk/a/media/e911839a7ab44adeb3b0f899f6c733bc.jpg',
'https://m.atcdn.co.uk/a/media/0109b8e5e1ec4b42b7601dc81bfcf835.jpg',
'https://m.atcdn.co.uk/a/media/39d454ab8b3e44ee9784f8b9be8180cf.jpg',
'https://m.atcdn.co.uk/a/media/841dbaa92fa4433b95b9e72676b24983.jpg',
'https://m.atcdn.co.uk/a/media/2955687c905c4689bda61a8e62fea449.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 647287,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a928c039f554b1e9f9f2cde013a0ca9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607881,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f48c1627ce7400fb8f05fd67aeaed12.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618245,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/34b895067cf7418cbda7a0930e5f069a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 688526,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/70ba1dc769a74bd5bdf440c1465b40f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629491,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/02ec8952fc1845e38b65288053c00815.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 667144,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e911839a7ab44adeb3b0f899f6c733bc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614432,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0109b8e5e1ec4b42b7601dc81bfcf835.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575747,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/39d454ab8b3e44ee9784f8b9be8180cf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570524,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/841dbaa92fa4433b95b9e72676b24983.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ace56c9-d2ba-51e3-bbe5-7a68384f9184/7ace56c9-d2ba-51e3-bbe5-7a68384f9184_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512678,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2955687c905c4689bda61a8e62fea449.jpg',
'Width': 2048}],
'price': 6250,
'price_includes_vat': True,
'registration_date': '2014-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium 2WD Euro 5 5dr',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271083483%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603271083483: {'created_time': 1774883257.335627, 'last_price_update_time': 1774883257.335641}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603271083483') HTTP/1.1" 204 0
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 90eabd6c-ff99-54ad-942c-2dcfc3cacc61 with identifier: 202603271083373
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90eabd6c-ff99-54ad-942c-2dcfc3cacc61
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a6b6f9e949e42f89c8bed121765b31a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a6b6f9e949e42f89c8bed121765b31a.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7d5b56c45a634b37aeb3586c46e8813d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7d5b56c45a634b37aeb3586c46e8813d.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2998373863bf484b984bc4e9f8dd1e20.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2998373863bf484b984bc4e9f8dd1e20.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F57d6061679d8425f88a76318a36ed690.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/57d6061679d8425f88a76318a36ed690.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F59186c99c8b646be94a9281daf43494d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/59186c99c8b646be94a9281daf43494d.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73055c90a39e412d9eadab4071cc3d92.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73055c90a39e412d9eadab4071cc3d92.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97f8a530b8264ef1b09cc18cdca59490.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97f8a530b8264ef1b09cc18cdca59490.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdae5cbd680164281a139a98eeca34efb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dae5cbd680164281a139a98eeca34efb.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa3d5ab2174524e869466d2d7ba9cdfc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a3d5ab2174524e869466d2d7ba9cdfc9.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55aa8fdbcd854ace946523156ef0fc9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55aa8fdbcd854ace946523156ef0fc9e.jpg already downloaded
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 90eabd6c-ff99-54ad-942c-2dcfc3cacc61 with identifier 202603271083373
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 90eabd6c-ff99-54ad-942c-2dcfc3cacc61
2026-03-30 15:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'Blue',
'currency': 'GBP',
'description': 'APPOINTMENT ONLY, PLEASE CALL TO CONFIRM AVAILABILITY\n'
'This 2013 Ford Focus Titanium Navigator boasts an '
'exceptionally low mileage for its age, having covered just '
'69,056 miles. The car benefits from a full service history, '
'with the last service completed on 24th October 2025 at '
'66,812 miles. Its MOT is valid until October 2026, and it is '
'offered with a 3 month warranty for your peace of mind.\n'
'The Titanium Navigator trim level includes desirable features '
'such as dual zone electronic automatic air conditioning, rear '
'parking sensors with parking assistance, and Bluetooth '
'handsfree with voice control. Automatic headlights add to the '
'convenience of driving. This Ford Focus is also noted for its '
'impressive fuel economy, achieving up to 55 mpg, and benefits '
'from low CO2 emissions, indicating it is a more economical '
'choice compared to many similar vehicles. Test drive '
'available. HPI clear. Debit card or bank transfer available. '
'We can meet from nearest train station. 2 keys, drives good, '
'no issues. P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '90eabd6c-ff99-54ad-942c-2dcfc3cacc61',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603271083373',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'Ford',
'model': 'Focus',
'odometer': 69056,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9a6b6f9e949e42f89c8bed121765b31a.jpg',
'https://m.atcdn.co.uk/a/media/7d5b56c45a634b37aeb3586c46e8813d.jpg',
'https://m.atcdn.co.uk/a/media/2998373863bf484b984bc4e9f8dd1e20.jpg',
'https://m.atcdn.co.uk/a/media/57d6061679d8425f88a76318a36ed690.jpg',
'https://m.atcdn.co.uk/a/media/59186c99c8b646be94a9281daf43494d.jpg',
'https://m.atcdn.co.uk/a/media/73055c90a39e412d9eadab4071cc3d92.jpg',
'https://m.atcdn.co.uk/a/media/97f8a530b8264ef1b09cc18cdca59490.jpg',
'https://m.atcdn.co.uk/a/media/dae5cbd680164281a139a98eeca34efb.jpg',
'https://m.atcdn.co.uk/a/media/a3d5ab2174524e869466d2d7ba9cdfc9.jpg',
'https://m.atcdn.co.uk/a/media/55aa8fdbcd854ace946523156ef0fc9e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 674600,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9a6b6f9e949e42f89c8bed121765b31a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641996,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7d5b56c45a634b37aeb3586c46e8813d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 519666,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2998373863bf484b984bc4e9f8dd1e20.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680122,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/57d6061679d8425f88a76318a36ed690.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 604383,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/59186c99c8b646be94a9281daf43494d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650498,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73055c90a39e412d9eadab4071cc3d92.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648712,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/97f8a530b8264ef1b09cc18cdca59490.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501741,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dae5cbd680164281a139a98eeca34efb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558121,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a3d5ab2174524e869466d2d7ba9cdfc9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90eabd6c-ff99-54ad-942c-2dcfc3cacc61/90eabd6c-ff99-54ad-942c-2dcfc3cacc61_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546809,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55aa8fdbcd854ace946523156ef0fc9e.jpg',
'Width': 2048}],
'price': 4850,
'price_includes_vat': True,
'registration_date': '2013-12-18',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost Titanium Navigator Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Titanium Navigator',
'year': 2013}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271083373%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603271083373: {'created_time': 1774883257.565632, 'last_price_update_time': 1774883257.565646}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603271083373') HTTP/1.1" 204 0
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9265d124-e71e-521b-b8c5-0c596d63fbed with identifier: 202603271083307
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9265d124-e71e-521b-b8c5-0c596d63fbed
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60721b9f978a432f9a891623efcc5367.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60721b9f978a432f9a891623efcc5367.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff733c093483340f39fee73c7465c2902.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f733c093483340f39fee73c7465c2902.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2d60eac6aa245e2bd770d4fe1d1197f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2d60eac6aa245e2bd770d4fe1d1197f.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F977180f2ec12460b97b4a5c6538c2a94.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/977180f2ec12460b97b4a5c6538c2a94.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0288a2a9728d483aa3d2f2eda05d94ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0288a2a9728d483aa3d2f2eda05d94ce.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52cb1695b31d4bfa99d1e7ae98395a70.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52cb1695b31d4bfa99d1e7ae98395a70.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5dad17b2bb5c4f9e8f7bc75f45318b8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5dad17b2bb5c4f9e8f7bc75f45318b8a.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcfc7a91a36f54ef09342dede0f80df01.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cfc7a91a36f54ef09342dede0f80df01.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac7089ee46ee43f5b3e148c36b27e391.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac7089ee46ee43f5b3e148c36b27e391.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e70672945534cf98d04450c131b37dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e70672945534cf98d04450c131b37dc.jpg already downloaded
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9265d124-e71e-521b-b8c5-0c596d63fbed with identifier 202603271083307
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9265d124-e71e-521b-b8c5-0c596d63fbed
2026-03-30 15:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'Grey',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY\n'
'With an MOT valid until September 2026 and a recent service '
'completed in March 2026 at 80,407 miles, this 2018 Mazda6 '
'SKYACTIV-D GT Sport Nav+ offers excellent peace of mind. This '
'Euro 6 compliant 2.2 litre diesel model comes with an 18 '
'month warranty, ensuring your investment is protected. A '
'clear vehicle history check further confirms its sound '
'provenance.\n'
'This Mazda6 GT Sport Nav+ is equipped with a premium BOSE '
'Surround Sound System for an immersive audio experience. '
'Enjoy convenience with dusk sensing automatic headlights and '
'smart keyless entry. The safety pack includes LED headlights '
'and a 360 degree camera for enhanced visibility and parking '
'assistance. Inside, you will find a driver memory seat paired '
'with an active driving display, offering personalised comfort '
'and information. Its low insurance group rating also makes it '
'a more economical choice compared to similar vehicles. Test '
'drive available. HPI clear. Debit card or bank transfer '
'available. We can meet from nearest train station. 2 keys. '
'P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.2L',
'engine_horse_power': 181,
'fuel_type': 'Diesel',
'id': '9265d124-e71e-521b-b8c5-0c596d63fbed',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603271083307',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'Mazda',
'model': 'Mazda6',
'odometer': 80407,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photo_urls': ['https://m.atcdn.co.uk/a/media/60721b9f978a432f9a891623efcc5367.jpg',
'https://m.atcdn.co.uk/a/media/f733c093483340f39fee73c7465c2902.jpg',
'https://m.atcdn.co.uk/a/media/a2d60eac6aa245e2bd770d4fe1d1197f.jpg',
'https://m.atcdn.co.uk/a/media/977180f2ec12460b97b4a5c6538c2a94.jpg',
'https://m.atcdn.co.uk/a/media/0288a2a9728d483aa3d2f2eda05d94ce.jpg',
'https://m.atcdn.co.uk/a/media/52cb1695b31d4bfa99d1e7ae98395a70.jpg',
'https://m.atcdn.co.uk/a/media/5dad17b2bb5c4f9e8f7bc75f45318b8a.jpg',
'https://m.atcdn.co.uk/a/media/cfc7a91a36f54ef09342dede0f80df01.jpg',
'https://m.atcdn.co.uk/a/media/ac7089ee46ee43f5b3e148c36b27e391.jpg',
'https://m.atcdn.co.uk/a/media/6e70672945534cf98d04450c131b37dc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673050,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60721b9f978a432f9a891623efcc5367.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 624248,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f733c093483340f39fee73c7465c2902.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447649,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2d60eac6aa245e2bd770d4fe1d1197f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693499,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/977180f2ec12460b97b4a5c6538c2a94.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642117,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0288a2a9728d483aa3d2f2eda05d94ce.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 701920,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/52cb1695b31d4bfa99d1e7ae98395a70.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627036,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5dad17b2bb5c4f9e8f7bc75f45318b8a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396739,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cfc7a91a36f54ef09342dede0f80df01.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383836,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac7089ee46ee43f5b3e148c36b27e391.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9265d124-e71e-521b-b8c5-0c596d63fbed/9265d124-e71e-521b-b8c5-0c596d63fbed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306669,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6e70672945534cf98d04450c131b37dc.jpg',
'Width': 2048}],
'price': 10750,
'price_includes_vat': True,
'registration_date': '2018-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda6 2.2 SKYACTIV-D GT Sport Nav+ Tourer Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'GT Sport Nav+',
'year': 2018}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271083307%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603271083307: {'created_time': 1774883257.798773, 'last_price_update_time': 1774883257.798784}
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603271083307') HTTP/1.1" 204 0
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c72671a-3a35-5b68-a4a7-66d4b2374f55 with identifier: 202603271083266
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c72671a-3a35-5b68-a4a7-66d4b2374f55
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd24b8660aac140e781a95cda5e17abbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d24b8660aac140e781a95cda5e17abbd.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3222a6c124784b6c903c753ae41415c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3222a6c124784b6c903c753ae41415c4.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff61cc956e98c46078303079f7d53366f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f61cc956e98c46078303079f7d53366f.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F570374ff4f8a4e8cadb97852a87d16b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/570374ff4f8a4e8cadb97852a87d16b9.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc432bc4d5c39453f920d37c614fbf001.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c432bc4d5c39453f920d37c614fbf001.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38d2a1382e0f4e8e9bcae4ff4806264f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38d2a1382e0f4e8e9bcae4ff4806264f.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F019def3735de4f72af0bef48b77e05bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/019def3735de4f72af0bef48b77e05bf.jpg already downloaded
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdc8ab0d3ac524a93ad500663caf34845.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dc8ab0d3ac524a93ad500663caf34845.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1d85325c286240d094c4bb48ca69aaff.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1d85325c286240d094c4bb48ca69aaff.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3287103311a048368b081fc9f95dc50e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3287103311a048368b081fc9f95dc50e.jpg already downloaded
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2c72671a-3a35-5b68-a4a7-66d4b2374f55 with identifier 202603271083266
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2c72671a-3a35-5b68-a4a7-66d4b2374f55
2026-03-30 15:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'Black',
'currency': 'GBP',
'description': 'APPOINTMENT ONLY, PLEASE CALL TO CONFIRM AVAILABILITY, 3 '
'month warranty. Test drive available. HPI clear. We can meet '
'from nearest train station. 2 keys, drives good, no issues. '
'P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.8L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': '2c72671a-3a35-5b68-a4a7-66d4b2374f55',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603271083266',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'Honda',
'model': 'Civic',
'odometer': 58572,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d24b8660aac140e781a95cda5e17abbd.jpg',
'https://m.atcdn.co.uk/a/media/3222a6c124784b6c903c753ae41415c4.jpg',
'https://m.atcdn.co.uk/a/media/f61cc956e98c46078303079f7d53366f.jpg',
'https://m.atcdn.co.uk/a/media/570374ff4f8a4e8cadb97852a87d16b9.jpg',
'https://m.atcdn.co.uk/a/media/c432bc4d5c39453f920d37c614fbf001.jpg',
'https://m.atcdn.co.uk/a/media/38d2a1382e0f4e8e9bcae4ff4806264f.jpg',
'https://m.atcdn.co.uk/a/media/019def3735de4f72af0bef48b77e05bf.jpg',
'https://m.atcdn.co.uk/a/media/dc8ab0d3ac524a93ad500663caf34845.jpg',
'https://m.atcdn.co.uk/a/media/1d85325c286240d094c4bb48ca69aaff.jpg',
'https://m.atcdn.co.uk/a/media/3287103311a048368b081fc9f95dc50e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650109,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d24b8660aac140e781a95cda5e17abbd.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646227,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3222a6c124784b6c903c753ae41415c4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608273,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f61cc956e98c46078303079f7d53366f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699957,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/570374ff4f8a4e8cadb97852a87d16b9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 672861,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c432bc4d5c39453f920d37c614fbf001.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 633627,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/38d2a1382e0f4e8e9bcae4ff4806264f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635865,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/019def3735de4f72af0bef48b77e05bf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570363,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dc8ab0d3ac524a93ad500663caf34845.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459433,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1d85325c286240d094c4bb48ca69aaff.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c72671a-3a35-5b68-a4a7-66d4b2374f55/2c72671a-3a35-5b68-a4a7-66d4b2374f55_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570578,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3287103311a048368b081fc9f95dc50e.jpg',
'Width': 2048}],
'price': 2500,
'price_includes_vat': True,
'registration_date': '2009-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Civic 1.8 i-VTEC SE 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2009}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271083266%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603271083266: {'created_time': 1774883258.068157, 'last_price_update_time': 1774883258.068168}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603271083266') HTTP/1.1" 204 0
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e43be72c-71af-5196-91cd-bd9a11893753 with identifier: 202603070491381
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e43be72c-71af-5196-91cd-bd9a11893753
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa301b16368254a98a92e04bcc2ebdaf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a301b16368254a98a92e04bcc2ebdaf4.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec6c49c295044bd08b2b2ce2d8cac8e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec6c49c295044bd08b2b2ce2d8cac8e8.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F67b2358d3f9e40b18ca3aeade3dd0eae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/67b2358d3f9e40b18ca3aeade3dd0eae.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea59d7e0bb8d4b0cb7e5ee7ffbb98a36.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea59d7e0bb8d4b0cb7e5ee7ffbb98a36.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52dacf8ca6944d56bbd4840976d7df19.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52dacf8ca6944d56bbd4840976d7df19.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4d7d9ca826fe4af880cc216922a39fa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4d7d9ca826fe4af880cc216922a39fa3.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F66cf9202f8334ddfa679b5111328521f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/66cf9202f8334ddfa679b5111328521f.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed7225e950b54075915ac845fac47f17.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed7225e950b54075915ac845fac47f17.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd01cb0cf0526460084126b574a875153.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d01cb0cf0526460084126b574a875153.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55782a252d254607b0c233bca56f743b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55782a252d254607b0c233bca56f743b.jpg already downloaded
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e43be72c-71af-5196-91cd-bd9a11893753 with identifier 202603070491381
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e43be72c-71af-5196-91cd-bd9a11893753
2026-03-30 15:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Blue',
'currency': 'GBP',
'description': 'APPOINTMENT ONLY, PLEASE CALL TO CONFIRM AVAILABILITY\n'
'With an exceptionally low mileage of just 48,805 miles for '
'its 2013 registration, this MINI Hatch Cooper D Bayswater '
'presents a compelling proposition. This particular model is '
'equipped with a 1.6L Diesel Engine, offering a blend of '
'efficiency and performance. Its provenance is further '
'strengthened by a clear vehicle history check and a recent '
'service completed on 7th March 2026 at 48,805 miles. The MOT '
'remains valid until August 2026, and the vehicle comes with a '
'3 month warranty for your peace of mind. Notable features '
'include automatic air conditioning with climate control, and '
'basic Bluetooth connectivity with USB audio.\n'
'\n'
'This MINI Hatch Cooper D Bayswater stands out with several '
'key advantages. Its impressive fuel economy of 74 mpg means '
'fewer trips to the petrol station, making it an economical '
'choice for daily driving. The low insurance group and low CO2 '
'emissions further contribute to its affordability and '
'environmental consideration. With only two previous owners '
'and its very low mileage for its age, this vehicle offers a '
'superior ownership experience compared to many others on the '
'market. Test drive available. HPI clear. Debit card or bank '
'transfer available. We can meet from nearest train station. '
'2 keys. P/X welcome.',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 110,
'fuel_type': 'Diesel',
'id': 'e43be72c-71af-5196-91cd-bd9a11893753',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603070491381',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'MINI',
'model': 'Hatch',
'odometer': 48805,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://m.atcdn.co.uk/a/media/a301b16368254a98a92e04bcc2ebdaf4.jpg',
'https://m.atcdn.co.uk/a/media/ec6c49c295044bd08b2b2ce2d8cac8e8.jpg',
'https://m.atcdn.co.uk/a/media/67b2358d3f9e40b18ca3aeade3dd0eae.jpg',
'https://m.atcdn.co.uk/a/media/ea59d7e0bb8d4b0cb7e5ee7ffbb98a36.jpg',
'https://m.atcdn.co.uk/a/media/52dacf8ca6944d56bbd4840976d7df19.jpg',
'https://m.atcdn.co.uk/a/media/4d7d9ca826fe4af880cc216922a39fa3.jpg',
'https://m.atcdn.co.uk/a/media/66cf9202f8334ddfa679b5111328521f.jpg',
'https://m.atcdn.co.uk/a/media/ed7225e950b54075915ac845fac47f17.jpg',
'https://m.atcdn.co.uk/a/media/d01cb0cf0526460084126b574a875153.jpg',
'https://m.atcdn.co.uk/a/media/55782a252d254607b0c233bca56f743b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662217,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a301b16368254a98a92e04bcc2ebdaf4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 629230,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec6c49c295044bd08b2b2ce2d8cac8e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596544,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/67b2358d3f9e40b18ca3aeade3dd0eae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684620,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea59d7e0bb8d4b0cb7e5ee7ffbb98a36.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628798,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/52dacf8ca6944d56bbd4840976d7df19.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644210,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4d7d9ca826fe4af880cc216922a39fa3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582808,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/66cf9202f8334ddfa679b5111328521f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563396,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed7225e950b54075915ac845fac47f17.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 623593,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d01cb0cf0526460084126b574a875153.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e43be72c-71af-5196-91cd-bd9a11893753/e43be72c-71af-5196-91cd-bd9a11893753_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549202,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55782a252d254607b0c233bca56f743b.jpg',
'Width': 2048}],
'price': 5990,
'price_includes_vat': True,
'registration_date': '2013-09-01',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Hatch 1.6 Cooper D Bayswater Euro 5 (s/s) 3dr',
'transmission': 'manual',
'trim': 'Cooper D Bayswater',
'year': 2013}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070491381%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603070491381: {'created_time': 1774883258.468849, 'last_price_update_time': 1774883258.468861}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603070491381') HTTP/1.1" 204 0
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 03469e07-aaef-5f92-a849-18f11511ceef with identifier: 202602240189132
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03469e07-aaef-5f92-a849-18f11511ceef
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F58b35c76e55741fc9001e6596f52f1a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/58b35c76e55741fc9001e6596f52f1a1.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5d8e8b5d5a3241aaa1d5d05a80627026.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5d8e8b5d5a3241aaa1d5d05a80627026.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffec02fad98a34c24baddf5dadc7680ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fec02fad98a34c24baddf5dadc7680ae.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F21e6cb41900a4778a160a6be531909a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/21e6cb41900a4778a160a6be531909a4.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6c88877002f54557a95b87452d373a0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6c88877002f54557a95b87452d373a0a.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F042ca08b7e404257a353584b0f940bca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/042ca08b7e404257a353584b0f940bca.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0abc7869cd074a5fb54bcc8b7abd1f93.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0abc7869cd074a5fb54bcc8b7abd1f93.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09dc7cb31dae461b9080dbfc61cacef8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09dc7cb31dae461b9080dbfc61cacef8.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8034fa89e5804faba543a390aba8f580.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8034fa89e5804faba543a390aba8f580.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7aab021aaa64f69a2cbf8d2243e164c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7aab021aaa64f69a2cbf8d2243e164c.jpg already downloaded
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 03469e07-aaef-5f92-a849-18f11511ceef with identifier 202602240189132
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 03469e07-aaef-5f92-a849-18f11511ceef
2026-03-30 15:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'Black',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY\n'
'Boasting a full service history and an MOT valid until August '
'2026, this 2018 BMW 2 Series Active Tourer 220d M Sport '
'presents a compelling proposition for discerning buyers. This '
'Euro 6 compliant model, powered by a 2.0L diesel engine, '
'offers an impressive 0-62mph acceleration in just 7.6 '
'seconds. The M Sport trim enhances its appeal, and you can '
'drive with peace of mind knowing it comes with an 18 month '
'warranty and a clear vehicle history check. Notable features '
'include a rain sensor with automatic headlight activation, '
'rear park distance control for easier manoeuvring, and '
'automatic dual zone climate control for consistent comfort. '
'The convenience of Bluetooth hands free with USB audio '
'interface and the versatility of sliding rear bench seats '
'further add to its practicality, complemented by a large boot '
'space.\n'
'This BMW 2 Series Active Tourer stands out with its '
'combination of performance and efficiency, indicated by its '
'low CO2 emissions. The rapid acceleration from 0-62mph in 7.6 '
'seconds demonstrates its dynamic capability, setting it apart '
'from many other vehicles in its class. The inclusion of '
'features like automatic headlights, rear parking sensors, and '
'dual zone climate control signifies a higher level of comfort '
'and convenience, while the sliding rear bench and generous '
'boot space offer exceptional versatility for families and '
'active lifestyles. Test drive available. HPI clear. We can '
'meet from nearest train station. Drives good, no issues, 4 '
'new tyres, new battery, 2 keys. P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 187,
'fuel_type': 'Diesel',
'id': '03469e07-aaef-5f92-a849-18f11511ceef',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240189132',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'BMW',
'model': '2 Series Active Tourer',
'odometer': 105768,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photo_urls': ['https://m.atcdn.co.uk/a/media/58b35c76e55741fc9001e6596f52f1a1.jpg',
'https://m.atcdn.co.uk/a/media/5d8e8b5d5a3241aaa1d5d05a80627026.jpg',
'https://m.atcdn.co.uk/a/media/fec02fad98a34c24baddf5dadc7680ae.jpg',
'https://m.atcdn.co.uk/a/media/21e6cb41900a4778a160a6be531909a4.jpg',
'https://m.atcdn.co.uk/a/media/6c88877002f54557a95b87452d373a0a.jpg',
'https://m.atcdn.co.uk/a/media/042ca08b7e404257a353584b0f940bca.jpg',
'https://m.atcdn.co.uk/a/media/0abc7869cd074a5fb54bcc8b7abd1f93.jpg',
'https://m.atcdn.co.uk/a/media/09dc7cb31dae461b9080dbfc61cacef8.jpg',
'https://m.atcdn.co.uk/a/media/8034fa89e5804faba543a390aba8f580.jpg',
'https://m.atcdn.co.uk/a/media/b7aab021aaa64f69a2cbf8d2243e164c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665540,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/58b35c76e55741fc9001e6596f52f1a1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 622658,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5d8e8b5d5a3241aaa1d5d05a80627026.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602514,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fec02fad98a34c24baddf5dadc7680ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705476,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/21e6cb41900a4778a160a6be531909a4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670325,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6c88877002f54557a95b87452d373a0a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709203,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/042ca08b7e404257a353584b0f940bca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645640,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0abc7869cd074a5fb54bcc8b7abd1f93.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643485,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09dc7cb31dae461b9080dbfc61cacef8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640606,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8034fa89e5804faba543a390aba8f580.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03469e07-aaef-5f92-a849-18f11511ceef/03469e07-aaef-5f92-a849-18f11511ceef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 680851,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7aab021aaa64f69a2cbf8d2243e164c.jpg',
'Width': 2048}],
'price': 8450,
'price_includes_vat': True,
'registration_date': '2018-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2 Series Active Tourer 2.0 220d M Sport Auto Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240189132%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240189132: {'created_time': 1774883258.743476, 'last_price_update_time': 1774883258.74349}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240189132') HTTP/1.1" 204 0
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ed9f2f-bd97-5284-921b-af7edb25ab7e with identifier: 202602159947425
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08ed9f2f-bd97-5284-921b-af7edb25ab7e
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5080e442f0394e57b7383c8aad14027c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5080e442f0394e57b7383c8aad14027c.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb165fb9d7e84d98b49dc643756b9578.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db165fb9d7e84d98b49dc643756b9578.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e3bb96bd5e8444e97f2a6ba3782c2b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e3bb96bd5e8444e97f2a6ba3782c2b8.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6dbf6856de774a0fbcc00352a24f298a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6dbf6856de774a0fbcc00352a24f298a.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe338bb7c91c64a868a06cf2af326d541.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e338bb7c91c64a868a06cf2af326d541.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F473761ded2224dfd83c89441c9dd6715.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/473761ded2224dfd83c89441c9dd6715.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07f354cd6e97442a8a3ef494f2520c5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07f354cd6e97442a8a3ef494f2520c5d.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6c114f53894742ec8436b1ed00c41ded.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6c114f53894742ec8436b1ed00c41ded.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e8e0527a52849d993d74d73d9058942.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e8e0527a52849d993d74d73d9058942.jpg already downloaded
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd6c036a7466a47e3ab09abbf0f71529a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d6c036a7466a47e3ab09abbf0f71529a.jpg already downloaded
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 08ed9f2f-bd97-5284-921b-af7edb25ab7e with identifier 202602159947425
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 08ed9f2f-bd97-5284-921b-af7edb25ab7e
2026-03-30 15:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'White',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY\n'
'This 2018 BMW 2 Series Gran Tourer 218d Sport boasts a clear '
'vehicle history and an MOT valid until July 2026, offering '
'peace of mind for its next owner. This Euro 6 compliant '
'model features a 2.0L diesel engine and a versatile 7 seat '
'configuration, making it ideal for families. The Sport trim '
'includes practical features such as Rain Sensor with '
'Automatic Headlight Activation, Bluetooth Hands Free with USB '
'Audio Interface, and Rear Park Distance Control. Enjoy a '
'comfortable cabin with Automatic Two Zone Climate Control and '
'added privacy with Sun Protection Glazing. The vehicle was '
'last serviced on 7th January 2026 at 90,518 miles and comes '
'with a 18 month warranty.\n'
'The BMW 2 Series Gran Tourer 218d Sport offers a compelling '
'blend of practicality and performance. Its large boot space '
'provides ample room for luggage or shopping, setting it apart '
'from many vehicles in its class. With low CO2 emissions, it '
'represents a more environmentally conscious choice. Test '
'drive available. HPI clear. Debit card or bank transfer '
'available. We can meet from nearest train station. 2 keys, '
'drives good, no issues. P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': '08ed9f2f-bd97-5284-921b-af7edb25ab7e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602159947425',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'BMW',
'model': '2 Series Gran Tourer',
'odometer': 91300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photo_urls': ['https://m.atcdn.co.uk/a/media/5080e442f0394e57b7383c8aad14027c.jpg',
'https://m.atcdn.co.uk/a/media/db165fb9d7e84d98b49dc643756b9578.jpg',
'https://m.atcdn.co.uk/a/media/9e3bb96bd5e8444e97f2a6ba3782c2b8.jpg',
'https://m.atcdn.co.uk/a/media/6dbf6856de774a0fbcc00352a24f298a.jpg',
'https://m.atcdn.co.uk/a/media/e338bb7c91c64a868a06cf2af326d541.jpg',
'https://m.atcdn.co.uk/a/media/473761ded2224dfd83c89441c9dd6715.jpg',
'https://m.atcdn.co.uk/a/media/07f354cd6e97442a8a3ef494f2520c5d.jpg',
'https://m.atcdn.co.uk/a/media/6c114f53894742ec8436b1ed00c41ded.jpg',
'https://m.atcdn.co.uk/a/media/3e8e0527a52849d993d74d73d9058942.jpg',
'https://m.atcdn.co.uk/a/media/d6c036a7466a47e3ab09abbf0f71529a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561720,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5080e442f0394e57b7383c8aad14027c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529606,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db165fb9d7e84d98b49dc643756b9578.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644254,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e3bb96bd5e8444e97f2a6ba3782c2b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635163,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6dbf6856de774a0fbcc00352a24f298a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552109,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e338bb7c91c64a868a06cf2af326d541.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 642744,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/473761ded2224dfd83c89441c9dd6715.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534908,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/07f354cd6e97442a8a3ef494f2520c5d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 587443,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6c114f53894742ec8436b1ed00c41ded.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538944,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e8e0527a52849d993d74d73d9058942.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08ed9f2f-bd97-5284-921b-af7edb25ab7e/08ed9f2f-bd97-5284-921b-af7edb25ab7e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600457,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d6c036a7466a47e3ab09abbf0f71529a.jpg',
'Width': 2048}],
'price': 8750,
'price_includes_vat': True,
'registration_date': '2018-10-31',
'seats_number': 7,
'seller_name': None,
'title': 'BMW 2 Series Gran Tourer 2.0 218d Sport Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Sport',
'year': 2018}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602159947425%27 HTTP/1.1" 200 None
2026-03-30 15:07:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602159947425: {'created_time': 1774883258.987753, 'last_price_update_time': 1774883258.987768}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602159947425') HTTP/1.1" 204 0
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c74fa74-5910-51b4-ab27-254b542b824b with identifier: 202602159947182
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c74fa74-5910-51b4-ab27-254b542b824b
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F565d822197dd4eea9d4f1d30f737221e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/565d822197dd4eea9d4f1d30f737221e.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2f11a49d2444e3bbff8fe2fcb5af850.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2f11a49d2444e3bbff8fe2fcb5af850.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc29fc83293814b6a97054ffcea4db608.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c29fc83293814b6a97054ffcea4db608.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8161c02f75ca4eb18382fe4865c27220.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8161c02f75ca4eb18382fe4865c27220.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7dc7f635a65347cfaa3ffbc81098f12c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7dc7f635a65347cfaa3ffbc81098f12c.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd931c738e4d04765873c8ff30fdd9a5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d931c738e4d04765873c8ff30fdd9a5c.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5aac7f60df6d441e9d95693d1643b9af.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5aac7f60df6d441e9d95693d1643b9af.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F884b06fa9c7d4a85aad7a0a640ea9982.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/884b06fa9c7d4a85aad7a0a640ea9982.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F15dd61a6ccbb4c81914fb7ae8183133f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/15dd61a6ccbb4c81914fb7ae8183133f.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b30966cd9f44584863c40ccd4b90d74.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b30966cd9f44584863c40ccd4b90d74.jpg already downloaded
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3c74fa74-5910-51b4-ab27-254b542b824b with identifier 202602159947182
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3c74fa74-5910-51b4-ab27-254b542b824b
2026-03-30 15:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 42,
'color': 'Red',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY\n'
'This 2015 Mitsubishi Outlander GX4h presents an exceptional '
'ownership proposition with its comprehensive service history '
'and a clear vehicle history check. This four wheel drive, 2.0 '
'litre petrol plug in hybrid model, registered in 2015, boasts '
'a Euro 6 emission class and has covered a low mileage of just '
'75557 miles for its age. Its MOT is valid until September '
'2026, and it comes with a 3 month warranty for your peace of '
'mind. The vehicle has been diligently maintained, with its '
'last service performed on 2025-09-05 at 73992 miles, '
'confirming its full service history.\n'
'\n'
'Key features that enhance the driving experience include '
'Xenon headlights for superior visibility, a rear view camera '
'for easier parking, and keyless entry for convenient access. '
'Stay connected on the go with the Bluetooth hands free '
'telephone kit, and enjoy added comfort with heated front '
'seats. These elements, combined with the efficient plug in '
'hybrid technology and four wheel drive capability, position '
'this Outlander GX4h as a well equipped and practical choice. '
'Test drive available. HPI clear. We can meet from nearest '
'train station. 2 keys, drives good, no issues, MOT '
'advisories have been fixed. P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 198,
'fuel_type': 'Petrol Plug-in Hybrid',
'id': '3c74fa74-5910-51b4-ab27-254b542b824b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602159947182',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 75557,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 36,
'photo_urls': ['https://m.atcdn.co.uk/a/media/565d822197dd4eea9d4f1d30f737221e.jpg',
'https://m.atcdn.co.uk/a/media/f2f11a49d2444e3bbff8fe2fcb5af850.jpg',
'https://m.atcdn.co.uk/a/media/c29fc83293814b6a97054ffcea4db608.jpg',
'https://m.atcdn.co.uk/a/media/8161c02f75ca4eb18382fe4865c27220.jpg',
'https://m.atcdn.co.uk/a/media/7dc7f635a65347cfaa3ffbc81098f12c.jpg',
'https://m.atcdn.co.uk/a/media/d931c738e4d04765873c8ff30fdd9a5c.jpg',
'https://m.atcdn.co.uk/a/media/5aac7f60df6d441e9d95693d1643b9af.jpg',
'https://m.atcdn.co.uk/a/media/884b06fa9c7d4a85aad7a0a640ea9982.jpg',
'https://m.atcdn.co.uk/a/media/15dd61a6ccbb4c81914fb7ae8183133f.jpg',
'https://m.atcdn.co.uk/a/media/9b30966cd9f44584863c40ccd4b90d74.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681857,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/565d822197dd4eea9d4f1d30f737221e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 670106,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2f11a49d2444e3bbff8fe2fcb5af850.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545466,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c29fc83293814b6a97054ffcea4db608.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329086,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8161c02f75ca4eb18382fe4865c27220.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620357,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7dc7f635a65347cfaa3ffbc81098f12c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758827,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d931c738e4d04765873c8ff30fdd9a5c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605515,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5aac7f60df6d441e9d95693d1643b9af.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673152,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/884b06fa9c7d4a85aad7a0a640ea9982.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542347,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/15dd61a6ccbb4c81914fb7ae8183133f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c74fa74-5910-51b4-ab27-254b542b824b/3c74fa74-5910-51b4-ab27-254b542b824b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553553,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9b30966cd9f44584863c40ccd4b90d74.jpg',
'Width': 2048}],
'price': 9250,
'price_includes_vat': True,
'registration_date': '2015-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0h 12kWh GX4h CVT 4WD Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'GX4h',
'year': 2015}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602159947182%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602159947182: {'created_time': 1774883259.24708, 'last_price_update_time': 1774883259.247092}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602159947182') HTTP/1.1" 204 0
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b9ac867c-2d7d-59d7-8f97-2cd3eb648856 with identifier: 202512218738308
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9ac867c-2d7d-59d7-8f97-2cd3eb648856
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9acac6b80af54458925c9249f1a55c57.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9acac6b80af54458925c9249f1a55c57.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa56a9a4c9544ef2861816912b445cdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa56a9a4c9544ef2861816912b445cdf.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9eb5bf71f4674f31b45d46c6c32f0470.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9eb5bf71f4674f31b45d46c6c32f0470.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdb75f2fbe1e4b52bc9ae364de99a614.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdb75f2fbe1e4b52bc9ae364de99a614.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8daa1050b1aa4dd9b9899eec8351fc8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8daa1050b1aa4dd9b9899eec8351fc8e.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13b913537fa6492388c39362c00883db.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13b913537fa6492388c39362c00883db.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc6828aa965f47f383eb57eb6998f450.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc6828aa965f47f383eb57eb6998f450.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97f705c8919c4f168993eeb26cdae14d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97f705c8919c4f168993eeb26cdae14d.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd55a9090e8a24b399bda9272ca38d56e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d55a9090e8a24b399bda9272ca38d56e.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff84b9a3e7e124c2980980cdc9f60ed8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f84b9a3e7e124c2980980cdc9f60ed8c.jpg already downloaded
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b9ac867c-2d7d-59d7-8f97-2cd3eb648856 with identifier 202512218738308
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b9ac867c-2d7d-59d7-8f97-2cd3eb648856
2026-03-30 15:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Grey',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY\n'
'This 2019 BMW 2 Series Active Tourer 218d M Sport boasts '
'exceptionally low mileage for its age, having covered just '
'27,592 miles. As a Euro 6 compliant model, it features a 2.0 '
'litre diesel engine and comes with a 18 month warranty and '
'partial service history. The M Sport trim enhances its '
"appeal, and you'll appreciate the convenience of a reversing "
'assist camera with rear parking sensors, Bluetooth hands free '
'with USB audio interface, automatic dual zone climate '
'control, and a rain sensor that activates the headlights '
'automatically.\n'
'This particular 2 Series Active Tourer stands out with its '
'low CO2 emissions, making it an environmentally conscious '
'choice. Its acceleration from 0 to 62mph in just 9.1 seconds '
'demonstrates its responsive performance, while its low '
'insurance group rating offers potential cost savings. '
'Furthermore, the generous boot space ensures practicality for '
'everyday use and longer journeys, highlighting its '
'versatility compared to other vehicles in its class. Test '
'drive available. HPI clear. Debit card or bank transfer '
'available. We can meet from nearest train station. 2 keys. '
'P/X welcome.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'b9ac867c-2d7d-59d7-8f97-2cd3eb648856',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512218738308',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'BMW',
'model': '2 Series Active Tourer',
'odometer': 27592,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9acac6b80af54458925c9249f1a55c57.jpg',
'https://m.atcdn.co.uk/a/media/aa56a9a4c9544ef2861816912b445cdf.jpg',
'https://m.atcdn.co.uk/a/media/9eb5bf71f4674f31b45d46c6c32f0470.jpg',
'https://m.atcdn.co.uk/a/media/cdb75f2fbe1e4b52bc9ae364de99a614.jpg',
'https://m.atcdn.co.uk/a/media/8daa1050b1aa4dd9b9899eec8351fc8e.jpg',
'https://m.atcdn.co.uk/a/media/13b913537fa6492388c39362c00883db.jpg',
'https://m.atcdn.co.uk/a/media/bc6828aa965f47f383eb57eb6998f450.jpg',
'https://m.atcdn.co.uk/a/media/97f705c8919c4f168993eeb26cdae14d.jpg',
'https://m.atcdn.co.uk/a/media/d55a9090e8a24b399bda9272ca38d56e.jpg',
'https://m.atcdn.co.uk/a/media/f84b9a3e7e124c2980980cdc9f60ed8c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645095,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9acac6b80af54458925c9249f1a55c57.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602303,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa56a9a4c9544ef2861816912b445cdf.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 529863,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9eb5bf71f4674f31b45d46c6c32f0470.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668603,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cdb75f2fbe1e4b52bc9ae364de99a614.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641920,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8daa1050b1aa4dd9b9899eec8351fc8e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655800,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13b913537fa6492388c39362c00883db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662392,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc6828aa965f47f383eb57eb6998f450.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477889,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/97f705c8919c4f168993eeb26cdae14d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413754,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d55a9090e8a24b399bda9272ca38d56e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ac867c-2d7d-59d7-8f97-2cd3eb648856/b9ac867c-2d7d-59d7-8f97-2cd3eb648856_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446360,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f84b9a3e7e124c2980980cdc9f60ed8c.jpg',
'Width': 2048}],
'price': 13650,
'price_includes_vat': True,
'registration_date': '2019-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 2 Series Active Tourer 2.0 218d M Sport Auto Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512218738308%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512218738308: {'created_time': 1774883259.493429, 'last_price_update_time': 1774883259.49344}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512218738308') HTTP/1.1" 204 0
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f7689f0f-4b23-5c10-a545-65a2b57fa010 with identifier: 202512128552788
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7689f0f-4b23-5c10-a545-65a2b57fa010
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c2dc30180d64e3dae7564213a9c66ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c2dc30180d64e3dae7564213a9c66ee.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36bc2a7875e248f08bc47ab532d9d953.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36bc2a7875e248f08bc47ab532d9d953.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b7cfb560ec7439facb6de74b1986385.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b7cfb560ec7439facb6de74b1986385.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa70cba4939264024a76c2712afd39ab4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a70cba4939264024a76c2712afd39ab4.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa089629edcd4df5957da152a76bb733.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa089629edcd4df5957da152a76bb733.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffaeab02c7b914f51b97f5094fc677ac0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/faeab02c7b914f51b97f5094fc677ac0.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7e8d4f89539a417a81a57997615f3695.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7e8d4f89539a417a81a57997615f3695.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60fa97ea106d41edbb93dc05dfe5c83a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60fa97ea106d41edbb93dc05dfe5c83a.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F576c1ed902384c539efe57c77ba60527.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/576c1ed902384c539efe57c77ba60527.jpg already downloaded
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90609b8911ea40d08e4e3a5207824bbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90609b8911ea40d08e4e3a5207824bbb.jpg already downloaded
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f7689f0f-4b23-5c10-a545-65a2b57fa010 with identifier 202512128552788
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f7689f0f-4b23-5c10-a545-65a2b57fa010
2026-03-30 15:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': 'Blue',
'currency': 'GBP',
'description': 'FINANCE AVAILABLE, APPOINTMENT ONLY, PLEASE CALL TO CONFIRM '
'AVAILABILITY\n'
'Boasting a full dealership service history, this 2022 Skoda '
'Octavia TDI SE presents a well maintained example. This Euro '
'6 compliant 2.0 litre diesel model offers an impressive 66 '
'miles per gallon, making it an economical choice. It comes '
'with a clear vehicle history check and a 18 month nationwide '
'warranty for your peace of mind. The SE trim level includes '
'practical features such as rear parking sensors with '
'manoeuvre assist and LED headlights with LED daytime running '
'lights. Connectivity is also a strong point, with Smartlink '
'offering Android Auto and MirrorLink, alongside wireless '
'Smartlink for Apple CarPlay, and Bluetooth for seamless phone '
'integration.\n'
'\n'
'This Skoda Octavia stands out with its excellent fuel economy '
'of 66 mpg, which is better than many comparable vehicles. Its '
'low CO2 emissions further contribute to its cost '
'effectiveness. The acceleration from 0 to 60 mph in just 8.5 '
'seconds demonstrates a responsive driving experience. '
'Furthermore, the Octavia is known for its large boot space, '
'providing ample room for luggage or shopping, and it sits in '
'a low insurance group, making it an affordable option to own '
'and run. The MOT is valid until September 2026, ensuring it '
'is roadworthy for the foreseeable future. Test drive '
'available. HPI clear. Debit card or bank transfer available. '
'We can meet from nearest train station. 2 keys. P/X '
'welcome.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'f7689f0f-4b23-5c10-a545-65a2b57fa010',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512128552788',
'listing': 'directbuy',
'location': 'Maldon, Essex',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 62689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0c2dc30180d64e3dae7564213a9c66ee.jpg',
'https://m.atcdn.co.uk/a/media/36bc2a7875e248f08bc47ab532d9d953.jpg',
'https://m.atcdn.co.uk/a/media/4b7cfb560ec7439facb6de74b1986385.jpg',
'https://m.atcdn.co.uk/a/media/a70cba4939264024a76c2712afd39ab4.jpg',
'https://m.atcdn.co.uk/a/media/aa089629edcd4df5957da152a76bb733.jpg',
'https://m.atcdn.co.uk/a/media/faeab02c7b914f51b97f5094fc677ac0.jpg',
'https://m.atcdn.co.uk/a/media/7e8d4f89539a417a81a57997615f3695.jpg',
'https://m.atcdn.co.uk/a/media/60fa97ea106d41edbb93dc05dfe5c83a.jpg',
'https://m.atcdn.co.uk/a/media/576c1ed902384c539efe57c77ba60527.jpg',
'https://m.atcdn.co.uk/a/media/90609b8911ea40d08e4e3a5207824bbb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 702389,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c2dc30180d64e3dae7564213a9c66ee.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602346,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/36bc2a7875e248f08bc47ab532d9d953.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 560795,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b7cfb560ec7439facb6de74b1986385.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 690817,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a70cba4939264024a76c2712afd39ab4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 669075,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa089629edcd4df5957da152a76bb733.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677851,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/faeab02c7b914f51b97f5094fc677ac0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 671725,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7e8d4f89539a417a81a57997615f3695.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682951,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60fa97ea106d41edbb93dc05dfe5c83a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575203,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/576c1ed902384c539efe57c77ba60527.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7689f0f-4b23-5c10-a545-65a2b57fa010/f7689f0f-4b23-5c10-a545-65a2b57fa010_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 549062,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/90609b8911ea40d08e4e3a5207824bbb.jpg',
'Width': 2048}],
'price': 13750,
'price_includes_vat': True,
'registration_date': '2022-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Octavia 2.0 TDI SE Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2022}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512128552788%27 HTTP/1.1" 200 None
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512128552788: {'created_time': 1774883259.747647, 'last_price_update_time': 1774883259.747657}
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512128552788') HTTP/1.1" 204 0
2026-03-30 15:07:39 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:07:39 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:07:39 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4a648e482c1f11f18e133aacc95538c6
2026-03-30 15:07:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:07:39 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:07:39 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:39 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:07:39 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587260 HTTP/1.1" 200 None
2026-03-30 15:07:40 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (12 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4a648e482c1f11f18e133aacc95538c6.jl
2026-03-30 15:07:40 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 93211,
'downloader/request_count': 3,
'downloader/request_method_count/POST': 3,
'downloader/response_bytes': 593744,
'downloader/response_count': 3,
'downloader/response_status_count/200': 3,
'elapsed_time_seconds': 12.681628,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 15, 7, 40, 369675, tzinfo=datetime.timezone.utc),
'item_scraped_count': 12,
'log_count/DEBUG': 389,
'log_count/INFO': 254,
'memusage/max': 147509248,
'memusage/startup': 147509248,
'request_depth_max': 1,
'response_received_count': 3,
'scheduler/dequeued': 3,
'scheduler/dequeued/memory': 3,
'scheduler/enqueued': 3,
'scheduler/enqueued/memory': 3,
'scrape_type/new': 12,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 3,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.4669038460900388,
'scrapy-zyte-api/mean_response_seconds': 1.5191677982608478,
'scrapy-zyte-api/processed': 3,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
'scrapy-zyte-api/request_args/experimental.requestCookies': 2,
'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
'scrapy-zyte-api/request_args/httpRequestBody': 3,
'scrapy-zyte-api/request_args/httpRequestMethod': 3,
'scrapy-zyte-api/request_args/httpResponseBody': 3,
'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
'scrapy-zyte-api/request_args/url': 3,
'scrapy-zyte-api/status_codes/200': 3,
'scrapy-zyte-api/success': 3,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 30, 15, 7, 27, 688047, tzinfo=datetime.timezone.utc)}
2026-03-30 15:07:40 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:07:40 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f4813f8f290>
2026-03-30 15:07:40 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f4813f8fb10>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)