PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2026-03-30 15:07:52 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:07:52 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:07:52 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:07:52 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:07:52 [auto_selling_autotrader.co.uk] INFO: _job: 4a6e01c62c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:07:52 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:07:52 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:07:52 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:07:52 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:07:52 [scrapy.extensions.telnet] INFO: Telnet Password: b088851f529cbc94
2026-03-30 15:07:52 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:07:52 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4a6e01c62c1f11f18e133aacc95538c6.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 15:07:52 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:52 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:52 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:07:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:07:52 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:07:53 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:07:53 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:07:53 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:07:53 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:07:53 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:07:53 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:07:53 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 15:07:53 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 15:07:53 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:53 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:58 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 3236 and multipost_profile_id: 1a568e23-393a-452b-b57c-8b40042a6b40 and job_id: 4a6e01c62c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=3236&sort=price-asc
2026-03-30 15:07:58 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 3236, page: 1
2026-03-30 15:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Page: 1/4, total results: 65
2026-03-30 15:07:59 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-30 15:07:59 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271074601%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603271074601: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261039871%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603261039871: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250993855%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250993855: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250993852%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250993852: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210890674%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210890674: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210890590%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210890590: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210885975%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210885975: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210885894%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210885894: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210885768%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210885768: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190827038%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190827038: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180804523%27 HTTP/1.1" 200 None
2026-03-30 15:07:59 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603180804523: 1
2026-03-30 15:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635275%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120635275: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635268%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120635268: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635237%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120635237: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635163%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120635163: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635153%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120635153: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110608176%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110608176: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090540388%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090540388: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070494191%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603070494191: 1
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060470605%27 HTTP/1.1" 200 None
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060470605: 1
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-30 15:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-30 15:08:00 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 3236, page: 2
2026-03-30 15:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Page: 2/4, total results: 65
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060470440%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060470440: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060469295%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060469295: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050427656%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050427656: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050427561%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050427561: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200090204%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200090204: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200089383%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200089383: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179994495%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179994495: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179993088%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179993088: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169969571%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169969571: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169969504%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169969504: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602139905163%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602139905163: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129884963%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602129884963: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119849664%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602119849664: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049670779%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049670779: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049670696%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049670696: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039648310%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602039648310: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039647875%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602039647875: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602029613284%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602029613284: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269435342%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269435342: 1
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269435260%27 HTTP/1.1" 200 None
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269435260: 1
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-30 15:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-30 15:08:01 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 3236, page: 3
2026-03-30 15:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:02 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 942d04f4-256a-52c3-864b-aa6e4c5ba46d with identifier: 202603180804523
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 942d04f4-256a-52c3-864b-aa6e4c5ba46d
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bd8153c597f4001b339d1207512dc7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bd8153c597f4001b339d1207512dc7d.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbea63f63e4004597b85fcb28d375547b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bea63f63e4004597b85fcb28d375547b.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff554ddb4f0a64af0b7a7f9875166117a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f554ddb4f0a64af0b7a7f9875166117a.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F16e3c7b82b114218b55d0c61d60a3ec3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/16e3c7b82b114218b55d0c61d60a3ec3.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F356444af9ac54b0e8a930d4399293bcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/356444af9ac54b0e8a930d4399293bcc.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b197d015afd4d6f95bbc1c57ad1d91f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b197d015afd4d6f95bbc1c57ad1d91f.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffdba2e0765ed4414b9806b1530975962.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fdba2e0765ed4414b9806b1530975962.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d35b13ef4444b1cb128bb3204c2982b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d35b13ef4444b1cb128bb3204c2982b.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F46cd23b35f9c4d0b8f71f78d97209d53.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/46cd23b35f9c4d0b8f71f78d97209d53.jpg already downloaded
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9ef3baac33d4445bbc740abdd94656f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9ef3baac33d4445bbc740abdd94656f0.jpg already downloaded
2026-03-30 15:08:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 942d04f4-256a-52c3-864b-aa6e4c5ba46d with identifier 202603180804523
2026-03-30 15:08:02 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:08:02 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:08:02 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:08:02 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:02 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:08:02 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2013
2026-03-30 15:08:02 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883282
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883282
2026-03-30 15:08:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:08:03 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 942d04f4-256a-52c3-864b-aa6e4c5ba46d
2026-03-30 15:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 230,
'color': 'Blue',
'currency': 'GBP',
'description': 'Performance - Drive with confidence in the GWM POER300. With '
'its turbocharged engine, responsive transmission and '
'impressive towing power, you’ll be ready to tackle any '
'challenge.\n'
'\n'
'Tech- Make every journey a pleasure with innovative safety '
'features and driver assistance systems embedded to give you '
'peace of mind. Stay connected with Apple CarPlay and Android '
'Auto standard across the range. Enjoy features like Wireless '
'Charging, Smart Keyless Entry and Push Button Start to make '
'everyday practical.\n'
'\n'
'More power. More performance. More possibilities with 5 '
'years/125,000 miles warranty.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 180,
'fuel_type': 'Diesel',
'id': '942d04f4-256a-52c3-864b-aa6e4c5ba46d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603180804523',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'POER300',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4bd8153c597f4001b339d1207512dc7d.jpg',
'https://m.atcdn.co.uk/a/media/bea63f63e4004597b85fcb28d375547b.jpg',
'https://m.atcdn.co.uk/a/media/f554ddb4f0a64af0b7a7f9875166117a.jpg',
'https://m.atcdn.co.uk/a/media/16e3c7b82b114218b55d0c61d60a3ec3.jpg',
'https://m.atcdn.co.uk/a/media/356444af9ac54b0e8a930d4399293bcc.jpg',
'https://m.atcdn.co.uk/a/media/1b197d015afd4d6f95bbc1c57ad1d91f.jpg',
'https://m.atcdn.co.uk/a/media/fdba2e0765ed4414b9806b1530975962.jpg',
'https://m.atcdn.co.uk/a/media/0d35b13ef4444b1cb128bb3204c2982b.jpg',
'https://m.atcdn.co.uk/a/media/46cd23b35f9c4d0b8f71f78d97209d53.jpg',
'https://m.atcdn.co.uk/a/media/9ef3baac33d4445bbc740abdd94656f0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224909,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4bd8153c597f4001b339d1207512dc7d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132773,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bea63f63e4004597b85fcb28d375547b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147358,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f554ddb4f0a64af0b7a7f9875166117a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206588,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/16e3c7b82b114218b55d0c61d60a3ec3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215749,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/356444af9ac54b0e8a930d4399293bcc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192481,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b197d015afd4d6f95bbc1c57ad1d91f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145451,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fdba2e0765ed4414b9806b1530975962.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184913,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d35b13ef4444b1cb128bb3204c2982b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183432,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/46cd23b35f9c4d0b8f71f78d97209d53.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_942d04f4-256a-52c3-864b-aa6e4c5ba46d/942d04f4-256a-52c3-864b-aa6e4c5ba46d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246834,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9ef3baac33d4445bbc740abdd94656f0.jpg',
'Width': 1280}],
'price': 38394,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'GWM POER300 LUX 2.4 4dr Pickup Automatic Diesel',
'transmission': 'automatic',
'trim': 'Lux',
'year': 2026}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180804523%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603180804523: {'created_time': 1774883283.108284, 'last_price_update_time': 1774883283.108295}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603180804523') HTTP/1.1" 204 0
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ee2c373-5f18-5b6b-9ac9-52163f0d7193 with identifier: 202603120635275
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ee2c373-5f18-5b6b-9ac9-52163f0d7193
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F576b3de9acf54d5cb8fac453ae00b44d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/576b3de9acf54d5cb8fac453ae00b44d.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F058a78162a1b4091b4faafcc47e9df49.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/058a78162a1b4091b4faafcc47e9df49.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ef3a4fb6b0c4695b108c952dfdd0c24.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ef3a4fb6b0c4695b108c952dfdd0c24.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a3938a621ef4d34896750359e642cc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a3938a621ef4d34896750359e642cc4.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F988d4fa46be949909872e5de19f16c8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/988d4fa46be949909872e5de19f16c8f.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F129bb8bc4a5d42d590120b795a31831b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/129bb8bc4a5d42d590120b795a31831b.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d04c0abe514471bbc870bf75c4c5725.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d04c0abe514471bbc870bf75c4c5725.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe45afdff4be9462b88057f4230aee9a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e45afdff4be9462b88057f4230aee9a7.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F76083ae310cb4ba99f89d261c3c35bee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/76083ae310cb4ba99f89d261c3c35bee.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2eaacc2e1bfa45c6b02a5df5b7bad711.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2eaacc2e1bfa45c6b02a5df5b7bad711.jpg already downloaded
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0ee2c373-5f18-5b6b-9ac9-52163f0d7193 with identifier 202603120635275
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0ee2c373-5f18-5b6b-9ac9-52163f0d7193
2026-03-30 15:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 230,
'color': 'Red',
'currency': 'GBP',
'description': 'Performance - Drive with confidence in the GWM POER300. With '
'its turbocharged engine, responsive transmission and '
'impressive towing power, you’ll be ready to tackle any '
'challenge.\n'
'\n'
'Tech- Make every journey a pleasure with innovative safety '
'features and driver assistance systems embedded to give you '
'peace of mind. Stay connected with Apple CarPlay and Android '
'Auto standard across the range. Enjoy features like Wireless '
'Charging, Smart Keyless Entry and Push Button Start to make '
'everyday practical.\n'
'\n'
'More power. More performance. More possibilities with 5 '
'years/125,000 miles warranty.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 180,
'fuel_type': 'Diesel',
'id': '0ee2c373-5f18-5b6b-9ac9-52163f0d7193',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120635275',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'POER300',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/576b3de9acf54d5cb8fac453ae00b44d.jpg',
'https://m.atcdn.co.uk/a/media/058a78162a1b4091b4faafcc47e9df49.jpg',
'https://m.atcdn.co.uk/a/media/2ef3a4fb6b0c4695b108c952dfdd0c24.jpg',
'https://m.atcdn.co.uk/a/media/6a3938a621ef4d34896750359e642cc4.jpg',
'https://m.atcdn.co.uk/a/media/988d4fa46be949909872e5de19f16c8f.jpg',
'https://m.atcdn.co.uk/a/media/129bb8bc4a5d42d590120b795a31831b.jpg',
'https://m.atcdn.co.uk/a/media/0d04c0abe514471bbc870bf75c4c5725.jpg',
'https://m.atcdn.co.uk/a/media/e45afdff4be9462b88057f4230aee9a7.jpg',
'https://m.atcdn.co.uk/a/media/76083ae310cb4ba99f89d261c3c35bee.jpg',
'https://m.atcdn.co.uk/a/media/2eaacc2e1bfa45c6b02a5df5b7bad711.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226334,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/576b3de9acf54d5cb8fac453ae00b44d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128051,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/058a78162a1b4091b4faafcc47e9df49.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143738,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ef3a4fb6b0c4695b108c952dfdd0c24.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226980,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6a3938a621ef4d34896750359e642cc4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213680,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/988d4fa46be949909872e5de19f16c8f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222367,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/129bb8bc4a5d42d590120b795a31831b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189423,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d04c0abe514471bbc870bf75c4c5725.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140500,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e45afdff4be9462b88057f4230aee9a7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165230,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/76083ae310cb4ba99f89d261c3c35bee.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8c43af-09e9-5c1d-ac79-939a68ab7b05/fe8c43af-09e9-5c1d-ac79-939a68ab7b05_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172822,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2eaacc2e1bfa45c6b02a5df5b7bad711.jpg',
'Width': 1280}],
'price': 39594,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'GWM POER300 LUX 2.4 4dr Pick Up Automatic Diesel',
'transmission': 'automatic',
'trim': 'Lux',
'year': 2026}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635275%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120635275: {'created_time': 1774883283.578018, 'last_price_update_time': 1774883283.578034}
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120635275') HTTP/1.1" 204 0
2026-03-30 15:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a294169-501b-5deb-8a77-c71153751a67 with identifier: 202603120635268
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a294169-501b-5deb-8a77-c71153751a67
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3931aa3f391640249ca5b58c324f373e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3931aa3f391640249ca5b58c324f373e.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F74963a13304a423381fbea9dcb803efb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/74963a13304a423381fbea9dcb803efb.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ed7a6f8019542489a5bdcf84a23a39d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ed7a6f8019542489a5bdcf84a23a39d.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F616acae4dc054fbabc96a880d1c960be.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/616acae4dc054fbabc96a880d1c960be.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F866dfe65150a442e9c8fdb3eff5a84e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/866dfe65150a442e9c8fdb3eff5a84e3.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F441c784a819643f9bf1fd9deec2dac7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/441c784a819643f9bf1fd9deec2dac7b.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe1e034725cc496b97bbfea3e8fd1f57.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe1e034725cc496b97bbfea3e8fd1f57.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6f5fc79dc0e143f68e32b9548b0e0d52.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6f5fc79dc0e143f68e32b9548b0e0d52.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e54f27df7b5476c87443ec42ab1f200.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e54f27df7b5476c87443ec42ab1f200.jpg already downloaded
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fee7cb57d55ae4c17be910bcf30ac7292.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ee7cb57d55ae4c17be910bcf30ac7292.jpg already downloaded
2026-03-30 15:08:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0a294169-501b-5deb-8a77-c71153751a67 with identifier 202603120635268
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0a294169-501b-5deb-8a77-c71153751a67
2026-03-30 15:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Black',
'currency': 'GBP',
'description': 'IN STOCK ¦ CHOICE OF COLOURS ¦ CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': '0a294169-501b-5deb-8a77-c71153751a67',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120635268',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photo_urls': ['https://m.atcdn.co.uk/a/media/3931aa3f391640249ca5b58c324f373e.jpg',
'https://m.atcdn.co.uk/a/media/74963a13304a423381fbea9dcb803efb.jpg',
'https://m.atcdn.co.uk/a/media/8ed7a6f8019542489a5bdcf84a23a39d.jpg',
'https://m.atcdn.co.uk/a/media/616acae4dc054fbabc96a880d1c960be.jpg',
'https://m.atcdn.co.uk/a/media/866dfe65150a442e9c8fdb3eff5a84e3.jpg',
'https://m.atcdn.co.uk/a/media/441c784a819643f9bf1fd9deec2dac7b.jpg',
'https://m.atcdn.co.uk/a/media/fe1e034725cc496b97bbfea3e8fd1f57.jpg',
'https://m.atcdn.co.uk/a/media/6f5fc79dc0e143f68e32b9548b0e0d52.jpg',
'https://m.atcdn.co.uk/a/media/4e54f27df7b5476c87443ec42ab1f200.jpg',
'https://m.atcdn.co.uk/a/media/ee7cb57d55ae4c17be910bcf30ac7292.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147363,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3931aa3f391640249ca5b58c324f373e.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121463,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/74963a13304a423381fbea9dcb803efb.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125744,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8ed7a6f8019542489a5bdcf84a23a39d.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142912,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/616acae4dc054fbabc96a880d1c960be.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124234,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/866dfe65150a442e9c8fdb3eff5a84e3.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146074,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/441c784a819643f9bf1fd9deec2dac7b.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150017,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe1e034725cc496b97bbfea3e8fd1f57.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128234,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6f5fc79dc0e143f68e32b9548b0e0d52.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137020,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e54f27df7b5476c87443ec42ab1f200.jpg',
'Width': 1279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05575e20-4129-5d1b-939a-62301926c36a/05575e20-4129-5d1b-939a-62301926c36a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112423,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee7cb57d55ae4c17be910bcf30ac7292.jpg',
'Width': 1279}],
'price': 42995,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback Field 2.5 5dr Estate CVT Petrol',
'transmission': 'automatic',
'trim': 'Field',
'year': 2026}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635268%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120635268: {'created_time': 1774883284.030362, 'last_price_update_time': 1774883284.030375}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120635268') HTTP/1.1" 204 0
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 35664960-97e6-5a2e-8cb1-658dd6d939c7 with identifier: 202603271074601
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35664960-97e6-5a2e-8cb1-658dd6d939c7
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcb6911fcd59f407daf73cd08b3b8b85e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cb6911fcd59f407daf73cd08b3b8b85e.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fef6ad8d9a03c4e1da2dc9d3e1ebb32aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ef6ad8d9a03c4e1da2dc9d3e1ebb32aa.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6fbcfd001d9247d5892e81f76a7281d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6fbcfd001d9247d5892e81f76a7281d1.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2363e2178fdf47dd850621ccfc4fad0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2363e2178fdf47dd850621ccfc4fad0c.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32e0da1513224202b19f44b40d6f327c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32e0da1513224202b19f44b40d6f327c.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fddf052e11c7e4bea8f54038fe5368ee3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ddf052e11c7e4bea8f54038fe5368ee3.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F520edf9010c94885be5fbd65c45f8bdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/520edf9010c94885be5fbd65c45f8bdb.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7047320eba854226a5ee9bb3b62fe8cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7047320eba854226a5ee9bb3b62fe8cf.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fecf331eddb90438c89af1b6be7e7ab82.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ecf331eddb90438c89af1b6be7e7ab82.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0f66e3a34a64309a3cddccdb1d964e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0f66e3a34a64309a3cddccdb1d964e0.jpg already downloaded
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 76c5dec6-c822-5029-9e05-2a367b1793ad with identifier: 202603120635237
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76c5dec6-c822-5029-9e05-2a367b1793ad
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55a016f7139f4345a5e25d3b8f2eb185.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55a016f7139f4345a5e25d3b8f2eb185.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ad7e19879814f3dbd34d01873b60ccf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ad7e19879814f3dbd34d01873b60ccf.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3d64f1e7d4ed4338af8c4efc5545d57d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3d64f1e7d4ed4338af8c4efc5545d57d.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f8f85d8effd4f7d9a39a141ea296b12.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f8f85d8effd4f7d9a39a141ea296b12.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F88a13008c2294f06a82bf456824a1444.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/88a13008c2294f06a82bf456824a1444.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbfce0761d1364f809eaeb96bac15a406.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bfce0761d1364f809eaeb96bac15a406.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F16de2f9dfd20461ea066907591f48304.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/16de2f9dfd20461ea066907591f48304.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09aafc60599d4099958b74fa828456cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09aafc60599d4099958b74fa828456cf.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F520c9521f8eb448b81f3cc0a3665a228.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/520c9521f8eb448b81f3cc0a3665a228.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F624d275252d84b05a202888d1251379f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/624d275252d84b05a202888d1251379f.jpg already downloaded
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 35664960-97e6-5a2e-8cb1-658dd6d939c7 with identifier 202603271074601
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 35664960-97e6-5a2e-8cb1-658dd6d939c7
2026-03-30 15:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 180,
'color': 'Yellow',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Petrol Hybrid',
'id': '35664960-97e6-5a2e-8cb1-658dd6d939c7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603271074601',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'XV',
'odometer': 32917,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photo_urls': ['https://m.atcdn.co.uk/a/media/cb6911fcd59f407daf73cd08b3b8b85e.jpg',
'https://m.atcdn.co.uk/a/media/ef6ad8d9a03c4e1da2dc9d3e1ebb32aa.jpg',
'https://m.atcdn.co.uk/a/media/6fbcfd001d9247d5892e81f76a7281d1.jpg',
'https://m.atcdn.co.uk/a/media/2363e2178fdf47dd850621ccfc4fad0c.jpg',
'https://m.atcdn.co.uk/a/media/32e0da1513224202b19f44b40d6f327c.jpg',
'https://m.atcdn.co.uk/a/media/ddf052e11c7e4bea8f54038fe5368ee3.jpg',
'https://m.atcdn.co.uk/a/media/520edf9010c94885be5fbd65c45f8bdb.jpg',
'https://m.atcdn.co.uk/a/media/7047320eba854226a5ee9bb3b62fe8cf.jpg',
'https://m.atcdn.co.uk/a/media/ecf331eddb90438c89af1b6be7e7ab82.jpg',
'https://m.atcdn.co.uk/a/media/f0f66e3a34a64309a3cddccdb1d964e0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277841,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cb6911fcd59f407daf73cd08b3b8b85e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251811,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ef6ad8d9a03c4e1da2dc9d3e1ebb32aa.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280498,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6fbcfd001d9247d5892e81f76a7281d1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275544,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2363e2178fdf47dd850621ccfc4fad0c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281664,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/32e0da1513224202b19f44b40d6f327c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271226,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ddf052e11c7e4bea8f54038fe5368ee3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316017,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/520edf9010c94885be5fbd65c45f8bdb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260557,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7047320eba854226a5ee9bb3b62fe8cf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227151,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ecf331eddb90438c89af1b6be7e7ab82.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35664960-97e6-5a2e-8cb1-658dd6d939c7/35664960-97e6-5a2e-8cb1-658dd6d939c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239042,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f0f66e3a34a64309a3cddccdb1d964e0.jpg',
'Width': 1280}],
'price': 17995,
'price_includes_vat': True,
'registration_date': '2021-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru XV 2.0 i e-Boxer SE SUV 5dr Petrol Hybrid Lineartronic 4WD '
'Euro 6 (s/s) (150 ps)',
'transmission': 'automatic',
'trim': 'SE',
'year': 2021}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603271074601%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603271074601: {'created_time': 1774883284.690892, 'last_price_update_time': 1774883284.690907}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603271074601') HTTP/1.1" 204 0
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 76c5dec6-c822-5029-9e05-2a367b1793ad with identifier 202603120635237
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 76c5dec6-c822-5029-9e05-2a367b1793ad
2026-03-30 15:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Green',
'currency': 'GBP',
'description': 'IN STOCK ¦ CHOICE OF COLOURS ¦ CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': '76c5dec6-c822-5029-9e05-2a367b1793ad',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120635237',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photo_urls': ['https://m.atcdn.co.uk/a/media/55a016f7139f4345a5e25d3b8f2eb185.jpg',
'https://m.atcdn.co.uk/a/media/5ad7e19879814f3dbd34d01873b60ccf.jpg',
'https://m.atcdn.co.uk/a/media/3d64f1e7d4ed4338af8c4efc5545d57d.jpg',
'https://m.atcdn.co.uk/a/media/9f8f85d8effd4f7d9a39a141ea296b12.jpg',
'https://m.atcdn.co.uk/a/media/88a13008c2294f06a82bf456824a1444.jpg',
'https://m.atcdn.co.uk/a/media/bfce0761d1364f809eaeb96bac15a406.jpg',
'https://m.atcdn.co.uk/a/media/16de2f9dfd20461ea066907591f48304.jpg',
'https://m.atcdn.co.uk/a/media/09aafc60599d4099958b74fa828456cf.jpg',
'https://m.atcdn.co.uk/a/media/520c9521f8eb448b81f3cc0a3665a228.jpg',
'https://m.atcdn.co.uk/a/media/624d275252d84b05a202888d1251379f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175865,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55a016f7139f4345a5e25d3b8f2eb185.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146388,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5ad7e19879814f3dbd34d01873b60ccf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154960,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3d64f1e7d4ed4338af8c4efc5545d57d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184759,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f8f85d8effd4f7d9a39a141ea296b12.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176252,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/88a13008c2294f06a82bf456824a1444.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169550,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bfce0761d1364f809eaeb96bac15a406.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158695,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/16de2f9dfd20461ea066907591f48304.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140012,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09aafc60599d4099958b74fa828456cf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190003,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/520c9521f8eb448b81f3cc0a3665a228.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d678e4-412a-5d28-83ac-2dbbc4b946d9/46d678e4-412a-5d28-83ac-2dbbc4b946d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110719,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/624d275252d84b05a202888d1251379f.jpg',
'Width': 1280}],
'price': 43295,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback Field 2.5 5dr Estate CVT Petrol',
'transmission': 'automatic',
'trim': 'Field',
'year': 2026}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635237%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120635237: {'created_time': 1774883284.766141, 'last_price_update_time': 1774883284.766153}
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120635237') HTTP/1.1" 204 0
2026-03-30 15:08:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bdc5e791-12a8-5eca-8330-f717d3afc43f with identifier: 202603261039871
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdc5e791-12a8-5eca-8330-f717d3afc43f
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc2de42a65f7441e0bdbb266d4702871b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c2de42a65f7441e0bdbb266d4702871b.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faf25635a634748d89e38c52d2d699e42.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/af25635a634748d89e38c52d2d699e42.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7bd356ef90cc41289a6adfcc9c680cd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7bd356ef90cc41289a6adfcc9c680cd9.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1efe449c06c04ff6be0bacb9b1d54ec1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1efe449c06c04ff6be0bacb9b1d54ec1.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc5a908d5c064b7e8e856c819df2c665.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc5a908d5c064b7e8e856c819df2c665.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0642c382a78483ebd64f41a7939da99.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0642c382a78483ebd64f41a7939da99.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5cc906678cb64aafa6dcefbee570a083.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5cc906678cb64aafa6dcefbee570a083.jpg already downloaded
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a5e82d98cae4119af8cb59c9601eabf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a5e82d98cae4119af8cb59c9601eabf.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff513e2fc7baf445ab920252c848a4aba.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f513e2fc7baf445ab920252c848a4aba.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3310de6a9bbc441bab662695c1e6b816.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3310de6a9bbc441bab662695c1e6b816.jpg already downloaded
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Page: 3/4, total results: 65
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149149574%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149149574: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865371%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512318865371: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865367%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512318865367: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865358%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512318865358: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865352%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512318865352: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865347%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512318865347: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865327%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512318865327: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512308848456%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512308848456: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512308848455%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512308848455: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238767099%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512238767099: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048366264%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048366264: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048365542%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048365542: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511288214031%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511288214031: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511288203102%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511288203102: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511228070362%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511228070362: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208024452%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511208024452: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511197999123%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511197999123: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511197998852%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511197998852: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510317555316%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510317555316: 1
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510317555028%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510317555028: 1
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:05 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f1263a8-b929-5988-93a8-0a84195afc10 with identifier: 202603120635163
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f1263a8-b929-5988-93a8-0a84195afc10
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6512c6d704a24f1abb86941147b0f55a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6512c6d704a24f1abb86941147b0f55a.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F12d0191b8d524bd285891f7ff65ff4ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/12d0191b8d524bd285891f7ff65ff4ed.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38e63963a41a4e86a83c35a38d840f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38e63963a41a4e86a83c35a38d840f3a.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6a0da4c59634ae29cba6d842a0f8977.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6a0da4c59634ae29cba6d842a0f8977.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc41df90debde47fcb0db07a1f285a6d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c41df90debde47fcb0db07a1f285a6d1.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60521e12847046febed0b3e995125c51.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60521e12847046febed0b3e995125c51.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fedf9052ef2db421e9108d6ff9db820da.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/edf9052ef2db421e9108d6ff9db820da.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa6d2a4ba210f49f8871a3ba5787943e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a6d2a4ba210f49f8871a3ba5787943e7.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdc73ed0b83d04c99bd59e3a482f91ce4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dc73ed0b83d04c99bd59e3a482f91ce4.jpg already downloaded
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7a071a9e8de9486b9498122ee8427eec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7a071a9e8de9486b9498122ee8427eec.jpg already downloaded
2026-03-30 15:08:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bdc5e791-12a8-5eca-8330-f717d3afc43f with identifier 202603261039871
2026-03-30 15:08:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bdc5e791-12a8-5eca-8330-f717d3afc43f
2026-03-30 15:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 221,
'color': 'Red',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 168,
'fuel_type': 'Diesel',
'id': 'bdc5e791-12a8-5eca-8330-f717d3afc43f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603261039871',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Ford',
'model': 'Ranger',
'odometer': 23902,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 15,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c2de42a65f7441e0bdbb266d4702871b.jpg',
'https://m.atcdn.co.uk/a/media/af25635a634748d89e38c52d2d699e42.jpg',
'https://m.atcdn.co.uk/a/media/7bd356ef90cc41289a6adfcc9c680cd9.jpg',
'https://m.atcdn.co.uk/a/media/1efe449c06c04ff6be0bacb9b1d54ec1.jpg',
'https://m.atcdn.co.uk/a/media/cc5a908d5c064b7e8e856c819df2c665.jpg',
'https://m.atcdn.co.uk/a/media/e0642c382a78483ebd64f41a7939da99.jpg',
'https://m.atcdn.co.uk/a/media/5cc906678cb64aafa6dcefbee570a083.jpg',
'https://m.atcdn.co.uk/a/media/0a5e82d98cae4119af8cb59c9601eabf.jpg',
'https://m.atcdn.co.uk/a/media/f513e2fc7baf445ab920252c848a4aba.jpg',
'https://m.atcdn.co.uk/a/media/3310de6a9bbc441bab662695c1e6b816.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239911,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c2de42a65f7441e0bdbb266d4702871b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214819,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/af25635a634748d89e38c52d2d699e42.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249528,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7bd356ef90cc41289a6adfcc9c680cd9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216199,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1efe449c06c04ff6be0bacb9b1d54ec1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255850,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cc5a908d5c064b7e8e856c819df2c665.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202307,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0642c382a78483ebd64f41a7939da99.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246307,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5cc906678cb64aafa6dcefbee570a083.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202668,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a5e82d98cae4119af8cb59c9601eabf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192761,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f513e2fc7baf445ab920252c848a4aba.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdc5e791-12a8-5eca-8330-f717d3afc43f/bdc5e791-12a8-5eca-8330-f717d3afc43f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182668,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3310de6a9bbc441bab662695c1e6b816.jpg',
'Width': 1280}],
'price': 28995,
'price_includes_vat': True,
'registration_date': '2023-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ranger 2.0 EcoBlue XLT Pickup Double Cab 4dr Diesel Manual 4WD '
'Euro 6 (s/s) (170 ps)',
'transmission': 'manual',
'trim': 'XLT',
'year': 2023}
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603261039871%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603261039871: {'created_time': 1774883285.65178, 'last_price_update_time': 1774883285.651792}
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603261039871') HTTP/1.1" 204 0
2026-03-30 15:08:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6f1263a8-b929-5988-93a8-0a84195afc10 with identifier 202603120635163
2026-03-30 15:08:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6f1263a8-b929-5988-93a8-0a84195afc10
2026-03-30 15:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 183,
'color': 'Black',
'currency': 'GBP',
'description': 'CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': '6f1263a8-b929-5988-93a8-0a84195afc10',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120635163',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Forester',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6512c6d704a24f1abb86941147b0f55a.jpg',
'https://m.atcdn.co.uk/a/media/12d0191b8d524bd285891f7ff65ff4ed.jpg',
'https://m.atcdn.co.uk/a/media/38e63963a41a4e86a83c35a38d840f3a.jpg',
'https://m.atcdn.co.uk/a/media/f6a0da4c59634ae29cba6d842a0f8977.jpg',
'https://m.atcdn.co.uk/a/media/c41df90debde47fcb0db07a1f285a6d1.jpg',
'https://m.atcdn.co.uk/a/media/60521e12847046febed0b3e995125c51.jpg',
'https://m.atcdn.co.uk/a/media/edf9052ef2db421e9108d6ff9db820da.jpg',
'https://m.atcdn.co.uk/a/media/a6d2a4ba210f49f8871a3ba5787943e7.jpg',
'https://m.atcdn.co.uk/a/media/dc73ed0b83d04c99bd59e3a482f91ce4.jpg',
'https://m.atcdn.co.uk/a/media/7a071a9e8de9486b9498122ee8427eec.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225581,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6512c6d704a24f1abb86941147b0f55a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151670,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/12d0191b8d524bd285891f7ff65ff4ed.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160554,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/38e63963a41a4e86a83c35a38d840f3a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196916,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f6a0da4c59634ae29cba6d842a0f8977.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219851,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c41df90debde47fcb0db07a1f285a6d1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211962,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60521e12847046febed0b3e995125c51.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185810,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/edf9052ef2db421e9108d6ff9db820da.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187982,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a6d2a4ba210f49f8871a3ba5787943e7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183462,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dc73ed0b83d04c99bd59e3a482f91ce4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_910c3f5f-f309-5f99-8043-83c4009cee07/910c3f5f-f309-5f99-8043-83c4009cee07_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231839,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7a071a9e8de9486b9498122ee8427eec.jpg',
'Width': 1280}],
'price': 38995,
'price_includes_vat': True,
'registration_date': '2026-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester Field 2.0 5dr Estate CVT Petrol/Electric',
'transmission': 'automatic',
'trim': 'Field',
'year': 2025}
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635163%27 HTTP/1.1" 200 None
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120635163: {'created_time': 1774883285.941493, 'last_price_update_time': 1774883285.941508}
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120635163') HTTP/1.1" 204 0
2026-03-30 15:08:05 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:05 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ec08633a-4254-58ed-b3fe-a1e9cbb837f7 with identifier: 202603250993855
2026-03-30 15:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec08633a-4254-58ed-b3fe-a1e9cbb837f7
2026-03-30 15:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F118ddc26eb15450da5ce79a7b8f10c41.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/118ddc26eb15450da5ce79a7b8f10c41.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2c6366fe2a44462b80a5617eadcd0b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2c6366fe2a44462b80a5617eadcd0b4.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fec7fff53f1094bbf82f918aa0670fb7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ec7fff53f1094bbf82f918aa0670fb7f.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad221691d43f4424bc40310a06f2cbc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad221691d43f4424bc40310a06f2cbc5.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F355b5d7884e4438486bcc5fe3887db99.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/355b5d7884e4438486bcc5fe3887db99.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F35c61ca2252f4756960792d433086a66.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/35c61ca2252f4756960792d433086a66.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8b81af689c84d349174170e55dca2fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8b81af689c84d349174170e55dca2fa.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F50dcb980aad445eca8774e80bd089d85.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/50dcb980aad445eca8774e80bd089d85.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6046e19d8bb4f0e8411485b594c0917.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6046e19d8bb4f0e8411485b594c0917.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F916b5c2526b749b481100f077f3a4262.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/916b5c2526b749b481100f077f3a4262.jpg already downloaded
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-30 15:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:06 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: edacfaab-034d-5fa2-ab12-99f7e71a2708 with identifier: 202603120635153
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item edacfaab-034d-5fa2-ab12-99f7e71a2708
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24cb5373cbda4dca9ac39f1bd9312d57.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24cb5373cbda4dca9ac39f1bd9312d57.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0def9221dff34af58cd9ac33e2e98341.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0def9221dff34af58cd9ac33e2e98341.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea9ec1fee439431996313e934a6ef128.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea9ec1fee439431996313e934a6ef128.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F13cb1b2c3f6e4ec5871e47ac105e206e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/13cb1b2c3f6e4ec5871e47ac105e206e.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbfd53754eddc411a85447e104eae66ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bfd53754eddc411a85447e104eae66ef.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b0ea046eafb4f0a93d30a4de715f2dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b0ea046eafb4f0a93d30a4de715f2dd.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b06695938ec460ca37915e9bc261b15.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b06695938ec460ca37915e9bc261b15.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F35e175ba6d024087a60cb22c76a9c9c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/35e175ba6d024087a60cb22c76a9c9c0.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa291c57ab25f4fd6928ef1e0744677d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a291c57ab25f4fd6928ef1e0744677d8.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5d93d3bf4a614e7cb99ef1aec7b431eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5d93d3bf4a614e7cb99ef1aec7b431eb.jpg already downloaded
2026-03-30 15:08:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ec08633a-4254-58ed-b3fe-a1e9cbb837f7 with identifier 202603250993855
2026-03-30 15:08:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ec08633a-4254-58ed-b3fe-a1e9cbb837f7
2026-03-30 15:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 241,
'color': 'Grey',
'currency': 'GBP',
'description': 'Isuzu D-Max V-Cross Steel Double Cab Automatic',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': 'ec08633a-4254-58ed-b3fe-a1e9cbb837f7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250993855',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 3000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photo_urls': ['https://m.atcdn.co.uk/a/media/118ddc26eb15450da5ce79a7b8f10c41.jpg',
'https://m.atcdn.co.uk/a/media/d2c6366fe2a44462b80a5617eadcd0b4.jpg',
'https://m.atcdn.co.uk/a/media/ec7fff53f1094bbf82f918aa0670fb7f.jpg',
'https://m.atcdn.co.uk/a/media/ad221691d43f4424bc40310a06f2cbc5.jpg',
'https://m.atcdn.co.uk/a/media/355b5d7884e4438486bcc5fe3887db99.jpg',
'https://m.atcdn.co.uk/a/media/35c61ca2252f4756960792d433086a66.jpg',
'https://m.atcdn.co.uk/a/media/d8b81af689c84d349174170e55dca2fa.jpg',
'https://m.atcdn.co.uk/a/media/50dcb980aad445eca8774e80bd089d85.jpg',
'https://m.atcdn.co.uk/a/media/f6046e19d8bb4f0e8411485b594c0917.jpg',
'https://m.atcdn.co.uk/a/media/916b5c2526b749b481100f077f3a4262.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194637,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/118ddc26eb15450da5ce79a7b8f10c41.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113896,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2c6366fe2a44462b80a5617eadcd0b4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129209,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ec7fff53f1094bbf82f918aa0670fb7f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168848,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad221691d43f4424bc40310a06f2cbc5.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204122,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/355b5d7884e4438486bcc5fe3887db99.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201196,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/35c61ca2252f4756960792d433086a66.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192075,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d8b81af689c84d349174170e55dca2fa.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157838,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/50dcb980aad445eca8774e80bd089d85.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190768,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f6046e19d8bb4f0e8411485b594c0917.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b775543-6905-5ecc-a760-dac2976d4243/3b775543-6905-5ecc-a760-dac2976d4243_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213704,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/916b5c2526b749b481100f077f3a4262.jpg',
'Width': 1280}],
'price': 44394,
'price_includes_vat': True,
'registration_date': '2025-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max V-Cross Steel Dcb 1.9 4dr Pick Up Automatic Diesel',
'transmission': 'automatic',
'trim': 'V-Cross Steel Edition',
'year': 2025}
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250993855%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250993855: {'created_time': 1774883286.43988, 'last_price_update_time': 1774883286.439895}
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250993855') HTTP/1.1" 204 0
2026-03-30 15:08:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: edacfaab-034d-5fa2-ab12-99f7e71a2708 with identifier 202603120635153
2026-03-30 15:08:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item edacfaab-034d-5fa2-ab12-99f7e71a2708
2026-03-30 15:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Black',
'currency': 'GBP',
'description': 'CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': 'edacfaab-034d-5fa2-ab12-99f7e71a2708',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120635153',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/24cb5373cbda4dca9ac39f1bd9312d57.jpg',
'https://m.atcdn.co.uk/a/media/0def9221dff34af58cd9ac33e2e98341.jpg',
'https://m.atcdn.co.uk/a/media/ea9ec1fee439431996313e934a6ef128.jpg',
'https://m.atcdn.co.uk/a/media/13cb1b2c3f6e4ec5871e47ac105e206e.jpg',
'https://m.atcdn.co.uk/a/media/bfd53754eddc411a85447e104eae66ef.jpg',
'https://m.atcdn.co.uk/a/media/3b0ea046eafb4f0a93d30a4de715f2dd.jpg',
'https://m.atcdn.co.uk/a/media/4b06695938ec460ca37915e9bc261b15.jpg',
'https://m.atcdn.co.uk/a/media/35e175ba6d024087a60cb22c76a9c9c0.jpg',
'https://m.atcdn.co.uk/a/media/a291c57ab25f4fd6928ef1e0744677d8.jpg',
'https://m.atcdn.co.uk/a/media/5d93d3bf4a614e7cb99ef1aec7b431eb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229661,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/24cb5373cbda4dca9ac39f1bd9312d57.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217747,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0def9221dff34af58cd9ac33e2e98341.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206890,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea9ec1fee439431996313e934a6ef128.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200526,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/13cb1b2c3f6e4ec5871e47ac105e206e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147325,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bfd53754eddc411a85447e104eae66ef.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187557,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b0ea046eafb4f0a93d30a4de715f2dd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188655,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b06695938ec460ca37915e9bc261b15.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220723,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/35e175ba6d024087a60cb22c76a9c9c0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167500,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a291c57ab25f4fd6928ef1e0744677d8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e84e9e64-62d6-5ae3-b3b3-dbc947f49e34/e84e9e64-62d6-5ae3-b3b3-dbc947f49e34_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119158,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5d93d3bf4a614e7cb99ef1aec7b431eb.jpg',
'Width': 1280}],
'price': 37995,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback Limited 2.5 5dr Estate CVT Petrol',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2026}
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635153%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120635153: {'created_time': 1774883286.498774, 'last_price_update_time': 1774883286.498785}
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120635153') HTTP/1.1" 204 0
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:06 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 377a4aa2-c052-5f9d-9a93-17fdf7d86f73 with identifier: 202603250993852
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 377a4aa2-c052-5f9d-9a93-17fdf7d86f73
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5017b40f531543b5af17bde55d2c2831.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5017b40f531543b5af17bde55d2c2831.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F17ca5ac3acec4c008b76dfd5f3f1fca3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/17ca5ac3acec4c008b76dfd5f3f1fca3.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4e8662d666ca48fa98d01bcebbd0b1ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4e8662d666ca48fa98d01bcebbd0b1ab.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8da0ad0bb62d4631acc9da5795fac03d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8da0ad0bb62d4631acc9da5795fac03d.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff80e4634701d4449b2ca1ce9cf0702ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f80e4634701d4449b2ca1ce9cf0702ec.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77cba45ac8a1477998897bea57f11ed5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77cba45ac8a1477998897bea57f11ed5.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8dd0ed09a9ca4dfda48eb1b235a8c7f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8dd0ed09a9ca4dfda48eb1b235a8c7f9.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45d3fea9944a4fe98326689396328748.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45d3fea9944a4fe98326689396328748.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F10c840fd3feb49b3bb8ca0bb55af6107.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/10c840fd3feb49b3bb8ca0bb55af6107.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc8f4c6255fb34c9c92964e8a78b6b237.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c8f4c6255fb34c9c92964e8a78b6b237.jpg already downloaded
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Getting next page: 4
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 3236, page: 4
2026-03-30 15:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:06 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da20864-e0d6-5440-b80f-4078fea70d6c with identifier: 202603110608176
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4da20864-e0d6-5440-b80f-4078fea70d6c
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F59c0ccb700fc468fbae0444e8fa28276.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/59c0ccb700fc468fbae0444e8fa28276.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0daebedcee864643891f1a5baf90ebc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0daebedcee864643891f1a5baf90ebc4.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2bce49895a7148ac8ba83c8f755dac2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2bce49895a7148ac8ba83c8f755dac2b.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd712014f4619486abd96b37601dad17f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d712014f4619486abd96b37601dad17f.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdbcd3455cc4d474681dfc579535d8ff8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dbcd3455cc4d474681dfc579535d8ff8.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2a731c1c6a794dcc87544d419992a59f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2a731c1c6a794dcc87544d419992a59f.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3d6fbcad0a64ad8af7f36207e587867.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3d6fbcad0a64ad8af7f36207e587867.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6f6daee498b64e92a68912de65d74e78.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6f6daee498b64e92a68912de65d74e78.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19250c68bd284b37811254bd4ffcc255.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19250c68bd284b37811254bd4ffcc255.jpg already downloaded
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc00c65cf10cb4da48ad5da8271e3a06c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c00c65cf10cb4da48ad5da8271e3a06c.jpg already downloaded
2026-03-30 15:08:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 377a4aa2-c052-5f9d-9a93-17fdf7d86f73 with identifier 202603250993852
2026-03-30 15:08:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 377a4aa2-c052-5f9d-9a93-17fdf7d86f73
2026-03-30 15:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2024 Subaru Crosstrek i e-Boxer Touring is a dependable '
'choice. This Euro 6 compliant vehicle combines a 2.0L Petrol '
'Hybrid Engine with Four Wheel Drive, offering a balanced and '
'efficient driving experience. The Touring trim includes '
'several features designed for convenience and comfort, such '
'as wireless Apple CarPlay and Android Auto integration, '
'keyless entry with push button start, a reversing camera for '
'easy parking, and heated front seats for those chilly '
'mornings.\n'
'\n'
'One key benefit is the low insurance group, which can save '
'you money. The Subaru Crosstrek offers modern technology and '
'practical features, making it a well-rounded vehicle for '
'everyday use.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': '377a4aa2-c052-5f9d-9a93-17fdf7d86f73',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250993852',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Crosstrek',
'odometer': 7972,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/5017b40f531543b5af17bde55d2c2831.jpg',
'https://m.atcdn.co.uk/a/media/17ca5ac3acec4c008b76dfd5f3f1fca3.jpg',
'https://m.atcdn.co.uk/a/media/4e8662d666ca48fa98d01bcebbd0b1ab.jpg',
'https://m.atcdn.co.uk/a/media/8da0ad0bb62d4631acc9da5795fac03d.jpg',
'https://m.atcdn.co.uk/a/media/f80e4634701d4449b2ca1ce9cf0702ec.jpg',
'https://m.atcdn.co.uk/a/media/77cba45ac8a1477998897bea57f11ed5.jpg',
'https://m.atcdn.co.uk/a/media/8dd0ed09a9ca4dfda48eb1b235a8c7f9.jpg',
'https://m.atcdn.co.uk/a/media/45d3fea9944a4fe98326689396328748.jpg',
'https://m.atcdn.co.uk/a/media/10c840fd3feb49b3bb8ca0bb55af6107.jpg',
'https://m.atcdn.co.uk/a/media/c8f4c6255fb34c9c92964e8a78b6b237.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206732,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5017b40f531543b5af17bde55d2c2831.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173503,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/17ca5ac3acec4c008b76dfd5f3f1fca3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161266,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4e8662d666ca48fa98d01bcebbd0b1ab.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209627,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8da0ad0bb62d4631acc9da5795fac03d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210273,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f80e4634701d4449b2ca1ce9cf0702ec.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238634,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/77cba45ac8a1477998897bea57f11ed5.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215354,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8dd0ed09a9ca4dfda48eb1b235a8c7f9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177682,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/45d3fea9944a4fe98326689396328748.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211087,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/10c840fd3feb49b3bb8ca0bb55af6107.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0247c9-5754-5e27-9eeb-455a12d2b3b4/4b0247c9-5754-5e27-9eeb-455a12d2b3b4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232568,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c8f4c6255fb34c9c92964e8a78b6b237.jpg',
'Width': 1280}],
'price': 26895,
'price_includes_vat': True,
'registration_date': '2024-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Crosstrek 2.0 i e-Boxer Touring SUV 5dr Petrol Hybrid '
'Lineartronic 4WD Euro 6 (s/s) (136 ps)',
'transmission': 'automatic',
'trim': 'Touring',
'year': 2024}
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250993852%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250993852: {'created_time': 1774883286.93963, 'last_price_update_time': 1774883286.939644}
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250993852') HTTP/1.1" 204 0
2026-03-30 15:08:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4da20864-e0d6-5440-b80f-4078fea70d6c with identifier 202603110608176
2026-03-30 15:08:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4da20864-e0d6-5440-b80f-4078fea70d6c
2026-03-30 15:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 174,
'color': 'Red',
'currency': 'GBP',
'description': 'RARE COLOUR ¦ LEATHER ¦ REVERSING CAMERA',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': '4da20864-e0d6-5440-b80f-4078fea70d6c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110608176',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Crosstrek',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/59c0ccb700fc468fbae0444e8fa28276.jpg',
'https://m.atcdn.co.uk/a/media/0daebedcee864643891f1a5baf90ebc4.jpg',
'https://m.atcdn.co.uk/a/media/2bce49895a7148ac8ba83c8f755dac2b.jpg',
'https://m.atcdn.co.uk/a/media/d712014f4619486abd96b37601dad17f.jpg',
'https://m.atcdn.co.uk/a/media/dbcd3455cc4d474681dfc579535d8ff8.jpg',
'https://m.atcdn.co.uk/a/media/2a731c1c6a794dcc87544d419992a59f.jpg',
'https://m.atcdn.co.uk/a/media/c3d6fbcad0a64ad8af7f36207e587867.jpg',
'https://m.atcdn.co.uk/a/media/6f6daee498b64e92a68912de65d74e78.jpg',
'https://m.atcdn.co.uk/a/media/19250c68bd284b37811254bd4ffcc255.jpg',
'https://m.atcdn.co.uk/a/media/c00c65cf10cb4da48ad5da8271e3a06c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179973,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/59c0ccb700fc468fbae0444e8fa28276.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118113,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0daebedcee864643891f1a5baf90ebc4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126334,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2bce49895a7148ac8ba83c8f755dac2b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170314,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d712014f4619486abd96b37601dad17f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193665,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dbcd3455cc4d474681dfc579535d8ff8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179431,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2a731c1c6a794dcc87544d419992a59f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147563,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c3d6fbcad0a64ad8af7f36207e587867.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161198,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6f6daee498b64e92a68912de65d74e78.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192018,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/19250c68bd284b37811254bd4ffcc255.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da20864-e0d6-5440-b80f-4078fea70d6c/4da20864-e0d6-5440-b80f-4078fea70d6c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218401,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c00c65cf10cb4da48ad5da8271e3a06c.jpg',
'Width': 1280}],
'price': 37995,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Crosstrek Touring 2.0 5dr Hatchback CVT Petrol/Electric',
'transmission': 'automatic',
'trim': 'Touring',
'year': 2026}
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110608176%27 HTTP/1.1" 200 None
2026-03-30 15:08:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110608176: {'created_time': 1774883286.993988, 'last_price_update_time': 1774883286.993999}
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110608176') HTTP/1.1" 204 0
2026-03-30 15:08:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f1d9a19-b184-5790-b2f3-fc96ae24bb00 with identifier: 202603210890674
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f1d9a19-b184-5790-b2f3-fc96ae24bb00
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4be93a3788d4128a5946a3710cd66cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4be93a3788d4128a5946a3710cd66cc.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F729ae7de132d4c5484c3722cec767905.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/729ae7de132d4c5484c3722cec767905.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe8cdde9e5b994817b2d552a89d9088b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e8cdde9e5b994817b2d552a89d9088b7.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F93a65202f0aa4f8f8c1e9966534680f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/93a65202f0aa4f8f8c1e9966534680f1.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fab0da06b817a479eb231bb6a79368836.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ab0da06b817a479eb231bb6a79368836.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F22496bd41b97436aae4b85f7d9a13a41.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/22496bd41b97436aae4b85f7d9a13a41.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69564a13b41342e194aea42d239a4b14.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69564a13b41342e194aea42d239a4b14.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdddde2d4457f4c32b98c8f0bb6d1a52c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dddde2d4457f4c32b98c8f0bb6d1a52c.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fab6b9067cc4443f19802625254c0ec51.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ab6b9067cc4443f19802625254c0ec51.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe99f1faae7ed4b9f8a112ff186121188.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e99f1faae7ed4b9f8a112ff186121188.jpg already downloaded
2026-03-30 15:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a with identifier: 202603090540388
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb64614c110be46cbb81ca93027b5e95f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b64614c110be46cbb81ca93027b5e95f.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd05c09a22f354da0930b18306e55fe42.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d05c09a22f354da0930b18306e55fe42.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F756a9e1251a441268f8deab3c071236f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/756a9e1251a441268f8deab3c071236f.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5151cf85cdc461893cf15ab09747a3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5151cf85cdc461893cf15ab09747a3d.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa78e38ef19a9408a91910582534315b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a78e38ef19a9408a91910582534315b8.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F753aa0265fbc46439b57e335f9eef9f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/753aa0265fbc46439b57e335f9eef9f5.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdbe82c607e44b5682878b83096f9b7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdbe82c607e44b5682878b83096f9b7f.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20d75071b3484cfbadde1998e02f3bb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20d75071b3484cfbadde1998e02f3bb7.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd975977eb59149d498d5eed9912473cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d975977eb59149d498d5eed9912473cb.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2a39f74c25a041c7bf4ec030e5547fc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2a39f74c25a041c7bf4ec030e5547fc0.jpg already downloaded
2026-03-30 15:08:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5f1d9a19-b184-5790-b2f3-fc96ae24bb00 with identifier 202603210890674
2026-03-30 15:08:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5f1d9a19-b184-5790-b2f3-fc96ae24bb00
2026-03-30 15:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 183,
'color': 'Unknown',
'currency': 'GBP',
'description': 'LEATHER ¦ REVERSING CAMERA',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': '5f1d9a19-b184-5790-b2f3-fc96ae24bb00',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210890674',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Forester',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f4be93a3788d4128a5946a3710cd66cc.jpg',
'https://m.atcdn.co.uk/a/media/729ae7de132d4c5484c3722cec767905.jpg',
'https://m.atcdn.co.uk/a/media/e8cdde9e5b994817b2d552a89d9088b7.jpg',
'https://m.atcdn.co.uk/a/media/93a65202f0aa4f8f8c1e9966534680f1.jpg',
'https://m.atcdn.co.uk/a/media/ab0da06b817a479eb231bb6a79368836.jpg',
'https://m.atcdn.co.uk/a/media/22496bd41b97436aae4b85f7d9a13a41.jpg',
'https://m.atcdn.co.uk/a/media/69564a13b41342e194aea42d239a4b14.jpg',
'https://m.atcdn.co.uk/a/media/dddde2d4457f4c32b98c8f0bb6d1a52c.jpg',
'https://m.atcdn.co.uk/a/media/ab6b9067cc4443f19802625254c0ec51.jpg',
'https://m.atcdn.co.uk/a/media/e99f1faae7ed4b9f8a112ff186121188.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184165,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4be93a3788d4128a5946a3710cd66cc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119070,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/729ae7de132d4c5484c3722cec767905.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149776,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e8cdde9e5b994817b2d552a89d9088b7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172134,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/93a65202f0aa4f8f8c1e9966534680f1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179311,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab0da06b817a479eb231bb6a79368836.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184412,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/22496bd41b97436aae4b85f7d9a13a41.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139607,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/69564a13b41342e194aea42d239a4b14.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162651,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dddde2d4457f4c32b98c8f0bb6d1a52c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171970,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab6b9067cc4443f19802625254c0ec51.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f1d9a19-b184-5790-b2f3-fc96ae24bb00/5f1d9a19-b184-5790-b2f3-fc96ae24bb00_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207852,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e99f1faae7ed4b9f8a112ff186121188.jpg',
'Width': 1280}],
'price': 41995,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester Field 2.0 5dr Estate CVT Petrol/Electric',
'transmission': 'automatic',
'trim': 'Field',
'year': 2026}
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210890674%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210890674: {'created_time': 1774883287.511117, 'last_price_update_time': 1774883287.511128}
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210890674') HTTP/1.1" 204 0
2026-03-30 15:08:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a with identifier 202603090540388
2026-03-30 15:08:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a
2026-03-30 15:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 183,
'color': 'Green',
'currency': 'GBP',
'description': 'GREEN FIELD IN STOCK ¦ LEATHER ¦ REVERSING CAMERA',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': 'cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090540388',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Forester',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b64614c110be46cbb81ca93027b5e95f.jpg',
'https://m.atcdn.co.uk/a/media/d05c09a22f354da0930b18306e55fe42.jpg',
'https://m.atcdn.co.uk/a/media/756a9e1251a441268f8deab3c071236f.jpg',
'https://m.atcdn.co.uk/a/media/b5151cf85cdc461893cf15ab09747a3d.jpg',
'https://m.atcdn.co.uk/a/media/a78e38ef19a9408a91910582534315b8.jpg',
'https://m.atcdn.co.uk/a/media/753aa0265fbc46439b57e335f9eef9f5.jpg',
'https://m.atcdn.co.uk/a/media/cdbe82c607e44b5682878b83096f9b7f.jpg',
'https://m.atcdn.co.uk/a/media/20d75071b3484cfbadde1998e02f3bb7.jpg',
'https://m.atcdn.co.uk/a/media/d975977eb59149d498d5eed9912473cb.jpg',
'https://m.atcdn.co.uk/a/media/2a39f74c25a041c7bf4ec030e5547fc0.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208035,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b64614c110be46cbb81ca93027b5e95f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113422,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d05c09a22f354da0930b18306e55fe42.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136527,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/756a9e1251a441268f8deab3c071236f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182570,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b5151cf85cdc461893cf15ab09747a3d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198052,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a78e38ef19a9408a91910582534315b8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216356,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/753aa0265fbc46439b57e335f9eef9f5.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150229,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cdbe82c607e44b5682878b83096f9b7f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194705,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/20d75071b3484cfbadde1998e02f3bb7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175664,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d975977eb59149d498d5eed9912473cb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a/cb67bd53-b7a8-5ba5-8e96-7fcd36f6873a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221427,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2a39f74c25a041c7bf4ec030e5547fc0.jpg',
'Width': 1280}],
'price': 42235,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester Field 2.0 5dr Estate CVT Petrol/Electric',
'transmission': 'automatic',
'trim': 'Field',
'year': 2026}
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090540388%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090540388: {'created_time': 1774883287.605294, 'last_price_update_time': 1774883287.605309}
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090540388') HTTP/1.1" 204 0
2026-03-30 15:08:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ba3e52dd-5c83-5d73-92c3-b41779241e25 with identifier: 202603210890590
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba3e52dd-5c83-5d73-92c3-b41779241e25
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F890462d87bcf408baf06545fb3d9ec2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/890462d87bcf408baf06545fb3d9ec2b.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55c3e93b9ed44083acd883e74d6e206f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55c3e93b9ed44083acd883e74d6e206f.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68ecee937df3418eaff65628e1b5f3fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68ecee937df3418eaff65628e1b5f3fb.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3dd8be74c0341fdb012ca133bba6d0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3dd8be74c0341fdb012ca133bba6d0a.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5c12a4c171e46178c113d4e145da036.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5c12a4c171e46178c113d4e145da036.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F151296c5bf714c2d875770ad7806dd63.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/151296c5bf714c2d875770ad7806dd63.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d5de003c7624e2ebb03ec65acda7a10.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d5de003c7624e2ebb03ec65acda7a10.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F75f3ec72997b4518b3da92df49260db9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/75f3ec72997b4518b3da92df49260db9.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7d2773b8cc83458e82a8307a5e2a421c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7d2773b8cc83458e82a8307a5e2a421c.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2795b9120f544f239f97fc0fdaeae2a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2795b9120f544f239f97fc0fdaeae2a4.jpg already downloaded
2026-03-30 15:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b8131b66-a94f-5432-a24a-d4a26f9a90f8 with identifier: 202603060470440
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8131b66-a94f-5432-a24a-d4a26f9a90f8
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa1d9172c69ea4823af3a48bae88c462a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a1d9172c69ea4823af3a48bae88c462a.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F927cc15f900544ffa1834fead23e3515.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/927cc15f900544ffa1834fead23e3515.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F926eee5ea3f04352b4df2a314bf25f08.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/926eee5ea3f04352b4df2a314bf25f08.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97fbdd165d2b49c486f6fbf03d289bdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97fbdd165d2b49c486f6fbf03d289bdf.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8daac86d832941a9ad710599d0914bf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8daac86d832941a9ad710599d0914bf5.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F94a77b1535ec400fb8728d22043d84aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/94a77b1535ec400fb8728d22043d84aa.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe19ce0e413f44c0e9dc63123233639d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e19ce0e413f44c0e9dc63123233639d9.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd7d7b38702ec4d07975ee672320ec241.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d7d7b38702ec4d07975ee672320ec241.jpg already downloaded
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1bb09b9b5b024361910f8786a93b583d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1bb09b9b5b024361910f8786a93b583d.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F172e9e27bb1247eca9cbb2bdf2a29964.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/172e9e27bb1247eca9cbb2bdf2a29964.jpg already downloaded
2026-03-30 15:08:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d01c6ab9-1d59-5acf-9a5b-f9aab75963ad with identifier: 202603070494191
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d01c6ab9-1d59-5acf-9a5b-f9aab75963ad
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78764cd7d2154abbb26b374c3dfa2186.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78764cd7d2154abbb26b374c3dfa2186.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7c1e3142de73471a84ae6a7a0615298b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7c1e3142de73471a84ae6a7a0615298b.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7aa73c799cfa4d249efa4b9edf3c579f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7aa73c799cfa4d249efa4b9edf3c579f.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b6f844c5051410fbcb902b621a00804.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b6f844c5051410fbcb902b621a00804.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8fef3043c7834ea49e96d04cc240e9c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8fef3043c7834ea49e96d04cc240e9c9.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69c6c046dc1a43efb104a8974a87d505.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69c6c046dc1a43efb104a8974a87d505.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c91f28049584a2eab408f4c34a28cd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c91f28049584a2eab408f4c34a28cd0.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F70009e3d3f65427c8128abd3da4c58c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/70009e3d3f65427c8128abd3da4c58c3.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb1847384e5a64c8f9df9e21ac9165c5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b1847384e5a64c8f9df9e21ac9165c5a.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F869d17b3292e4f68821f8a0a99239aac.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/869d17b3292e4f68821f8a0a99239aac.jpg already downloaded
2026-03-30 15:08:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ba3e52dd-5c83-5d73-92c3-b41779241e25 with identifier 202603210890590
2026-03-30 15:08:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ba3e52dd-5c83-5d73-92c3-b41779241e25
2026-03-30 15:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 220,
'color': 'Orange',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': 'ba3e52dd-5c83-5d73-92c3-b41779241e25',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210890590',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 70122,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 14,
'photo_urls': ['https://m.atcdn.co.uk/a/media/890462d87bcf408baf06545fb3d9ec2b.jpg',
'https://m.atcdn.co.uk/a/media/55c3e93b9ed44083acd883e74d6e206f.jpg',
'https://m.atcdn.co.uk/a/media/68ecee937df3418eaff65628e1b5f3fb.jpg',
'https://m.atcdn.co.uk/a/media/f3dd8be74c0341fdb012ca133bba6d0a.jpg',
'https://m.atcdn.co.uk/a/media/f5c12a4c171e46178c113d4e145da036.jpg',
'https://m.atcdn.co.uk/a/media/151296c5bf714c2d875770ad7806dd63.jpg',
'https://m.atcdn.co.uk/a/media/9d5de003c7624e2ebb03ec65acda7a10.jpg',
'https://m.atcdn.co.uk/a/media/75f3ec72997b4518b3da92df49260db9.jpg',
'https://m.atcdn.co.uk/a/media/7d2773b8cc83458e82a8307a5e2a421c.jpg',
'https://m.atcdn.co.uk/a/media/2795b9120f544f239f97fc0fdaeae2a4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260429,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/890462d87bcf408baf06545fb3d9ec2b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238269,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55c3e93b9ed44083acd883e74d6e206f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237938,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/68ecee937df3418eaff65628e1b5f3fb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217062,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3dd8be74c0341fdb012ca133bba6d0a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198564,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f5c12a4c171e46178c113d4e145da036.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199403,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/151296c5bf714c2d875770ad7806dd63.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193724,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d5de003c7624e2ebb03ec65acda7a10.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190060,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/75f3ec72997b4518b3da92df49260db9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168493,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7d2773b8cc83458e82a8307a5e2a421c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3e52dd-5c83-5d73-92c3-b41779241e25/ba3e52dd-5c83-5d73-92c3-b41779241e25_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297202,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2795b9120f544f239f97fc0fdaeae2a4.jpg',
'Width': 1280}],
'price': 24995,
'price_includes_vat': True,
'registration_date': '2021-05-19',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max 1.9 TD DL40 Pickup Double Cab 4dr Diesel Manual 4WD '
'Euro 6 (s/s) (164 ps)',
'transmission': 'manual',
'trim': 'DL40',
'year': 2021}
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210890590%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210890590: {'created_time': 1774883288.269605, 'last_price_update_time': 1774883288.269617}
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210890590') HTTP/1.1" 204 0
2026-03-30 15:08:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b8131b66-a94f-5432-a24a-d4a26f9a90f8 with identifier 202603060470440
2026-03-30 15:08:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b8131b66-a94f-5432-a24a-d4a26f9a90f8
2026-03-30 15:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'White',
'currency': 'GBP',
'description': 'Performance - With a 1.5L hybrid engine, the most powerful '
'electric motor in its class. Enjoy better performance, '
'improved fuel efficiency and a smoother drive – all without '
'plugging in.\n'
'\n'
'Design -Stand out with more style. A specially-designed, '
'sleek aerodynamic sports exterior kit, full-width rear '
'lightbar and LED headlights come as standard, giving your car '
'a bold and unique look.\n'
'\n'
'Safety - You deserve more innovative safety features. With a '
'comprehensive ADAS package, from Adaptive Cruise Control to '
'Automatic Emergency Braking and Blind Spot Detection, you’ll '
'always feel protected.\n'
'\n'
'Infotainment - Stay connected with more tech at your '
'fingertips. A 12.3” infotainment display, complete with '
'Bluetooth, Apple CarPlay and Android Auto meaning every '
'journey is as entertaining as it is effortless.\n'
'\n'
'Elegant design, efficient hybrid performance with 5 years '
'unlimited mileage vehicle warranty.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 186,
'fuel_type': 'Petrol Hybrid',
'id': 'b8131b66-a94f-5432-a24a-d4a26f9a90f8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060470440',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'Haval Jolion Pro',
'odometer': 10,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photo_urls': ['https://m.atcdn.co.uk/a/media/a1d9172c69ea4823af3a48bae88c462a.jpg',
'https://m.atcdn.co.uk/a/media/927cc15f900544ffa1834fead23e3515.jpg',
'https://m.atcdn.co.uk/a/media/926eee5ea3f04352b4df2a314bf25f08.jpg',
'https://m.atcdn.co.uk/a/media/97fbdd165d2b49c486f6fbf03d289bdf.jpg',
'https://m.atcdn.co.uk/a/media/8daac86d832941a9ad710599d0914bf5.jpg',
'https://m.atcdn.co.uk/a/media/94a77b1535ec400fb8728d22043d84aa.jpg',
'https://m.atcdn.co.uk/a/media/e19ce0e413f44c0e9dc63123233639d9.jpg',
'https://m.atcdn.co.uk/a/media/d7d7b38702ec4d07975ee672320ec241.jpg',
'https://m.atcdn.co.uk/a/media/1bb09b9b5b024361910f8786a93b583d.jpg',
'https://m.atcdn.co.uk/a/media/172e9e27bb1247eca9cbb2bdf2a29964.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209028,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a1d9172c69ea4823af3a48bae88c462a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124073,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/927cc15f900544ffa1834fead23e3515.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118486,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/926eee5ea3f04352b4df2a314bf25f08.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171909,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/97fbdd165d2b49c486f6fbf03d289bdf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168278,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8daac86d832941a9ad710599d0914bf5.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164695,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/94a77b1535ec400fb8728d22043d84aa.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153906,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e19ce0e413f44c0e9dc63123233639d9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150198,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d7d7b38702ec4d07975ee672320ec241.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133601,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1bb09b9b5b024361910f8786a93b583d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8131b66-a94f-5432-a24a-d4a26f9a90f8/b8131b66-a94f-5432-a24a-d4a26f9a90f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169305,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/172e9e27bb1247eca9cbb2bdf2a29964.jpg',
'Width': 1280}],
'price': 23995,
'price_includes_vat': True,
'registration_date': '2026-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'GWM Haval Jolion Pro 1.5 Lux SUV 5dr Petrol Hybrid DHT Euro 6 (s/s) '
'(189 ps)',
'transmission': 'automatic',
'trim': 'Lux',
'year': 2026}
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060470440%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060470440: {'created_time': 1774883288.323735, 'last_price_update_time': 1774883288.323746}
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060470440') HTTP/1.1" 204 0
2026-03-30 15:08:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d01c6ab9-1d59-5acf-9a5b-f9aab75963ad with identifier 202603070494191
2026-03-30 15:08:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d01c6ab9-1d59-5acf-9a5b-f9aab75963ad
2026-03-30 15:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 230,
'color': 'Blue',
'currency': 'GBP',
'description': 'Performance - Drive with confidence in the GWM POER300. With '
'its turbocharged engine, responsive transmission and '
'impressive towing power, you’ll be ready to tackle any '
'challenge.\n'
'\n'
'Tech- Make every journey a pleasure with innovative safety '
'features and driver assistance systems embedded to give you '
'peace of mind. Stay connected with Apple CarPlay and Android '
'Auto standard across the range. Enjoy features like Wireless '
'Charging, Smart Keyless Entry and Push Button Start to make '
'everyday practical.\n'
'\n'
'More power. More performance. More possibilities with 5 '
'years/125,000 miles warranty.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 180,
'fuel_type': 'Diesel',
'id': 'd01c6ab9-1d59-5acf-9a5b-f9aab75963ad',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603070494191',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'POER300',
'odometer': 300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/78764cd7d2154abbb26b374c3dfa2186.jpg',
'https://m.atcdn.co.uk/a/media/7c1e3142de73471a84ae6a7a0615298b.jpg',
'https://m.atcdn.co.uk/a/media/7aa73c799cfa4d249efa4b9edf3c579f.jpg',
'https://m.atcdn.co.uk/a/media/0b6f844c5051410fbcb902b621a00804.jpg',
'https://m.atcdn.co.uk/a/media/8fef3043c7834ea49e96d04cc240e9c9.jpg',
'https://m.atcdn.co.uk/a/media/69c6c046dc1a43efb104a8974a87d505.jpg',
'https://m.atcdn.co.uk/a/media/0c91f28049584a2eab408f4c34a28cd0.jpg',
'https://m.atcdn.co.uk/a/media/70009e3d3f65427c8128abd3da4c58c3.jpg',
'https://m.atcdn.co.uk/a/media/b1847384e5a64c8f9df9e21ac9165c5a.jpg',
'https://m.atcdn.co.uk/a/media/869d17b3292e4f68821f8a0a99239aac.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231134,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/78764cd7d2154abbb26b374c3dfa2186.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81915,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7c1e3142de73471a84ae6a7a0615298b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122314,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7aa73c799cfa4d249efa4b9edf3c579f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195605,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b6f844c5051410fbcb902b621a00804.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171617,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8fef3043c7834ea49e96d04cc240e9c9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163028,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/69c6c046dc1a43efb104a8974a87d505.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131742,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c91f28049584a2eab408f4c34a28cd0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132214,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/70009e3d3f65427c8128abd3da4c58c3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83459,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b1847384e5a64c8f9df9e21ac9165c5a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d01c6ab9-1d59-5acf-9a5b-f9aab75963ad/d01c6ab9-1d59-5acf-9a5b-f9aab75963ad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204237,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/869d17b3292e4f68821f8a0a99239aac.jpg',
'Width': 1280}],
'price': 44394,
'price_includes_vat': True,
'registration_date': '2026-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'GWM POER300 2.4D Vanta Pickup Double Cab 4dr Diesel Auto 4WD Euro 6 '
'(s/s) (183 ps)',
'transmission': 'automatic',
'trim': 'Vanta',
'year': 2026}
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070494191%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603070494191: {'created_time': 1774883288.375959, 'last_price_update_time': 1774883288.375969}
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603070494191') HTTP/1.1" 204 0
2026-03-30 15:08:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 67078189-8ac6-5f36-a37a-2788ba9b55eb with identifier: 202603210885975
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67078189-8ac6-5f36-a37a-2788ba9b55eb
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F238b6e63f217492ba9a58e23e213be32.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/238b6e63f217492ba9a58e23e213be32.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11b59b94865040bab4f50621c61431a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11b59b94865040bab4f50621c61431a0.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2a8706c1c79a4d4896566626ca4ad0d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2a8706c1c79a4d4896566626ca4ad0d0.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f7d94e9a7164b11b460967c3c411e92.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f7d94e9a7164b11b460967c3c411e92.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45f35716ddb549c4a38bc140bfdbbed6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45f35716ddb549c4a38bc140bfdbbed6.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F279602edf7594d1eb2f25221c3ccc6b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/279602edf7594d1eb2f25221c3ccc6b4.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e896953fab14024a7017415e9ea5704.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e896953fab14024a7017415e9ea5704.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe97d3a7b8d9d4a7ebbfec8e04a411b46.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e97d3a7b8d9d4a7ebbfec8e04a411b46.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7a66de6ca0bc42e9ac45b28d90ecc3f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7a66de6ca0bc42e9ac45b28d90ecc3f9.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8906db69ca1b48b58ec25e21d60e2a04.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8906db69ca1b48b58ec25e21d60e2a04.jpg already downloaded
2026-03-30 15:08:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 159817ee-c29e-553b-a3bc-2c97cf75a080 with identifier: 202603060469295
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 159817ee-c29e-553b-a3bc-2c97cf75a080
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bb58f6e5d844832bd89f5ac1e09b3cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bb58f6e5d844832bd89f5ac1e09b3cb.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F452d921be789408e8ce029f59072bae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/452d921be789408e8ce029f59072bae9.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6fc9e3b6a48e4773bb83cd947477f52a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6fc9e3b6a48e4773bb83cd947477f52a.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8164f7c0b93d4bcc99a806df47c145c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8164f7c0b93d4bcc99a806df47c145c6.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffeb53c6365d040de8347231da1b3f20d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/feb53c6365d040de8347231da1b3f20d.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5b742a78404441d797fd8ec8e93f4cdb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5b742a78404441d797fd8ec8e93f4cdb.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8500543f22864a5db8fffd202744a383.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8500543f22864a5db8fffd202744a383.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff8f25162242042769ca786c5b09044a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f8f25162242042769ca786c5b09044a0.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b1f76d979ee436682904be19249b849.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b1f76d979ee436682904be19249b849.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa6cbf50223e142e384204946100c3ba1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a6cbf50223e142e384204946100c3ba1.jpg already downloaded
2026-03-30 15:08:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a724415-8d27-5f78-8ac0-317c07b747c7 with identifier: 202603060470605
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a724415-8d27-5f78-8ac0-317c07b747c7
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1487f8cb35464337a0009b863b7a308a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1487f8cb35464337a0009b863b7a308a.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F658218e7eb99480e9cb24723a40dd60f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/658218e7eb99480e9cb24723a40dd60f.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e372a456bba41d2b842226417db55b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e372a456bba41d2b842226417db55b1.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd76970bcb38c441f989e72b3db4ca1e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d76970bcb38c441f989e72b3db4ca1e0.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F42e33f49da7a49d2b1f3965fbf1ed077.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/42e33f49da7a49d2b1f3965fbf1ed077.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6de1b75c36b24fffb19ba23daf024e24.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6de1b75c36b24fffb19ba23daf024e24.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8cacac864d84ff3975aaee99a0e89a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8cacac864d84ff3975aaee99a0e89a9.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F480c70ed84354b1d8272f1ac20fc527d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/480c70ed84354b1d8272f1ac20fc527d.jpg already downloaded
2026-03-30 15:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8253125095946679ad5cfeb2367c5f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8253125095946679ad5cfeb2367c5f1.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F409d1c99e57744dcb3a03e6fc4cb54e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/409d1c99e57744dcb3a03e6fc4cb54e8.jpg already downloaded
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 67078189-8ac6-5f36-a37a-2788ba9b55eb with identifier 202603210885975
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 67078189-8ac6-5f36-a37a-2788ba9b55eb
2026-03-30 15:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Silver',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 89,
'fuel_type': 'Petrol',
'id': '67078189-8ac6-5f36-a37a-2788ba9b55eb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210885975',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 13702,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/238b6e63f217492ba9a58e23e213be32.jpg',
'https://m.atcdn.co.uk/a/media/11b59b94865040bab4f50621c61431a0.jpg',
'https://m.atcdn.co.uk/a/media/2a8706c1c79a4d4896566626ca4ad0d0.jpg',
'https://m.atcdn.co.uk/a/media/0f7d94e9a7164b11b460967c3c411e92.jpg',
'https://m.atcdn.co.uk/a/media/45f35716ddb549c4a38bc140bfdbbed6.jpg',
'https://m.atcdn.co.uk/a/media/279602edf7594d1eb2f25221c3ccc6b4.jpg',
'https://m.atcdn.co.uk/a/media/5e896953fab14024a7017415e9ea5704.jpg',
'https://m.atcdn.co.uk/a/media/e97d3a7b8d9d4a7ebbfec8e04a411b46.jpg',
'https://m.atcdn.co.uk/a/media/7a66de6ca0bc42e9ac45b28d90ecc3f9.jpg',
'https://m.atcdn.co.uk/a/media/8906db69ca1b48b58ec25e21d60e2a04.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178680,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/238b6e63f217492ba9a58e23e213be32.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141547,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/11b59b94865040bab4f50621c61431a0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146904,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2a8706c1c79a4d4896566626ca4ad0d0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180584,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f7d94e9a7164b11b460967c3c411e92.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170990,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/45f35716ddb549c4a38bc140bfdbbed6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169909,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/279602edf7594d1eb2f25221c3ccc6b4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131408,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e896953fab14024a7017415e9ea5704.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163244,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e97d3a7b8d9d4a7ebbfec8e04a411b46.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154801,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7a66de6ca0bc42e9ac45b28d90ecc3f9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67078189-8ac6-5f36-a37a-2788ba9b55eb/67078189-8ac6-5f36-a37a-2788ba9b55eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187470,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8906db69ca1b48b58ec25e21d60e2a04.jpg',
'Width': 1280}],
'price': 14495,
'price_includes_vat': True,
'registration_date': '2017-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Match Edition Hatchback 5dr Petrol DSG Euro '
'6 (s/s) (90 ps)',
'transmission': 'automatic',
'trim': 'Match Edition',
'year': 2017}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210885975%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210885975: {'created_time': 1774883289.054888, 'last_price_update_time': 1774883289.054899}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210885975') HTTP/1.1" 204 0
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 159817ee-c29e-553b-a3bc-2c97cf75a080 with identifier 202603060469295
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 159817ee-c29e-553b-a3bc-2c97cf75a080
2026-03-30 15:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 183,
'color': 'Unknown',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': '159817ee-c29e-553b-a3bc-2c97cf75a080',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060469295',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Forester',
'odometer': 250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4bb58f6e5d844832bd89f5ac1e09b3cb.jpg',
'https://m.atcdn.co.uk/a/media/452d921be789408e8ce029f59072bae9.jpg',
'https://m.atcdn.co.uk/a/media/6fc9e3b6a48e4773bb83cd947477f52a.jpg',
'https://m.atcdn.co.uk/a/media/8164f7c0b93d4bcc99a806df47c145c6.jpg',
'https://m.atcdn.co.uk/a/media/feb53c6365d040de8347231da1b3f20d.jpg',
'https://m.atcdn.co.uk/a/media/5b742a78404441d797fd8ec8e93f4cdb.jpg',
'https://m.atcdn.co.uk/a/media/8500543f22864a5db8fffd202744a383.jpg',
'https://m.atcdn.co.uk/a/media/f8f25162242042769ca786c5b09044a0.jpg',
'https://m.atcdn.co.uk/a/media/7b1f76d979ee436682904be19249b849.jpg',
'https://m.atcdn.co.uk/a/media/a6cbf50223e142e384204946100c3ba1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216594,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4bb58f6e5d844832bd89f5ac1e09b3cb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213802,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/452d921be789408e8ce029f59072bae9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198145,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6fc9e3b6a48e4773bb83cd947477f52a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201126,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8164f7c0b93d4bcc99a806df47c145c6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197080,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/feb53c6365d040de8347231da1b3f20d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188151,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5b742a78404441d797fd8ec8e93f4cdb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146780,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8500543f22864a5db8fffd202744a383.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185162,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f8f25162242042769ca786c5b09044a0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175768,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7b1f76d979ee436682904be19249b849.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_159817ee-c29e-553b-a3bc-2c97cf75a080/159817ee-c29e-553b-a3bc-2c97cf75a080_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222394,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a6cbf50223e142e384204946100c3ba1.jpg',
'Width': 1280}],
'price': 36995,
'price_includes_vat': True,
'registration_date': '2026-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester 2.0 i e-Boxer Limited SUV 5dr Petrol Hybrid '
'Lineartronic 4WD Euro 6 (s/s) (136 ps)',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2026}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060469295%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060469295: {'created_time': 1774883289.11513, 'last_price_update_time': 1774883289.115141}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060469295') HTTP/1.1" 204 0
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7a724415-8d27-5f78-8ac0-317c07b747c7 with identifier 202603060470605
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7a724415-8d27-5f78-8ac0-317c07b747c7
2026-03-30 15:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Grey',
'currency': 'GBP',
'description': 'Performance - With a 1.5L hybrid engine, the most powerful '
'electric motor in its class. Enjoy better performance, '
'improved fuel efficiency and a smoother drive – all without '
'plugging in.\n'
'\n'
'Design -Stand out with more style. A specially-designed, '
'sleek aerodynamic sports exterior kit, full-width rear '
'lightbar and LED headlights come as standard, giving your car '
'a bold and unique look.\n'
'\n'
'Safety - You deserve more innovative safety features. With a '
'comprehensive ADAS package, from Adaptive Cruise Control to '
'Automatic Emergency Braking and Blind Spot Detection, you’ll '
'always feel protected.\n'
'\n'
'Infotainment - Stay connected with more tech at your '
'fingertips. A 12.3” infotainment display, complete with '
'Bluetooth, Apple CarPlay and Android Auto meaning every '
'journey is as entertaining as it is effortless.\n'
'\n'
'Elegant design, efficient hybrid performance with 5 years '
'unlimited mileage vehicle warranty.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 186,
'fuel_type': 'Petrol Hybrid',
'id': '7a724415-8d27-5f78-8ac0-317c07b747c7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060470605',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'Haval Jolion Pro',
'odometer': 10,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/1487f8cb35464337a0009b863b7a308a.jpg',
'https://m.atcdn.co.uk/a/media/658218e7eb99480e9cb24723a40dd60f.jpg',
'https://m.atcdn.co.uk/a/media/2e372a456bba41d2b842226417db55b1.jpg',
'https://m.atcdn.co.uk/a/media/d76970bcb38c441f989e72b3db4ca1e0.jpg',
'https://m.atcdn.co.uk/a/media/42e33f49da7a49d2b1f3965fbf1ed077.jpg',
'https://m.atcdn.co.uk/a/media/6de1b75c36b24fffb19ba23daf024e24.jpg',
'https://m.atcdn.co.uk/a/media/a8cacac864d84ff3975aaee99a0e89a9.jpg',
'https://m.atcdn.co.uk/a/media/480c70ed84354b1d8272f1ac20fc527d.jpg',
'https://m.atcdn.co.uk/a/media/a8253125095946679ad5cfeb2367c5f1.jpg',
'https://m.atcdn.co.uk/a/media/409d1c99e57744dcb3a03e6fc4cb54e8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215722,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1487f8cb35464337a0009b863b7a308a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170090,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/658218e7eb99480e9cb24723a40dd60f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144948,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e372a456bba41d2b842226417db55b1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184272,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d76970bcb38c441f989e72b3db4ca1e0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197141,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/42e33f49da7a49d2b1f3965fbf1ed077.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195558,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6de1b75c36b24fffb19ba23daf024e24.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164822,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a8cacac864d84ff3975aaee99a0e89a9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172977,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/480c70ed84354b1d8272f1ac20fc527d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153841,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a8253125095946679ad5cfeb2367c5f1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a724415-8d27-5f78-8ac0-317c07b747c7/7a724415-8d27-5f78-8ac0-317c07b747c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202464,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/409d1c99e57744dcb3a03e6fc4cb54e8.jpg',
'Width': 1280}],
'price': 23995,
'price_includes_vat': True,
'registration_date': '2026-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'GWM Haval Jolion Pro 1.5 Lux SUV 5dr Petrol Hybrid DHT Euro 6 (s/s) '
'(189 ps)',
'transmission': 'automatic',
'trim': 'Lux',
'year': 2026}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060470605%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060470605: {'created_time': 1774883289.167931, 'last_price_update_time': 1774883289.167941}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060470605') HTTP/1.1" 204 0
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: dae6d9f9-ac7d-540f-8c98-6a298a22df40 with identifier: 202603210885894
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dae6d9f9-ac7d-540f-8c98-6a298a22df40
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e33e2487fa442b9a02a76e82c374e7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e33e2487fa442b9a02a76e82c374e7f.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d440b2b89144a65928cc73d74a91287.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d440b2b89144a65928cc73d74a91287.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fef2b2c639c33438da55ae5dd0431b486.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ef2b2c639c33438da55ae5dd0431b486.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5dbf60b9adfa4866be0c45d0f2fc5151.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5dbf60b9adfa4866be0c45d0f2fc5151.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1724d7b3a1d44a8a957f80184953c5fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1724d7b3a1d44a8a957f80184953c5fd.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F602d7cd48fb943b6ba1f35f8e2208431.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/602d7cd48fb943b6ba1f35f8e2208431.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa83863f5a71945a285dd01c5b5defc44.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a83863f5a71945a285dd01c5b5defc44.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb14809aa3ba44d58a0fee0188ef84ebc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b14809aa3ba44d58a0fee0188ef84ebc.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F58fa2999042f4ef497831a86b7c28184.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/58fa2999042f4ef497831a86b7c28184.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc2b45bfc3a074de8b2a335d5ba6dc71a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c2b45bfc3a074de8b2a335d5ba6dc71a.jpg already downloaded
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f3ff8b3-220d-5343-82c7-d2a87c5f08ad with identifier: 202603050427656
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f3ff8b3-220d-5343-82c7-d2a87c5f08ad
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38428e1ff09342738475f6ec7208b3bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38428e1ff09342738475f6ec7208b3bc.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe89e095bcf1647d987650bb420647f6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e89e095bcf1647d987650bb420647f6e.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5fc2f2bb13634c75a14af1a52dc38d73.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5fc2f2bb13634c75a14af1a52dc38d73.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97c7393f589d40a89ff10fa03f3a0210.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97c7393f589d40a89ff10fa03f3a0210.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F35b033d939384efc93d2b565ecb7c1dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/35b033d939384efc93d2b565ecb7c1dd.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55c4055948894268aa00ec693c81066f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55c4055948894268aa00ec693c81066f.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38f9d782298b46a3b77566ae6386d55b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38f9d782298b46a3b77566ae6386d55b.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F61ef65bf9f31443b8363c9c58b66d330.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/61ef65bf9f31443b8363c9c58b66d330.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F56c427988f6a44b28a74608cb74955ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/56c427988f6a44b28a74608cb74955ca.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad9e00cfef06411b99f319e2500994d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad9e00cfef06411b99f319e2500994d2.jpg already downloaded
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dabfa3d-3bae-5f91-8b1a-a3788dbda43d with identifier: 202602139905163
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dabfa3d-3bae-5f91-8b1a-a3788dbda43d
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9dd71eebf17943f39a12c7dfd34dd22a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9dd71eebf17943f39a12c7dfd34dd22a.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77469127ebab435d8643f4757b86998f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77469127ebab435d8643f4757b86998f.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9028114275164319b8fcba9b6fbc54f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9028114275164319b8fcba9b6fbc54f3.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F450d25cb43a0477b8f3a432d621ec1a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/450d25cb43a0477b8f3a432d621ec1a7.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98021af985474e4b8641424fefb09d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98021af985474e4b8641424fefb09d44.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f1a48dc007d4dd09d42051c07754c41.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f1a48dc007d4dd09d42051c07754c41.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F716860ff3e1345a984f105baf1eddf90.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/716860ff3e1345a984f105baf1eddf90.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F912926b2ae524983a0ebf75c31caed46.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/912926b2ae524983a0ebf75c31caed46.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fee79838a8a2a470dbfdce1305cbf1744.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ee79838a8a2a470dbfdce1305cbf1744.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fba5b06026b5547b18289afdd508e2014.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ba5b06026b5547b18289afdd508e2014.jpg already downloaded
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: dae6d9f9-ac7d-540f-8c98-6a298a22df40 with identifier 202603210885894
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item dae6d9f9-ac7d-540f-8c98-6a298a22df40
2026-03-30 15:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'Red',
'currency': 'GBP',
'description': 'AWAITI PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': 'dae6d9f9-ac7d-540f-8c98-6a298a22df40',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210885894',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Forester',
'odometer': 96176,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9e33e2487fa442b9a02a76e82c374e7f.jpg',
'https://m.atcdn.co.uk/a/media/9d440b2b89144a65928cc73d74a91287.jpg',
'https://m.atcdn.co.uk/a/media/ef2b2c639c33438da55ae5dd0431b486.jpg',
'https://m.atcdn.co.uk/a/media/5dbf60b9adfa4866be0c45d0f2fc5151.jpg',
'https://m.atcdn.co.uk/a/media/1724d7b3a1d44a8a957f80184953c5fd.jpg',
'https://m.atcdn.co.uk/a/media/602d7cd48fb943b6ba1f35f8e2208431.jpg',
'https://m.atcdn.co.uk/a/media/a83863f5a71945a285dd01c5b5defc44.jpg',
'https://m.atcdn.co.uk/a/media/b14809aa3ba44d58a0fee0188ef84ebc.jpg',
'https://m.atcdn.co.uk/a/media/58fa2999042f4ef497831a86b7c28184.jpg',
'https://m.atcdn.co.uk/a/media/c2b45bfc3a074de8b2a335d5ba6dc71a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182768,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e33e2487fa442b9a02a76e82c374e7f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134942,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d440b2b89144a65928cc73d74a91287.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163471,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ef2b2c639c33438da55ae5dd0431b486.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180750,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5dbf60b9adfa4866be0c45d0f2fc5151.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186656,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1724d7b3a1d44a8a957f80184953c5fd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197939,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/602d7cd48fb943b6ba1f35f8e2208431.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157786,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a83863f5a71945a285dd01c5b5defc44.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186948,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b14809aa3ba44d58a0fee0188ef84ebc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161207,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/58fa2999042f4ef497831a86b7c28184.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae6d9f9-ac7d-540f-8c98-6a298a22df40/dae6d9f9-ac7d-540f-8c98-6a298a22df40_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211218,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c2b45bfc3a074de8b2a335d5ba6dc71a.jpg',
'Width': 1280}],
'price': 9995,
'price_includes_vat': True,
'registration_date': '2016-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester 2.0i XE Premium SUV 5dr Petrol Lineartronic 4WD '
'Euro 6 (s/s) (150 ps)',
'transmission': 'automatic',
'trim': 'XE Premium',
'year': 2016}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210885894%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210885894: {'created_time': 1774883289.79994, 'last_price_update_time': 1774883289.79995}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210885894') HTTP/1.1" 204 0
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1f3ff8b3-220d-5343-82c7-d2a87c5f08ad with identifier 202603050427656
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1f3ff8b3-220d-5343-82c7-d2a87c5f08ad
2026-03-30 15:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2019 MINI Hatch Cooper S Exclusive offers an appealing '
'opportunity. Equipped with a 2.0L petrol engine and meeting '
'Euro 6 emission standards, this MINI Hatch combines '
'performance with environmental consciousness. The Cooper S '
'Exclusive trim adds a touch of luxury and convenience, with '
'features such as a panoramic glass sunroof, perfect for '
'enjoying sunny days, and the Navigation Pack, including Apple '
'CarPlay, ensuring you stay connected on the go. The Comfort '
'Plus Pack enhances your driving experience with climate '
'control and parking assistance, including front and rear '
'sensors and a rear camera, while heated seats provide extra '
'comfort. The Comfort Access System, featuring keyless entry, '
'adds a modern touch. Music lovers will appreciate the Harman '
'Kardon Hi-Fi system, delivering premium sound quality.\n'
'\n'
'The MINI Hatch Cooper S Exclusive stands out with its '
'impressive acceleration, reaching 0-62mph in just 6.7 '
'seconds, demonstrating its sporty capabilities. This feature '
'makes it quicker off the mark than many similar vehicles. The '
'combination of low mileage, comprehensive features, and '
'efficient engine makes this MINI Hatch a compelling choice '
'for those seeking a well-equipped and enjoyable driving '
'experience.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 189,
'fuel_type': 'Petrol',
'id': '1f3ff8b3-220d-5343-82c7-d2a87c5f08ad',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050427656',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'MINI',
'model': 'Hatch',
'odometer': 29075,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photo_urls': ['https://m.atcdn.co.uk/a/media/38428e1ff09342738475f6ec7208b3bc.jpg',
'https://m.atcdn.co.uk/a/media/e89e095bcf1647d987650bb420647f6e.jpg',
'https://m.atcdn.co.uk/a/media/5fc2f2bb13634c75a14af1a52dc38d73.jpg',
'https://m.atcdn.co.uk/a/media/97c7393f589d40a89ff10fa03f3a0210.jpg',
'https://m.atcdn.co.uk/a/media/35b033d939384efc93d2b565ecb7c1dd.jpg',
'https://m.atcdn.co.uk/a/media/55c4055948894268aa00ec693c81066f.jpg',
'https://m.atcdn.co.uk/a/media/38f9d782298b46a3b77566ae6386d55b.jpg',
'https://m.atcdn.co.uk/a/media/61ef65bf9f31443b8363c9c58b66d330.jpg',
'https://m.atcdn.co.uk/a/media/56c427988f6a44b28a74608cb74955ca.jpg',
'https://m.atcdn.co.uk/a/media/ad9e00cfef06411b99f319e2500994d2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204833,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/38428e1ff09342738475f6ec7208b3bc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154837,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e89e095bcf1647d987650bb420647f6e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153377,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5fc2f2bb13634c75a14af1a52dc38d73.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193105,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/97c7393f589d40a89ff10fa03f3a0210.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192350,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/35b033d939384efc93d2b565ecb7c1dd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197917,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55c4055948894268aa00ec693c81066f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171155,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/38f9d782298b46a3b77566ae6386d55b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216274,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/61ef65bf9f31443b8363c9c58b66d330.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168523,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/56c427988f6a44b28a74608cb74955ca.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f3ff8b3-220d-5343-82c7-d2a87c5f08ad/1f3ff8b3-220d-5343-82c7-d2a87c5f08ad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185676,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad9e00cfef06411b99f319e2500994d2.jpg',
'Width': 1280}],
'price': 16995,
'price_includes_vat': True,
'registration_date': '2019-11-25',
'seats_number': 4,
'seller_name': None,
'title': 'MINI Hatch 2.0 Cooper S Exclusive Hatchback 3dr Petrol Steptronic '
'Euro 6 (s/s) (192 ps)',
'transmission': 'automatic',
'trim': 'Cooper S Exclusive',
'year': 2019}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050427656%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050427656: {'created_time': 1774883289.856528, 'last_price_update_time': 1774883289.856537}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050427656') HTTP/1.1" 204 0
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7dabfa3d-3bae-5f91-8b1a-a3788dbda43d with identifier 202602139905163
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7dabfa3d-3bae-5f91-8b1a-a3788dbda43d
2026-03-30 15:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'White',
'currency': 'GBP',
'description': 'This 2023 SEAT Arona TSI XPERIENCE Lux boasts exceptionally '
'low mileage for its age. This Euro 6 compliant 1.0 litre '
'petrol model comes with a service history. The XPERIENCE Lux '
'trim level is well equipped, featuring full LED automatic '
'headlights for enhanced visibility, and both front and rear '
"parking sensors to assist with manoeuvring. Inside, you'll "
'appreciate the convenience of a wireless phone charger and '
'dual zone climate control, ensuring a comfortable environment '
'for all occupants.\n'
'\n'
'The SEAT Arona TSI XPERIENCE Lux stands out with its '
'impressive fuel economy, achieving a highlight of 51 miles '
'per gallon, which indicates it is more economical than many '
'similar vehicles. Furthermore, its low CO2 emissions also '
'position it favourably against other cars in its class. This '
'combination of efficiency and modern features makes it a '
'sensible and well appointed choice for everyday driving.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 108,
'fuel_type': 'Petrol',
'id': '7dabfa3d-3bae-5f91-8b1a-a3788dbda43d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602139905163',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'SEAT',
'model': 'Arona',
'odometer': 11393,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9dd71eebf17943f39a12c7dfd34dd22a.jpg',
'https://m.atcdn.co.uk/a/media/77469127ebab435d8643f4757b86998f.jpg',
'https://m.atcdn.co.uk/a/media/9028114275164319b8fcba9b6fbc54f3.jpg',
'https://m.atcdn.co.uk/a/media/450d25cb43a0477b8f3a432d621ec1a7.jpg',
'https://m.atcdn.co.uk/a/media/98021af985474e4b8641424fefb09d44.jpg',
'https://m.atcdn.co.uk/a/media/5f1a48dc007d4dd09d42051c07754c41.jpg',
'https://m.atcdn.co.uk/a/media/716860ff3e1345a984f105baf1eddf90.jpg',
'https://m.atcdn.co.uk/a/media/912926b2ae524983a0ebf75c31caed46.jpg',
'https://m.atcdn.co.uk/a/media/ee79838a8a2a470dbfdce1305cbf1744.jpg',
'https://m.atcdn.co.uk/a/media/ba5b06026b5547b18289afdd508e2014.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225841,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9dd71eebf17943f39a12c7dfd34dd22a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146300,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/77469127ebab435d8643f4757b86998f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142225,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9028114275164319b8fcba9b6fbc54f3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200176,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/450d25cb43a0477b8f3a432d621ec1a7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192684,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98021af985474e4b8641424fefb09d44.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196107,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f1a48dc007d4dd09d42051c07754c41.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153509,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/716860ff3e1345a984f105baf1eddf90.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195609,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/912926b2ae524983a0ebf75c31caed46.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182216,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee79838a8a2a470dbfdce1305cbf1744.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dabfa3d-3bae-5f91-8b1a-a3788dbda43d/7dabfa3d-3bae-5f91-8b1a-a3788dbda43d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226276,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ba5b06026b5547b18289afdd508e2014.jpg',
'Width': 1280}],
'price': 16495,
'price_includes_vat': True,
'registration_date': '2023-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT Arona 1.0 TSI XPERIENCE Lux SUV 5dr Petrol Manual Euro 6 (s/s) '
'(110 ps)',
'transmission': 'manual',
'trim': 'XPERIENCE Lux',
'year': 2023}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602139905163%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602139905163: {'created_time': 1774883289.914912, 'last_price_update_time': 1774883289.914925}
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602139905163') HTTP/1.1" 204 0
2026-03-30 15:08:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fe1183dc-bf01-5282-8bc9-013c588e1899 with identifier: 202603210885768
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe1183dc-bf01-5282-8bc9-013c588e1899
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F04b5091173d04059918d2de04bde05de.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/04b5091173d04059918d2de04bde05de.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5b6cd4a8f64c462b9f14409fcec4fa6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5b6cd4a8f64c462b9f14409fcec4fa6a.jpg already downloaded
2026-03-30 15:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2bd3a24197bd42029cbe178ec33f9218.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2bd3a24197bd42029cbe178ec33f9218.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8161e98fe51d410e9f3aa61119ef0e4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8161e98fe51d410e9f3aa61119ef0e4a.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc65ffeba6bed4da59b4be7b3d708b1d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c65ffeba6bed4da59b4be7b3d708b1d0.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe405b7d727cc4b93ae939efc9263162f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e405b7d727cc4b93ae939efc9263162f.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0498bfacb52745c586b4efd9accec1fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0498bfacb52745c586b4efd9accec1fe.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F99b6a0ba9b8946f9bacdd50f67c1988f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/99b6a0ba9b8946f9bacdd50f67c1988f.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb34405aefd5d43f38240993d02176e10.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b34405aefd5d43f38240993d02176e10.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbba0f01cd8434490b3e41b03cd2d0091.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bba0f01cd8434490b3e41b03cd2d0091.jpg already downloaded
2026-03-30 15:08:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 19877060-7bf5-564f-8787-45fb35bf8505 with identifier: 202603050427561
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19877060-7bf5-564f-8787-45fb35bf8505
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1befe05ec2d04b4c8fde575f00165c03.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1befe05ec2d04b4c8fde575f00165c03.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdfa588693e244bd3a38bbe7046e5c415.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dfa588693e244bd3a38bbe7046e5c415.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0468110462243d5916bc7099a18730c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0468110462243d5916bc7099a18730c.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F74091bcfe4184b76866be95c8bdcc743.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/74091bcfe4184b76866be95c8bdcc743.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd92bcd171511401fa995f3b1a8b63bc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d92bcd171511401fa995f3b1a8b63bc7.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F58972abafdf6465fa0188092c5d6277a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/58972abafdf6465fa0188092c5d6277a.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b492766bcde47fd8d027ff855b3c4b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b492766bcde47fd8d027ff855b3c4b2.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd283a033770e4fee95b982d181f9a531.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d283a033770e4fee95b982d181f9a531.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff75482974d0449ddb7a03115179f545c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f75482974d0449ddb7a03115179f545c.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3efa0d55a040450093920864acdb5980.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3efa0d55a040450093920864acdb5980.jpg already downloaded
2026-03-30 15:08:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 49fb88ad-241e-509b-b18f-d3976bcb1a5f with identifier: 202602129884963
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49fb88ad-241e-509b-b18f-d3976bcb1a5f
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feba71c2c18644dfc8f52082f85efcc71.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eba71c2c18644dfc8f52082f85efcc71.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa7f852d2d66f4f81ba470976ce9e279f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a7f852d2d66f4f81ba470976ce9e279f.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dc371739e2747689e1c1b51701dd258.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dc371739e2747689e1c1b51701dd258.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc35278888b564b36aaef3dd1c5bb04f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c35278888b564b36aaef3dd1c5bb04f9.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97482af56b074843b49cf4babed59d1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97482af56b074843b49cf4babed59d1e.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5bf39a5d11ad4d62b25db04635cf9bcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5bf39a5d11ad4d62b25db04635cf9bcc.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49f69ba9926940a18788a6e36b7a1d5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49f69ba9926940a18788a6e36b7a1d5e.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0703e87cb85e429b8c169c7aa2df4b21.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0703e87cb85e429b8c169c7aa2df4b21.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c383f92b9074deeb70060b8b396d7ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c383f92b9074deeb70060b8b396d7ce.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F907cc5f8f2854b50b0392ed35eef73a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/907cc5f8f2854b50b0392ed35eef73a5.jpg already downloaded
2026-03-30 15:08:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fe1183dc-bf01-5282-8bc9-013c588e1899 with identifier 202603210885768
2026-03-30 15:08:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fe1183dc-bf01-5282-8bc9-013c588e1899
2026-03-30 15:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Blue',
'currency': 'GBP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 186,
'fuel_type': 'Petrol Hybrid',
'id': 'fe1183dc-bf01-5282-8bc9-013c588e1899',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210885768',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'Haval Jolion Pro',
'odometer': 10,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/04b5091173d04059918d2de04bde05de.jpg',
'https://m.atcdn.co.uk/a/media/5b6cd4a8f64c462b9f14409fcec4fa6a.jpg',
'https://m.atcdn.co.uk/a/media/2bd3a24197bd42029cbe178ec33f9218.jpg',
'https://m.atcdn.co.uk/a/media/8161e98fe51d410e9f3aa61119ef0e4a.jpg',
'https://m.atcdn.co.uk/a/media/c65ffeba6bed4da59b4be7b3d708b1d0.jpg',
'https://m.atcdn.co.uk/a/media/e405b7d727cc4b93ae939efc9263162f.jpg',
'https://m.atcdn.co.uk/a/media/0498bfacb52745c586b4efd9accec1fe.jpg',
'https://m.atcdn.co.uk/a/media/99b6a0ba9b8946f9bacdd50f67c1988f.jpg',
'https://m.atcdn.co.uk/a/media/b34405aefd5d43f38240993d02176e10.jpg',
'https://m.atcdn.co.uk/a/media/bba0f01cd8434490b3e41b03cd2d0091.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226752,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/04b5091173d04059918d2de04bde05de.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126093,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5b6cd4a8f64c462b9f14409fcec4fa6a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151265,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2bd3a24197bd42029cbe178ec33f9218.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194893,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8161e98fe51d410e9f3aa61119ef0e4a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206304,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c65ffeba6bed4da59b4be7b3d708b1d0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199656,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e405b7d727cc4b93ae939efc9263162f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147705,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0498bfacb52745c586b4efd9accec1fe.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205331,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/99b6a0ba9b8946f9bacdd50f67c1988f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170283,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b34405aefd5d43f38240993d02176e10.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe1183dc-bf01-5282-8bc9-013c588e1899/fe1183dc-bf01-5282-8bc9-013c588e1899_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213318,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bba0f01cd8434490b3e41b03cd2d0091.jpg',
'Width': 1280}],
'price': 24995,
'price_includes_vat': True,
'registration_date': '2026-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'GWM Haval Jolion Pro 1.5 Ultra SUV 5dr Petrol Hybrid DHT Euro 6 '
'(s/s) (189 ps)',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2026}
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210885768%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210885768: {'created_time': 1774883290.610007, 'last_price_update_time': 1774883290.610016}
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210885768') HTTP/1.1" 204 0
2026-03-30 15:08:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 19877060-7bf5-564f-8787-45fb35bf8505 with identifier 202603050427561
2026-03-30 15:08:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 19877060-7bf5-564f-8787-45fb35bf8505
2026-03-30 15:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 223,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2023 Land Rover Discovery D300 R Dynamic HSE presents '
'exceptional provenance. This four wheel drive, Euro 6 '
'compliant Discovery boasts a powerful 3.0 litre diesel '
'engine, capable of accelerating from 0 to 60mph in just 6.5 '
'seconds. With seating for seven, it offers ample space for '
'families and adventurers alike. Notable features include '
'Android Auto and Apple CarPlay for seamless smartphone '
'integration, keyless entry for convenience, and two zone '
'climate control to ensure comfort for all occupants. The 60 '
'40 heated electric folding rear seats with manual slide and '
'powered recline centre headrest and armrest add further '
'versatility and comfort.\n'
'\n'
'This Discovery has impressive towing weight of 3500 kg means '
"this vehicle is ready for any challenge, whether it's hauling "
'a caravan or a trailer. These factors, combined with its '
'advanced features and robust performance, demonstrate how '
'this Land Rover Discovery stands out from other vehicles in '
'its class, offering a superior blend of capability, comfort, '
'and technology.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '3L',
'engine_horse_power': 296,
'fuel_type': 'Diesel',
'id': '19877060-7bf5-564f-8787-45fb35bf8505',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050427561',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 24400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photo_urls': ['https://m.atcdn.co.uk/a/media/1befe05ec2d04b4c8fde575f00165c03.jpg',
'https://m.atcdn.co.uk/a/media/dfa588693e244bd3a38bbe7046e5c415.jpg',
'https://m.atcdn.co.uk/a/media/b0468110462243d5916bc7099a18730c.jpg',
'https://m.atcdn.co.uk/a/media/74091bcfe4184b76866be95c8bdcc743.jpg',
'https://m.atcdn.co.uk/a/media/d92bcd171511401fa995f3b1a8b63bc7.jpg',
'https://m.atcdn.co.uk/a/media/58972abafdf6465fa0188092c5d6277a.jpg',
'https://m.atcdn.co.uk/a/media/2b492766bcde47fd8d027ff855b3c4b2.jpg',
'https://m.atcdn.co.uk/a/media/d283a033770e4fee95b982d181f9a531.jpg',
'https://m.atcdn.co.uk/a/media/f75482974d0449ddb7a03115179f545c.jpg',
'https://m.atcdn.co.uk/a/media/3efa0d55a040450093920864acdb5980.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204686,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1befe05ec2d04b4c8fde575f00165c03.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169019,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dfa588693e244bd3a38bbe7046e5c415.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158733,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0468110462243d5916bc7099a18730c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190606,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/74091bcfe4184b76866be95c8bdcc743.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203514,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d92bcd171511401fa995f3b1a8b63bc7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198128,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/58972abafdf6465fa0188092c5d6277a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202280,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b492766bcde47fd8d027ff855b3c4b2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138379,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d283a033770e4fee95b982d181f9a531.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206177,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f75482974d0449ddb7a03115179f545c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19877060-7bf5-564f-8787-45fb35bf8505/19877060-7bf5-564f-8787-45fb35bf8505_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216671,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3efa0d55a040450093920864acdb5980.jpg',
'Width': 1280}],
'price': 49995,
'price_includes_vat': True,
'registration_date': '2023-03-30',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery 3.0 D300 MHEV R-Dynamic HSE SUV 5dr Diesel '
'Auto 4WD Euro 6 (s/s) (300 ps)',
'transmission': 'automatic',
'trim': 'R-Dynamic HSE',
'year': 2023}
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050427561%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050427561: {'created_time': 1774883290.658059, 'last_price_update_time': 1774883290.658068}
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050427561') HTTP/1.1" 204 0
2026-03-30 15:08:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 49fb88ad-241e-509b-b18f-d3976bcb1a5f with identifier 202602129884963
2026-03-30 15:08:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 49fb88ad-241e-509b-b18f-d3976bcb1a5f
2026-03-30 15:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'Black',
'currency': 'GBP',
'description': 'this Ford Galaxy TDCi Zetec presents a remarkable find. This '
'seven seater, Euro 6 compliant vehicle is powered by an '
"efficient 2.0L diesel engine. Inside, you'll appreciate the "
'Dual Zone Electronic Automatic Temperature Control for '
'personalised comfort, along with front and rear parking '
'sensors to assist with manoeuvring. The SYNC 3 system, '
'featuring an 8in colour touchscreen, Bluetooth connectivity, '
'and voice control, ensures you stay connected and entertained '
'on every journey.\n'
'\n'
'This Ford Galaxy Zetec stands out due to its combination of '
'practical features and excellent condition. The inclusion of '
'both front and rear parking sensors, alongside the advanced '
'SYNC 3 system with emergency assistance, demonstrates a '
'higher level of convenience and safety compared to many other '
'vehicles. The dual zone climate control further enhances '
'passenger comfort, making it an ideal choice for families or '
'anyone needing versatile and comfortable transport. Its low '
'mileage and single owner provenance suggest it has been well '
'cared for, making it a compelling option for those seeking a '
'reliable and spacious MPV.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 118,
'fuel_type': 'Diesel',
'id': '49fb88ad-241e-509b-b18f-d3976bcb1a5f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602129884963',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 39177,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/eba71c2c18644dfc8f52082f85efcc71.jpg',
'https://m.atcdn.co.uk/a/media/a7f852d2d66f4f81ba470976ce9e279f.jpg',
'https://m.atcdn.co.uk/a/media/0dc371739e2747689e1c1b51701dd258.jpg',
'https://m.atcdn.co.uk/a/media/c35278888b564b36aaef3dd1c5bb04f9.jpg',
'https://m.atcdn.co.uk/a/media/97482af56b074843b49cf4babed59d1e.jpg',
'https://m.atcdn.co.uk/a/media/5bf39a5d11ad4d62b25db04635cf9bcc.jpg',
'https://m.atcdn.co.uk/a/media/49f69ba9926940a18788a6e36b7a1d5e.jpg',
'https://m.atcdn.co.uk/a/media/0703e87cb85e429b8c169c7aa2df4b21.jpg',
'https://m.atcdn.co.uk/a/media/2c383f92b9074deeb70060b8b396d7ce.jpg',
'https://m.atcdn.co.uk/a/media/907cc5f8f2854b50b0392ed35eef73a5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232828,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eba71c2c18644dfc8f52082f85efcc71.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127518,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a7f852d2d66f4f81ba470976ce9e279f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156212,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dc371739e2747689e1c1b51701dd258.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195631,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c35278888b564b36aaef3dd1c5bb04f9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203528,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/97482af56b074843b49cf4babed59d1e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195757,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5bf39a5d11ad4d62b25db04635cf9bcc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157050,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/49f69ba9926940a18788a6e36b7a1d5e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194431,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0703e87cb85e429b8c169c7aa2df4b21.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192534,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c383f92b9074deeb70060b8b396d7ce.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49fb88ad-241e-509b-b18f-d3976bcb1a5f/49fb88ad-241e-509b-b18f-d3976bcb1a5f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230276,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/907cc5f8f2854b50b0392ed35eef73a5.jpg',
'Width': 1280}],
'price': 14995,
'price_includes_vat': True,
'registration_date': '2018-08-13',
'seats_number': 7,
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi Zetec MPV 5dr Diesel Manual Euro 6 (120 ps)',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2018}
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129884963%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602129884963: {'created_time': 1774883290.710267, 'last_price_update_time': 1774883290.710277}
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602129884963') HTTP/1.1" 204 0
2026-03-30 15:08:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 462df1b4-82fa-5552-bd37-2c00ebcae625 with identifier: 202603190827038
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 462df1b4-82fa-5552-bd37-2c00ebcae625
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F657b19c2c34649259c81c03b87ed2e4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/657b19c2c34649259c81c03b87ed2e4c.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5a99e79c86f14a2b85c5f37138a140cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5a99e79c86f14a2b85c5f37138a140cd.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb2b4f98c3604b009d28fe11fb79046b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb2b4f98c3604b009d28fe11fb79046b.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe6b06594b0ad4cf1bf9f076dec7dea0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e6b06594b0ad4cf1bf9f076dec7dea0f.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0f89db1dd4543af9aa955f14ae1b97f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0f89db1dd4543af9aa955f14ae1b97f.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F977bb8df43614ada83c95b03c2cf1418.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/977bb8df43614ada83c95b03c2cf1418.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb3a255969d164109853a8037d4bcbc1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b3a255969d164109853a8037d4bcbc1a.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7a9e2b396c34368946e8d997ef27bbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7a9e2b396c34368946e8d997ef27bbf.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5d18ddec8de49339270be38fe14b6a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5d18ddec8de49339270be38fe14b6a0.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f81b57779ff44fc84f1600eb18cbcd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f81b57779ff44fc84f1600eb18cbcd4.jpg already downloaded
2026-03-30 15:08:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a9295f44-fabf-5858-a7eb-086813496c07 with identifier: 202602200090204
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9295f44-fabf-5858-a7eb-086813496c07
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7fd59aa7543546ed8c7191d729ad1d5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7fd59aa7543546ed8c7191d729ad1d5b.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff14eef7ccb7644518d076dd4f8d277cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f14eef7ccb7644518d076dd4f8d277cb.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F846635bbfe26416c9cac1d7834018f54.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/846635bbfe26416c9cac1d7834018f54.jpg already downloaded
2026-03-30 15:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85774b92546f4eb58f729176a95d2d33.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85774b92546f4eb58f729176a95d2d33.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F830cb9132ad8473cb623425dd03c84c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/830cb9132ad8473cb623425dd03c84c3.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa1efd6dfe630404a86794eec25a81382.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a1efd6dfe630404a86794eec25a81382.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F770f10333d7b431983000f9972bd408a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/770f10333d7b431983000f9972bd408a.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F35948da78229410abd892a317d05b657.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/35948da78229410abd892a317d05b657.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa7f2f56ebcd04a058b9e85f379405a06.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a7f2f56ebcd04a058b9e85f379405a06.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F332cf07136da47a78507c115fa55b749.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/332cf07136da47a78507c115fa55b749.jpg already downloaded
2026-03-30 15:08:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 29049598-ef25-5ef1-9b54-9eb952e0a6db with identifier: 202602119849664
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29049598-ef25-5ef1-9b54-9eb952e0a6db
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F108a361aa39147b9835b70ce1e8f1f3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/108a361aa39147b9835b70ce1e8f1f3b.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F65dd606c445d4495b3c95439cdfbfb6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/65dd606c445d4495b3c95439cdfbfb6a.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F757e12c26e36408a81a40305a1ca9db2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/757e12c26e36408a81a40305a1ca9db2.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F786185ac4356422b9f77c991ed285997.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/786185ac4356422b9f77c991ed285997.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fce70e940097b4f30aa2194e9d07d4dc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ce70e940097b4f30aa2194e9d07d4dc8.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffd8e402451d247a4b49074d9c16c8ba0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fd8e402451d247a4b49074d9c16c8ba0.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf333aee99f84053bc2846430be5aa75.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf333aee99f84053bc2846430be5aa75.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c41f13fc99d4c86a961b188f7a45358.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c41f13fc99d4c86a961b188f7a45358.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7d93d399c227404094b129be8159be1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7d93d399c227404094b129be8159be1a.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F526e61d5d3824cb48ec1c8d3f882f469.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/526e61d5d3824cb48ec1c8d3f882f469.jpg already downloaded
2026-03-30 15:08:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 462df1b4-82fa-5552-bd37-2c00ebcae625 with identifier 202603190827038
2026-03-30 15:08:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 462df1b4-82fa-5552-bd37-2c00ebcae625
2026-03-30 15:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 183,
'color': 'Grey',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 247,
'fuel_type': 'Petrol',
'id': '462df1b4-82fa-5552-bd37-2c00ebcae625',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190827038',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Jaguar',
'model': 'XE',
'odometer': 6554,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/657b19c2c34649259c81c03b87ed2e4c.jpg',
'https://m.atcdn.co.uk/a/media/5a99e79c86f14a2b85c5f37138a140cd.jpg',
'https://m.atcdn.co.uk/a/media/eb2b4f98c3604b009d28fe11fb79046b.jpg',
'https://m.atcdn.co.uk/a/media/e6b06594b0ad4cf1bf9f076dec7dea0f.jpg',
'https://m.atcdn.co.uk/a/media/c0f89db1dd4543af9aa955f14ae1b97f.jpg',
'https://m.atcdn.co.uk/a/media/977bb8df43614ada83c95b03c2cf1418.jpg',
'https://m.atcdn.co.uk/a/media/b3a255969d164109853a8037d4bcbc1a.jpg',
'https://m.atcdn.co.uk/a/media/b7a9e2b396c34368946e8d997ef27bbf.jpg',
'https://m.atcdn.co.uk/a/media/c5d18ddec8de49339270be38fe14b6a0.jpg',
'https://m.atcdn.co.uk/a/media/3f81b57779ff44fc84f1600eb18cbcd4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198307,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/657b19c2c34649259c81c03b87ed2e4c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128492,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5a99e79c86f14a2b85c5f37138a140cd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147700,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eb2b4f98c3604b009d28fe11fb79046b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189628,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e6b06594b0ad4cf1bf9f076dec7dea0f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189639,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c0f89db1dd4543af9aa955f14ae1b97f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193483,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/977bb8df43614ada83c95b03c2cf1418.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144059,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b3a255969d164109853a8037d4bcbc1a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181881,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7a9e2b396c34368946e8d997ef27bbf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164203,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c5d18ddec8de49339270be38fe14b6a0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_462df1b4-82fa-5552-bd37-2c00ebcae625/462df1b4-82fa-5552-bd37-2c00ebcae625_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212541,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f81b57779ff44fc84f1600eb18cbcd4.jpg',
'Width': 1280}],
'price': 29795,
'price_includes_vat': True,
'registration_date': '2023-07-24',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar XE 2.0 P250i R-Dynamic HSE Black Saloon 4dr Petrol Auto Euro '
'6 (s/s) (250 ps)',
'transmission': 'automatic',
'trim': 'R-Dynamic HSE Black',
'year': 2023}
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190827038%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190827038: {'created_time': 1774883291.378795, 'last_price_update_time': 1774883291.37881}
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190827038') HTTP/1.1" 204 0
2026-03-30 15:08:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a9295f44-fabf-5858-a7eb-086813496c07 with identifier 202602200090204
2026-03-30 15:08:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a9295f44-fabf-5858-a7eb-086813496c07
2026-03-30 15:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Grey',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': 'a9295f44-fabf-5858-a7eb-086813496c07',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200090204',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 47467,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/7fd59aa7543546ed8c7191d729ad1d5b.jpg',
'https://m.atcdn.co.uk/a/media/f14eef7ccb7644518d076dd4f8d277cb.jpg',
'https://m.atcdn.co.uk/a/media/846635bbfe26416c9cac1d7834018f54.jpg',
'https://m.atcdn.co.uk/a/media/85774b92546f4eb58f729176a95d2d33.jpg',
'https://m.atcdn.co.uk/a/media/830cb9132ad8473cb623425dd03c84c3.jpg',
'https://m.atcdn.co.uk/a/media/a1efd6dfe630404a86794eec25a81382.jpg',
'https://m.atcdn.co.uk/a/media/770f10333d7b431983000f9972bd408a.jpg',
'https://m.atcdn.co.uk/a/media/35948da78229410abd892a317d05b657.jpg',
'https://m.atcdn.co.uk/a/media/a7f2f56ebcd04a058b9e85f379405a06.jpg',
'https://m.atcdn.co.uk/a/media/332cf07136da47a78507c115fa55b749.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189021,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7fd59aa7543546ed8c7191d729ad1d5b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128407,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f14eef7ccb7644518d076dd4f8d277cb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175995,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/846635bbfe26416c9cac1d7834018f54.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166989,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85774b92546f4eb58f729176a95d2d33.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169225,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/830cb9132ad8473cb623425dd03c84c3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174727,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a1efd6dfe630404a86794eec25a81382.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154534,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/770f10333d7b431983000f9972bd408a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152207,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/35948da78229410abd892a317d05b657.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196840,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a7f2f56ebcd04a058b9e85f379405a06.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295f44-fabf-5858-a7eb-086813496c07/a9295f44-fabf-5858-a7eb-086813496c07_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131742,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/332cf07136da47a78507c115fa55b749.jpg',
'Width': 1280}],
'price': 24995,
'price_includes_vat': True,
'registration_date': '2023-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback 2.5i Touring Estate 5dr Petrol Lineartronic 4WD Euro '
'6 (s/s) (169 ps)',
'transmission': 'automatic',
'trim': 'Touring',
'year': 2023}
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200090204%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200090204: {'created_time': 1774883291.453752, 'last_price_update_time': 1774883291.453764}
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200090204') HTTP/1.1" 204 0
2026-03-30 15:08:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 29049598-ef25-5ef1-9b54-9eb952e0a6db with identifier 202602119849664
2026-03-30 15:08:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 29049598-ef25-5ef1-9b54-9eb952e0a6db
2026-03-30 15:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 75,
'color': 'White',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 100,
'fuel_type': 'Petrol Hybrid',
'id': '29049598-ef25-5ef1-9b54-9eb952e0a6db',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602119849664',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 29904,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 15,
'photo_urls': ['https://m.atcdn.co.uk/a/media/108a361aa39147b9835b70ce1e8f1f3b.jpg',
'https://m.atcdn.co.uk/a/media/65dd606c445d4495b3c95439cdfbfb6a.jpg',
'https://m.atcdn.co.uk/a/media/757e12c26e36408a81a40305a1ca9db2.jpg',
'https://m.atcdn.co.uk/a/media/786185ac4356422b9f77c991ed285997.jpg',
'https://m.atcdn.co.uk/a/media/ce70e940097b4f30aa2194e9d07d4dc8.jpg',
'https://m.atcdn.co.uk/a/media/fd8e402451d247a4b49074d9c16c8ba0.jpg',
'https://m.atcdn.co.uk/a/media/cf333aee99f84053bc2846430be5aa75.jpg',
'https://m.atcdn.co.uk/a/media/2c41f13fc99d4c86a961b188f7a45358.jpg',
'https://m.atcdn.co.uk/a/media/7d93d399c227404094b129be8159be1a.jpg',
'https://m.atcdn.co.uk/a/media/526e61d5d3824cb48ec1c8d3f882f469.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262004,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/108a361aa39147b9835b70ce1e8f1f3b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231019,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/65dd606c445d4495b3c95439cdfbfb6a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265515,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/757e12c26e36408a81a40305a1ca9db2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219425,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/786185ac4356422b9f77c991ed285997.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268760,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ce70e940097b4f30aa2194e9d07d4dc8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242151,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fd8e402451d247a4b49074d9c16c8ba0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263532,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf333aee99f84053bc2846430be5aa75.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218743,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c41f13fc99d4c86a961b188f7a45358.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165759,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7d93d399c227404094b129be8159be1a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29049598-ef25-5ef1-9b54-9eb952e0a6db/29049598-ef25-5ef1-9b54-9eb952e0a6db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238865,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/526e61d5d3824cb48ec1c8d3f882f469.jpg',
'Width': 1280}],
'price': 10995,
'price_includes_vat': True,
'registration_date': '2015-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris VVT-h Icon Hatchback 1.5 Automatic Petrol Hybrid 5dr',
'transmission': 'automatic',
'trim': 'Icon',
'year': 2015}
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119849664%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602119849664: {'created_time': 1774883291.519062, 'last_price_update_time': 1774883291.519074}
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602119849664') HTTP/1.1" 204 0
2026-03-30 15:08:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d74996-1c0d-55f7-a757-2e8b7f8c87fb with identifier: 202602200089383
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2d74996-1c0d-55f7-a757-2e8b7f8c87fb
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F726a1eea6e2343e1bbffba130d874b16.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/726a1eea6e2343e1bbffba130d874b16.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b7d0bd200bb4ebfaca8694f661321c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b7d0bd200bb4ebfaca8694f661321c3.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F032f1418da194e5e9d5921793096ae56.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/032f1418da194e5e9d5921793096ae56.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F076a07b3411b4391996b81b84cffd091.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/076a07b3411b4391996b81b84cffd091.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffb81b443cc104cdd82633a4c4ded44eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fb81b443cc104cdd82633a4c4ded44eb.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf26e90897474f68ae3132515848c384.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf26e90897474f68ae3132515848c384.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F578fe28609ab47098c3243e3d67b5541.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/578fe28609ab47098c3243e3d67b5541.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa5eb055ecd084ea184aebedf3698c6df.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a5eb055ecd084ea184aebedf3698c6df.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff8a6da0d170c44ed88b531c21718eb12.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f8a6da0d170c44ed88b531c21718eb12.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F694ead8636fa44329258120354ecec97.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/694ead8636fa44329258120354ecec97.jpg already downloaded
2026-03-30 15:08:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716 with identifier: 202602049670779
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b3a5051bf814961aa6b3ee18d751c17.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b3a5051bf814961aa6b3ee18d751c17.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4353e686a7e84ccd9e0d5fdf2420519f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4353e686a7e84ccd9e0d5fdf2420519f.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F36e5b4cc45b24235970b369808eb5ed8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/36e5b4cc45b24235970b369808eb5ed8.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb01ef0665fc408fb7b7445b3bb05730.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb01ef0665fc408fb7b7445b3bb05730.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd630afc50745490ca102491f9bca8721.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d630afc50745490ca102491f9bca8721.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa4e1a1ca433d4b63879d4864da111948.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a4e1a1ca433d4b63879d4864da111948.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F533a710dcd2b4a6993ef79a768adebe3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/533a710dcd2b4a6993ef79a768adebe3.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe82ed515a1244746a4ea9f4bb9e207d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e82ed515a1244746a4ea9f4bb9e207d2.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2450d39c9f5c414bae82a4b195fb2353.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2450d39c9f5c414bae82a4b195fb2353.jpg already downloaded
2026-03-30 15:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F41520f68ca46485e9be8b8f2de187534.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/41520f68ca46485e9be8b8f2de187534.jpg already downloaded
2026-03-30 15:08:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b2d74996-1c0d-55f7-a757-2e8b7f8c87fb with identifier 202602200089383
2026-03-30 15:08:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b2d74996-1c0d-55f7-a757-2e8b7f8c87fb
2026-03-30 15:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'Red',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 226,
'fuel_type': 'Petrol Hybrid',
'id': 'b2d74996-1c0d-55f7-a757-2e8b7f8c87fb',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200089383',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Kia',
'model': 'Sportage',
'odometer': 6924,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/726a1eea6e2343e1bbffba130d874b16.jpg',
'https://m.atcdn.co.uk/a/media/2b7d0bd200bb4ebfaca8694f661321c3.jpg',
'https://m.atcdn.co.uk/a/media/032f1418da194e5e9d5921793096ae56.jpg',
'https://m.atcdn.co.uk/a/media/076a07b3411b4391996b81b84cffd091.jpg',
'https://m.atcdn.co.uk/a/media/fb81b443cc104cdd82633a4c4ded44eb.jpg',
'https://m.atcdn.co.uk/a/media/cf26e90897474f68ae3132515848c384.jpg',
'https://m.atcdn.co.uk/a/media/578fe28609ab47098c3243e3d67b5541.jpg',
'https://m.atcdn.co.uk/a/media/a5eb055ecd084ea184aebedf3698c6df.jpg',
'https://m.atcdn.co.uk/a/media/f8a6da0d170c44ed88b531c21718eb12.jpg',
'https://m.atcdn.co.uk/a/media/694ead8636fa44329258120354ecec97.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228029,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/726a1eea6e2343e1bbffba130d874b16.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111980,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b7d0bd200bb4ebfaca8694f661321c3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107877,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/032f1418da194e5e9d5921793096ae56.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198576,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/076a07b3411b4391996b81b84cffd091.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192611,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fb81b443cc104cdd82633a4c4ded44eb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209076,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf26e90897474f68ae3132515848c384.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159338,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/578fe28609ab47098c3243e3d67b5541.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176575,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a5eb055ecd084ea184aebedf3698c6df.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150284,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f8a6da0d170c44ed88b531c21718eb12.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2d74996-1c0d-55f7-a757-2e8b7f8c87fb/b2d74996-1c0d-55f7-a757-2e8b7f8c87fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205603,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/694ead8636fa44329258120354ecec97.jpg',
'Width': 1280}],
'price': 26895,
'price_includes_vat': True,
'registration_date': '2024-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'KIA Sportage 1.6 h T-GDi GT-Line SUV 5dr Petrol Hybrid Auto Euro 6 '
'(s/s) (226 bhp)',
'transmission': 'automatic',
'trim': 'GT-Line',
'year': 2024}
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200089383%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200089383: {'created_time': 1774883292.082995, 'last_price_update_time': 1774883292.083007}
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200089383') HTTP/1.1" 204 0
2026-03-30 15:08:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716 with identifier 202602049670779
2026-03-30 15:08:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716
2026-03-30 15:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 41,
'color': 'Red',
'currency': 'GBP',
'description': 'This 2022 MINI Countryman Cooper SE Sport boasts a full Mini '
'service history, ensuring its excellent provenance. This four '
'wheel drive plug in hybrid model features a 1.5 litre petrol '
'engine and meets Euro 6 emissions standards. It comes '
'equipped with a Comfort Plus Pack, including rear parking '
'sensors and heated seats, along with a Piano Black Exterior '
'Pack and striking 19 inch John Cooper Works Circuit Spoke '
'alloy wheels. The interior is finished in Dinamica leather in '
'Carbon Black, and the vehicle benefits from adaptive LED '
'headlights for enhanced visibility.\n'
'\n'
'The Cooper SE Sport variant offers a compelling blend of '
'efficiency and performance, setting it apart from other '
'vehicles in its class. The plug in hybrid technology provides '
'flexibility for both electric and petrol driving, while the '
'four wheel drive system ensures confident handling in various '
'conditions. The inclusion of the Comfort Plus Pack and Piano '
'Black Exterior Pack, alongside the premium Dinamica leather '
'upholstery and John Cooper Works wheels, elevates the driving '
'experience and the overall appeal of this well maintained '
'MINI Countryman.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 219,
'fuel_type': 'Petrol Plug-in Hybrid',
'id': '19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049670779',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'MINI',
'model': 'Countryman',
'odometer': 31899,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photo_urls': ['https://m.atcdn.co.uk/a/media/1b3a5051bf814961aa6b3ee18d751c17.jpg',
'https://m.atcdn.co.uk/a/media/4353e686a7e84ccd9e0d5fdf2420519f.jpg',
'https://m.atcdn.co.uk/a/media/36e5b4cc45b24235970b369808eb5ed8.jpg',
'https://m.atcdn.co.uk/a/media/eb01ef0665fc408fb7b7445b3bb05730.jpg',
'https://m.atcdn.co.uk/a/media/d630afc50745490ca102491f9bca8721.jpg',
'https://m.atcdn.co.uk/a/media/a4e1a1ca433d4b63879d4864da111948.jpg',
'https://m.atcdn.co.uk/a/media/533a710dcd2b4a6993ef79a768adebe3.jpg',
'https://m.atcdn.co.uk/a/media/e82ed515a1244746a4ea9f4bb9e207d2.jpg',
'https://m.atcdn.co.uk/a/media/2450d39c9f5c414bae82a4b195fb2353.jpg',
'https://m.atcdn.co.uk/a/media/41520f68ca46485e9be8b8f2de187534.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217804,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b3a5051bf814961aa6b3ee18d751c17.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98556,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4353e686a7e84ccd9e0d5fdf2420519f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108128,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/36e5b4cc45b24235970b369808eb5ed8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197639,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eb01ef0665fc408fb7b7445b3bb05730.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200306,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d630afc50745490ca102491f9bca8721.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201411,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a4e1a1ca433d4b63879d4864da111948.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170230,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/533a710dcd2b4a6993ef79a768adebe3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194044,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e82ed515a1244746a4ea9f4bb9e207d2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187502,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2450d39c9f5c414bae82a4b195fb2353.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716/19d1bbc3-3555-5e3c-84fa-9b4fb9ed1716_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242837,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/41520f68ca46485e9be8b8f2de187534.jpg',
'Width': 1280}],
'price': 23695,
'price_includes_vat': True,
'registration_date': '2022-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman 1.5 10kWh Cooper SE Sport SUV 5dr Petrol Plug-in '
'Hybrid Auto ALL4 Euro 6 (s/s) (222 ps)',
'transmission': 'automatic',
'trim': 'Cooper SE Sport',
'year': 2022}
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049670779%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049670779: {'created_time': 1774883292.13474, 'last_price_update_time': 1774883292.134754}
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049670779') HTTP/1.1" 204 0
2026-03-30 15:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a849482-dfb4-58d1-b79b-3c02b8bd8d3f with identifier: 202602179994495
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a849482-dfb4-58d1-b79b-3c02b8bd8d3f
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8badd04147334e57be4c1b6e97b7b349.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8badd04147334e57be4c1b6e97b7b349.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F14f306ab84f04b93bddfed9e0b5ff045.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/14f306ab84f04b93bddfed9e0b5ff045.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0eb5b9e39fb1478c93e4b202a2059dbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0eb5b9e39fb1478c93e4b202a2059dbd.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6336b5a746344a33bb48134465ccd264.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6336b5a746344a33bb48134465ccd264.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83ec9f83ec3944efafca04e391cff553.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83ec9f83ec3944efafca04e391cff553.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9da240b73d7649cf9cba9018096364da.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9da240b73d7649cf9cba9018096364da.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F849916e75c894c628637f8852c60cb29.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/849916e75c894c628637f8852c60cb29.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcbe3236e9d1f4bcc98500469070b03a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cbe3236e9d1f4bcc98500469070b03a4.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb21bf10b393144fb8cfcd352d3837658.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b21bf10b393144fb8cfcd352d3837658.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24ffe56e05dd4118b5886e6b087ab490.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24ffe56e05dd4118b5886e6b087ab490.jpg already downloaded
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 08596d81-5cad-500c-8e6a-007dff8654d8 with identifier: 202602049670696
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08596d81-5cad-500c-8e6a-007dff8654d8
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F318387def1c1471ab2dd72d155697999.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/318387def1c1471ab2dd72d155697999.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09e32027920f4526b0ad996b92d55fea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09e32027920f4526b0ad996b92d55fea.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F642f247e805c459095932ced3c8f570e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/642f247e805c459095932ced3c8f570e.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2a391a5aa85542dcba3a17a2a19ae5e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2a391a5aa85542dcba3a17a2a19ae5e3.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb47ae7c6a48b4972b655c1f653ca6458.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b47ae7c6a48b4972b655c1f653ca6458.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb593f3c75aaa4e8cbbfd220ad8cf2df1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b593f3c75aaa4e8cbbfd220ad8cf2df1.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0c48442dcd546e9aee11adc428795a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0c48442dcd546e9aee11adc428795a4.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ce46623492d4af9b98c1daa3626d876.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ce46623492d4af9b98c1daa3626d876.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F57b56a8100b8485f9da7b8a7bc9af79e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/57b56a8100b8485f9da7b8a7bc9af79e.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F94328373dd9a4b08b4b49bed937b6193.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/94328373dd9a4b08b4b49bed937b6193.jpg already downloaded
2026-03-30 15:08:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4a849482-dfb4-58d1-b79b-3c02b8bd8d3f with identifier 202602179994495
2026-03-30 15:08:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4a849482-dfb4-58d1-b79b-3c02b8bd8d3f
2026-03-30 15:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Black',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': '4a849482-dfb4-58d1-b79b-3c02b8bd8d3f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179994495',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 43832,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8badd04147334e57be4c1b6e97b7b349.jpg',
'https://m.atcdn.co.uk/a/media/14f306ab84f04b93bddfed9e0b5ff045.jpg',
'https://m.atcdn.co.uk/a/media/0eb5b9e39fb1478c93e4b202a2059dbd.jpg',
'https://m.atcdn.co.uk/a/media/6336b5a746344a33bb48134465ccd264.jpg',
'https://m.atcdn.co.uk/a/media/83ec9f83ec3944efafca04e391cff553.jpg',
'https://m.atcdn.co.uk/a/media/9da240b73d7649cf9cba9018096364da.jpg',
'https://m.atcdn.co.uk/a/media/849916e75c894c628637f8852c60cb29.jpg',
'https://m.atcdn.co.uk/a/media/cbe3236e9d1f4bcc98500469070b03a4.jpg',
'https://m.atcdn.co.uk/a/media/b21bf10b393144fb8cfcd352d3837658.jpg',
'https://m.atcdn.co.uk/a/media/24ffe56e05dd4118b5886e6b087ab490.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207950,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8badd04147334e57be4c1b6e97b7b349.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114411,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/14f306ab84f04b93bddfed9e0b5ff045.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159862,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0eb5b9e39fb1478c93e4b202a2059dbd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188742,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6336b5a746344a33bb48134465ccd264.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177820,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/83ec9f83ec3944efafca04e391cff553.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194859,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9da240b73d7649cf9cba9018096364da.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150849,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/849916e75c894c628637f8852c60cb29.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159824,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cbe3236e9d1f4bcc98500469070b03a4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175098,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b21bf10b393144fb8cfcd352d3837658.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4a849482-dfb4-58d1-b79b-3c02b8bd8d3f/4a849482-dfb4-58d1-b79b-3c02b8bd8d3f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173390,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/24ffe56e05dd4118b5886e6b087ab490.jpg',
'Width': 1280}],
'price': 24995,
'price_includes_vat': True,
'registration_date': '2023-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback 2.5i Touring Estate 5dr Petrol Lineartronic 4WD Euro '
'6 (s/s) (169 ps)',
'transmission': 'automatic',
'trim': 'Touring',
'year': 2023}
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179994495%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179994495: {'created_time': 1774883292.641599, 'last_price_update_time': 1774883292.641613}
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179994495') HTTP/1.1" 204 0
2026-03-30 15:08:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 08596d81-5cad-500c-8e6a-007dff8654d8 with identifier 202602049670696
2026-03-30 15:08:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 08596d81-5cad-500c-8e6a-007dff8654d8
2026-03-30 15:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'Black',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 187,
'fuel_type': 'Petrol Hybrid',
'id': '08596d81-5cad-500c-8e6a-007dff8654d8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049670696',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 16423,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/318387def1c1471ab2dd72d155697999.jpg',
'https://m.atcdn.co.uk/a/media/09e32027920f4526b0ad996b92d55fea.jpg',
'https://m.atcdn.co.uk/a/media/642f247e805c459095932ced3c8f570e.jpg',
'https://m.atcdn.co.uk/a/media/2a391a5aa85542dcba3a17a2a19ae5e3.jpg',
'https://m.atcdn.co.uk/a/media/b47ae7c6a48b4972b655c1f653ca6458.jpg',
'https://m.atcdn.co.uk/a/media/b593f3c75aaa4e8cbbfd220ad8cf2df1.jpg',
'https://m.atcdn.co.uk/a/media/e0c48442dcd546e9aee11adc428795a4.jpg',
'https://m.atcdn.co.uk/a/media/6ce46623492d4af9b98c1daa3626d876.jpg',
'https://m.atcdn.co.uk/a/media/57b56a8100b8485f9da7b8a7bc9af79e.jpg',
'https://m.atcdn.co.uk/a/media/94328373dd9a4b08b4b49bed937b6193.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211742,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/318387def1c1471ab2dd72d155697999.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116605,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/09e32027920f4526b0ad996b92d55fea.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161961,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/642f247e805c459095932ced3c8f570e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173327,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2a391a5aa85542dcba3a17a2a19ae5e3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185436,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b47ae7c6a48b4972b655c1f653ca6458.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183110,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b593f3c75aaa4e8cbbfd220ad8cf2df1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156366,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0c48442dcd546e9aee11adc428795a4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185013,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ce46623492d4af9b98c1daa3626d876.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164390,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/57b56a8100b8485f9da7b8a7bc9af79e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08596d81-5cad-500c-8e6a-007dff8654d8/08596d81-5cad-500c-8e6a-007dff8654d8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207884,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/94328373dd9a4b08b4b49bed937b6193.jpg',
'Width': 1280}],
'price': 20995,
'price_includes_vat': True,
'registration_date': '2023-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 h e-POWER N-Connecta SUV 5dr Petrol Hybrid Auto '
'Euro 6 (s/s) (190 ps)',
'transmission': 'automatic',
'trim': 'N-Connecta',
'year': 2023}
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049670696%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049670696: {'created_time': 1774883292.701078, 'last_price_update_time': 1774883292.701091}
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049670696') HTTP/1.1" 204 0
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ff769323-ca03-57ed-bd3c-d2bd4e3229a2 with identifier: 202602179993088
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff769323-ca03-57ed-bd3c-d2bd4e3229a2
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63465ebff1934e238c3eaf9eaea967cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63465ebff1934e238c3eaf9eaea967cc.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20be6d8ea2174a5bb8d3e1dc552de415.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20be6d8ea2174a5bb8d3e1dc552de415.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb5c449f1ffe4b8ab3e326a50ae2ee44.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb5c449f1ffe4b8ab3e326a50ae2ee44.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F106fe81ef8744364a9c8e4622636ce90.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/106fe81ef8744364a9c8e4622636ce90.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd66268bbade24d2183441bb2ebfa6d2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d66268bbade24d2183441bb2ebfa6d2d.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b2fc2facc5341fa9a9d69d478fe9758.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b2fc2facc5341fa9a9d69d478fe9758.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f3ddfb1039b49e39b36e181156c9bef.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f3ddfb1039b49e39b36e181156c9bef.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa583813c96504f1dace77c864b7b1d4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a583813c96504f1dace77c864b7b1d4b.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffc0f8640d44541618f08f41d82c8e0b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fc0f8640d44541618f08f41d82c8e0b3.jpg already downloaded
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b2886875a324bf886be8067e959102a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b2886875a324bf886be8067e959102a.jpg already downloaded
2026-03-30 15:08:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b208469e-7800-585e-9c40-7a2b5adb2676 with identifier: 202602039648310
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b208469e-7800-585e-9c40-7a2b5adb2676
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F96ae857d778941e6a0b955ffc670aaca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/96ae857d778941e6a0b955ffc670aaca.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e2920d416064d25949f2a9c3cfd2ce6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e2920d416064d25949f2a9c3cfd2ce6.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6017722dad414b57a858f8d8f48151b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6017722dad414b57a858f8d8f48151b7.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3d95e28885d148518c94fa9c5ba68554.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3d95e28885d148518c94fa9c5ba68554.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F484255551b494e05a51f586f7f90a1fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/484255551b494e05a51f586f7f90a1fc.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1d85d73dea8410ba8362acb6f60b6a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1d85d73dea8410ba8362acb6f60b6a5.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe55383b3340c4b0e8ac9564f25ff287d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e55383b3340c4b0e8ac9564f25ff287d.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9679fc8cef6f4e1da961a25864bf5be6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9679fc8cef6f4e1da961a25864bf5be6.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffd3fe0bbf2a14766b94384142addca41.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fd3fe0bbf2a14766b94384142addca41.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9c18b041fc894185b4699484d536b974.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9c18b041fc894185b4699484d536b974.jpg already downloaded
2026-03-30 15:08:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ff769323-ca03-57ed-bd3c-d2bd4e3229a2 with identifier 202602179993088
2026-03-30 15:08:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ff769323-ca03-57ed-bd3c-d2bd4e3229a2
2026-03-30 15:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2020 Citroen Berlingo BlueHDi Flair is a versatile and '
'practical choice, offering seating for seven and a fuel '
'efficient 1.5 litre diesel engine. As a Euro 6 compliant '
'vehicle, it meets modern emissions standards. This particular '
'model comes in the Flair trim and includes the Visibility '
'Pack, which features automatic headlights for enhanced '
'convenience. For seamless connectivity, it boasts Mirror '
'Screen with Apple CarPlay and Android Auto, alongside a '
'Bluetooth telephone facility. Comfort is assured with manual '
'air conditioning, and parking is made easier with rear '
'parking sensors.\n'
'\n'
'The Berlingo BlueHDi Flair stands out with its impressive '
'fuel economy, achieving up to 57 miles per gallon, which '
'indicates it is more economical than many similar vehicles. '
'Furthermore, its low insurance group rating suggests that '
'running costs will be more affordable compared to other cars '
'in its class. This combination of practicality, efficiency, '
'and cost effectiveness makes the Citroen Berlingo a '
'compelling option for families and individuals alike.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 100,
'fuel_type': 'Diesel',
'id': 'ff769323-ca03-57ed-bd3c-d2bd4e3229a2',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179993088',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 38900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/63465ebff1934e238c3eaf9eaea967cc.jpg',
'https://m.atcdn.co.uk/a/media/20be6d8ea2174a5bb8d3e1dc552de415.jpg',
'https://m.atcdn.co.uk/a/media/bb5c449f1ffe4b8ab3e326a50ae2ee44.jpg',
'https://m.atcdn.co.uk/a/media/106fe81ef8744364a9c8e4622636ce90.jpg',
'https://m.atcdn.co.uk/a/media/d66268bbade24d2183441bb2ebfa6d2d.jpg',
'https://m.atcdn.co.uk/a/media/0b2fc2facc5341fa9a9d69d478fe9758.jpg',
'https://m.atcdn.co.uk/a/media/5f3ddfb1039b49e39b36e181156c9bef.jpg',
'https://m.atcdn.co.uk/a/media/a583813c96504f1dace77c864b7b1d4b.jpg',
'https://m.atcdn.co.uk/a/media/fc0f8640d44541618f08f41d82c8e0b3.jpg',
'https://m.atcdn.co.uk/a/media/4b2886875a324bf886be8067e959102a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230471,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/63465ebff1934e238c3eaf9eaea967cc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118137,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/20be6d8ea2174a5bb8d3e1dc552de415.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131425,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb5c449f1ffe4b8ab3e326a50ae2ee44.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218343,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/106fe81ef8744364a9c8e4622636ce90.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222466,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d66268bbade24d2183441bb2ebfa6d2d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190734,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b2fc2facc5341fa9a9d69d478fe9758.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180641,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f3ddfb1039b49e39b36e181156c9bef.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178216,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a583813c96504f1dace77c864b7b1d4b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238644,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fc0f8640d44541618f08f41d82c8e0b3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff769323-ca03-57ed-bd3c-d2bd4e3229a2/ff769323-ca03-57ed-bd3c-d2bd4e3229a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182246,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b2886875a324bf886be8067e959102a.jpg',
'Width': 1280}],
'price': 15495,
'price_includes_vat': True,
'registration_date': '2020-09-24',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen Berlingo 1.5 BlueHDi Flair XL MPV 5dr Diesel Manual Euro 6 '
'(s/s) (100 ps)',
'transmission': 'manual',
'trim': 'Flair',
'year': 2020}
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179993088%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179993088: {'created_time': 1774883293.256046, 'last_price_update_time': 1774883293.256058}
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179993088') HTTP/1.1" 204 0
2026-03-30 15:08:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b208469e-7800-585e-9c40-7a2b5adb2676 with identifier 202602039648310
2026-03-30 15:08:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b208469e-7800-585e-9c40-7a2b5adb2676
2026-03-30 15:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 175,
'color': 'White',
'currency': 'GBP',
'description': 'This 2024 KGM Tivoli K40 boasting a full KGM service history '
'and an MOT valid until March 2027. This stylish K40 trim '
'features a responsive 1.5 litre petrol engine, meeting Euro 6 '
'emissions standards. Enjoy seamless connectivity with Apple '
'CarPlay and Android Auto, integrated into the 9 inch AVN '
'touchscreen DAB radio which also offers TomTom navigation and '
'Bluetooth. The convenience of a remote keyless entry system '
'and automatic headlights further enhances your driving '
'experience, alongside a comfortable heated steering wheel.\n'
'\n'
'This KGM Tivoli K40 stands out with its inclusion of features '
'that elevate it above many other vehicles in its class. The '
'advanced infotainment system, complete with Apple CarPlay and '
'Android Auto, ensures your favourite apps and navigation are '
'readily accessible. Furthermore, the low insurance group '
'rating makes this Tivoli an economically sensible choice for '
'many drivers, offering a blend of practicality and modern '
'technology.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 161,
'fuel_type': 'Petrol',
'id': 'b208469e-7800-585e-9c40-7a2b5adb2676',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602039648310',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'KGM',
'model': 'Tivoli',
'odometer': 13674,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/96ae857d778941e6a0b955ffc670aaca.jpg',
'https://m.atcdn.co.uk/a/media/2e2920d416064d25949f2a9c3cfd2ce6.jpg',
'https://m.atcdn.co.uk/a/media/6017722dad414b57a858f8d8f48151b7.jpg',
'https://m.atcdn.co.uk/a/media/3d95e28885d148518c94fa9c5ba68554.jpg',
'https://m.atcdn.co.uk/a/media/484255551b494e05a51f586f7f90a1fc.jpg',
'https://m.atcdn.co.uk/a/media/c1d85d73dea8410ba8362acb6f60b6a5.jpg',
'https://m.atcdn.co.uk/a/media/e55383b3340c4b0e8ac9564f25ff287d.jpg',
'https://m.atcdn.co.uk/a/media/9679fc8cef6f4e1da961a25864bf5be6.jpg',
'https://m.atcdn.co.uk/a/media/fd3fe0bbf2a14766b94384142addca41.jpg',
'https://m.atcdn.co.uk/a/media/9c18b041fc894185b4699484d536b974.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185322,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/96ae857d778941e6a0b955ffc670aaca.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151038,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e2920d416064d25949f2a9c3cfd2ce6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184341,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6017722dad414b57a858f8d8f48151b7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168074,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3d95e28885d148518c94fa9c5ba68554.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173174,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/484255551b494e05a51f586f7f90a1fc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153539,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c1d85d73dea8410ba8362acb6f60b6a5.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137155,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e55383b3340c4b0e8ac9564f25ff287d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161175,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9679fc8cef6f4e1da961a25864bf5be6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144552,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fd3fe0bbf2a14766b94384142addca41.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b208469e-7800-585e-9c40-7a2b5adb2676/b208469e-7800-585e-9c40-7a2b5adb2676_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176248,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9c18b041fc894185b4699484d536b974.jpg',
'Width': 1280}],
'price': 16995,
'price_includes_vat': True,
'registration_date': '2024-03-12',
'seats_number': 5,
'seller_name': None,
'title': 'KGM Tivoli 1.5 K40 SUV 5dr Petrol Auto Euro 6 (s/s) (163 ps)',
'transmission': 'automatic',
'trim': 'K40',
'year': 2024}
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039648310%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602039648310: {'created_time': 1774883293.327099, 'last_price_update_time': 1774883293.327112}
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039648310') HTTP/1.1" 204 0
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6984f3b1-dd68-5af1-8ab7-6af781feccf3 with identifier: 202512048366264
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6984f3b1-dd68-5af1-8ab7-6af781feccf3
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Febc5dfdc9c5046e689a85eee0eee1d84.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ebc5dfdc9c5046e689a85eee0eee1d84.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e42c2bf64c54c108d5519521e39b979.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e42c2bf64c54c108d5519521e39b979.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb03a5878bb449e1bad96617c4a47e9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb03a5878bb449e1bad96617c4a47e9c.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F96f4fe2cf977459294abe8b9a7e5b8dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/96f4fe2cf977459294abe8b9a7e5b8dc.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9cf6c69c91a483c80ca8b8ff6e020ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9cf6c69c91a483c80ca8b8ff6e020ab.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F991adb55c4b44e25bea625002a8294fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/991adb55c4b44e25bea625002a8294fe.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F214ef01dd643433bbd247d8fb56e0660.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/214ef01dd643433bbd247d8fb56e0660.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2f27802f79514798b37b339f44677e06.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2f27802f79514798b37b339f44677e06.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0528c93ad9394d67b641607af4f53514.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0528c93ad9394d67b641607af4f53514.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3cad577cb530443d9ad44940bcaa0fde.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3cad577cb530443d9ad44940bcaa0fde.jpg already downloaded
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Page: 4/4, total results: 65
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510217309096%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510217309096: 1
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510207281701%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510207281701: 1
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510187244312%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510187244312: 1
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306762637%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509306762637: 1
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508315919840%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508315919840: 1
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 5 detail requests (batch 1)
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7 with identifier: 202602169969571
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4d8ee558de744715892bc45c02c89114.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4d8ee558de744715892bc45c02c89114.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3291a2cd1feb46a284a987bbeea4a3a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3291a2cd1feb46a284a987bbeea4a3a9.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F895cb1d9fe3c407fb9ba71c2b10ee768.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/895cb1d9fe3c407fb9ba71c2b10ee768.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F23f5aa9b2d5c42dd8ef8442c5881359f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/23f5aa9b2d5c42dd8ef8442c5881359f.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2edbfb94cad54371b1a814304c63737c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2edbfb94cad54371b1a814304c63737c.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5a157112e36949e1a9c954b8f58c6ab7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5a157112e36949e1a9c954b8f58c6ab7.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F18487df78d17407ca9492010b9d167fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/18487df78d17407ca9492010b9d167fe.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Febb1b486d4ec43f7aa17290426d890ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ebb1b486d4ec43f7aa17290426d890ce.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F024cf4415b8042f598a334ca8a8c062f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/024cf4415b8042f598a334ca8a8c062f.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62d10b7e222f4234b74736d81f92decd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62d10b7e222f4234b74736d81f92decd.jpg already downloaded
2026-03-30 15:08:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c4af22e-9633-5d9b-95fa-6d60eaed02cf with identifier: 202602039647875
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c4af22e-9633-5d9b-95fa-6d60eaed02cf
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85419b41c541409ebe1c9247bc5d0b3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85419b41c541409ebe1c9247bc5d0b3d.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdaa86cf9a9de4752b974ae1a565bdc46.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/daa86cf9a9de4752b974ae1a565bdc46.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F12a078110e9c405ea43592043818ac6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/12a078110e9c405ea43592043818ac6d.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0a99dc5582a4ec6a09e7f98f83406d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0a99dc5582a4ec6a09e7f98f83406d2.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb785340751d542daa793bffc334d0f8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b785340751d542daa793bffc334d0f8c.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26605fdc9429423e926d1971175bd4e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26605fdc9429423e926d1971175bd4e7.jpg already downloaded
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F023181a242e14128933ddc8aa4e34cac.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/023181a242e14128933ddc8aa4e34cac.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77c2f48778e245b48af2795a5ea3a345.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77c2f48778e245b48af2795a5ea3a345.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd7aaf8fda8c4a958dcd712a4be1acbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd7aaf8fda8c4a958dcd712a4be1acbc.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbbaad0917e1c45709c276a8d0cb0fd29.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bbaad0917e1c45709c276a8d0cb0fd29.jpg already downloaded
2026-03-30 15:08:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6984f3b1-dd68-5af1-8ab7-6af781feccf3 with identifier 202512048366264
2026-03-30 15:08:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6984f3b1-dd68-5af1-8ab7-6af781feccf3
2026-03-30 15:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Blue',
'currency': 'GBP',
'description': 'IN STOCK ¦ CHOICE OF COLOURS ¦ CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': '6984f3b1-dd68-5af1-8ab7-6af781feccf3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048366264',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ebc5dfdc9c5046e689a85eee0eee1d84.jpg',
'https://m.atcdn.co.uk/a/media/9e42c2bf64c54c108d5519521e39b979.jpg',
'https://m.atcdn.co.uk/a/media/bb03a5878bb449e1bad96617c4a47e9c.jpg',
'https://m.atcdn.co.uk/a/media/96f4fe2cf977459294abe8b9a7e5b8dc.jpg',
'https://m.atcdn.co.uk/a/media/e9cf6c69c91a483c80ca8b8ff6e020ab.jpg',
'https://m.atcdn.co.uk/a/media/991adb55c4b44e25bea625002a8294fe.jpg',
'https://m.atcdn.co.uk/a/media/214ef01dd643433bbd247d8fb56e0660.jpg',
'https://m.atcdn.co.uk/a/media/2f27802f79514798b37b339f44677e06.jpg',
'https://m.atcdn.co.uk/a/media/0528c93ad9394d67b641607af4f53514.jpg',
'https://m.atcdn.co.uk/a/media/3cad577cb530443d9ad44940bcaa0fde.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274725,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ebc5dfdc9c5046e689a85eee0eee1d84.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205017,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e42c2bf64c54c108d5519521e39b979.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168231,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb03a5878bb449e1bad96617c4a47e9c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223697,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/96f4fe2cf977459294abe8b9a7e5b8dc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226973,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9cf6c69c91a483c80ca8b8ff6e020ab.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248187,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/991adb55c4b44e25bea625002a8294fe.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228547,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/214ef01dd643433bbd247d8fb56e0660.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228337,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2f27802f79514798b37b339f44677e06.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253061,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0528c93ad9394d67b641607af4f53514.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6984f3b1-dd68-5af1-8ab7-6af781feccf3/6984f3b1-dd68-5af1-8ab7-6af781feccf3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259410,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3cad577cb530443d9ad44940bcaa0fde.jpg',
'Width': 1280}],
'price': 45995,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback Touring 2.5 5dr Estate CVT Petrol',
'transmission': 'automatic',
'trim': 'Touring',
'year': 2026}
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048366264%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048366264: {'created_time': 1774883294.086476, 'last_price_update_time': 1774883294.086492}
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048366264') HTTP/1.1" 204 0
2026-03-30 15:08:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7 with identifier 202602169969571
2026-03-30 15:08:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7
2026-03-30 15:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'Silver',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': 'c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169969571',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Ford',
'model': 'Focus',
'odometer': 48284,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4d8ee558de744715892bc45c02c89114.jpg',
'https://m.atcdn.co.uk/a/media/3291a2cd1feb46a284a987bbeea4a3a9.jpg',
'https://m.atcdn.co.uk/a/media/895cb1d9fe3c407fb9ba71c2b10ee768.jpg',
'https://m.atcdn.co.uk/a/media/23f5aa9b2d5c42dd8ef8442c5881359f.jpg',
'https://m.atcdn.co.uk/a/media/2edbfb94cad54371b1a814304c63737c.jpg',
'https://m.atcdn.co.uk/a/media/5a157112e36949e1a9c954b8f58c6ab7.jpg',
'https://m.atcdn.co.uk/a/media/18487df78d17407ca9492010b9d167fe.jpg',
'https://m.atcdn.co.uk/a/media/ebb1b486d4ec43f7aa17290426d890ce.jpg',
'https://m.atcdn.co.uk/a/media/024cf4415b8042f598a334ca8a8c062f.jpg',
'https://m.atcdn.co.uk/a/media/62d10b7e222f4234b74736d81f92decd.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258671,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4d8ee558de744715892bc45c02c89114.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264569,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3291a2cd1feb46a284a987bbeea4a3a9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258345,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/895cb1d9fe3c407fb9ba71c2b10ee768.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210657,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/23f5aa9b2d5c42dd8ef8442c5881359f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245930,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2edbfb94cad54371b1a814304c63737c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246334,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5a157112e36949e1a9c954b8f58c6ab7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289581,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/18487df78d17407ca9492010b9d167fe.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187584,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ebb1b486d4ec43f7aa17290426d890ce.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148158,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/024cf4415b8042f598a334ca8a8c062f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7/c0487c9a-f2d7-5fdc-aff7-c3fdb42b3ab7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198784,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62d10b7e222f4234b74736d81f92decd.jpg',
'Width': 1280}],
'price': 12695,
'price_includes_vat': True,
'registration_date': '2019-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost Active X Estate 5dr Petrol Manual Euro 6 '
'(s/s) (125 ps)',
'transmission': 'manual',
'trim': 'Active X',
'year': 2019}
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169969571%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169969571: {'created_time': 1774883294.143767, 'last_price_update_time': 1774883294.143777}
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169969571') HTTP/1.1" 204 0
2026-03-30 15:08:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9c4af22e-9633-5d9b-95fa-6d60eaed02cf with identifier 202602039647875
2026-03-30 15:08:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9c4af22e-9633-5d9b-95fa-6d60eaed02cf
2026-03-30 15:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 180,
'color': 'White',
'currency': 'GBP',
'description': 'This 2023 Subaru XV i e-Boxer SE Premium boasts a full '
'dealership service history, offering peace of mind for its '
'next owner. This Euro 6 compliant model features a 2.0 litre '
"petrol hybrid engine paired with Subaru's renowned Four Wheel "
'Drive system, ensuring capability in various conditions. The '
'SE Premium trim level comes equipped with a host of desirable '
'features, including seamless integration with Apple CarPlay '
'and Android Auto, allowing for easy access to your favourite '
'apps and navigation. For enhanced safety and convenience, it '
"includes Subaru's EyeSight driver assistance technology with "
'adaptive cruise control, automatic LED headlights that '
'illuminate the road ahead, and a power sliding and tilt '
'adjustable sunroof for an open and airy cabin experience.\n'
'\n'
'The Subaru XV i e-Boxer SE Premium stands out with its low '
'insurance group, making it an economical choice for many '
'drivers. The combination of its hybrid powertrain, Four Wheel '
'Drive capability, and advanced technology features like '
'Bluetooth connectivity, adaptive cruise control, automatic '
'headlights, and smartphone integration, positions this '
'vehicle as a well rounded and practical option within its '
'class.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Petrol Hybrid',
'id': '9c4af22e-9633-5d9b-95fa-6d60eaed02cf',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602039647875',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'XV',
'odometer': 20437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/85419b41c541409ebe1c9247bc5d0b3d.jpg',
'https://m.atcdn.co.uk/a/media/daa86cf9a9de4752b974ae1a565bdc46.jpg',
'https://m.atcdn.co.uk/a/media/12a078110e9c405ea43592043818ac6d.jpg',
'https://m.atcdn.co.uk/a/media/a0a99dc5582a4ec6a09e7f98f83406d2.jpg',
'https://m.atcdn.co.uk/a/media/b785340751d542daa793bffc334d0f8c.jpg',
'https://m.atcdn.co.uk/a/media/26605fdc9429423e926d1971175bd4e7.jpg',
'https://m.atcdn.co.uk/a/media/023181a242e14128933ddc8aa4e34cac.jpg',
'https://m.atcdn.co.uk/a/media/77c2f48778e245b48af2795a5ea3a345.jpg',
'https://m.atcdn.co.uk/a/media/cd7aaf8fda8c4a958dcd712a4be1acbc.jpg',
'https://m.atcdn.co.uk/a/media/bbaad0917e1c45709c276a8d0cb0fd29.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189857,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85419b41c541409ebe1c9247bc5d0b3d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134526,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/daa86cf9a9de4752b974ae1a565bdc46.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161022,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/12a078110e9c405ea43592043818ac6d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167018,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0a99dc5582a4ec6a09e7f98f83406d2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180952,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b785340751d542daa793bffc334d0f8c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183382,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/26605fdc9429423e926d1971175bd4e7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159547,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/023181a242e14128933ddc8aa4e34cac.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179488,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/77c2f48778e245b48af2795a5ea3a345.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149262,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd7aaf8fda8c4a958dcd712a4be1acbc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4af22e-9633-5d9b-95fa-6d60eaed02cf/9c4af22e-9633-5d9b-95fa-6d60eaed02cf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183743,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bbaad0917e1c45709c276a8d0cb0fd29.jpg',
'Width': 1280}],
'price': 21995,
'price_includes_vat': True,
'registration_date': '2023-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru XV 2.0 i e-Boxer SE Premium SUV 5dr Petrol Hybrid '
'Lineartronic 4WD Euro 6 (s/s) (150 ps)',
'transmission': 'automatic',
'trim': 'SE Premium',
'year': 2023}
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039647875%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602039647875: {'created_time': 1774883294.196742, 'last_price_update_time': 1774883294.196752}
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039647875') HTTP/1.1" 204 0
2026-03-30 15:08:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 91372755-7b29-52c2-9c7d-6b3a8f572499 with identifier: 202512048365542
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91372755-7b29-52c2-9c7d-6b3a8f572499
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7e53ab9a832643898e854e99822cdec1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7e53ab9a832643898e854e99822cdec1.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7944efb61494611adc6c491ff1543eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7944efb61494611adc6c491ff1543eb.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F958cdebe3f7648bf878a715ba0dc9ad2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/958cdebe3f7648bf878a715ba0dc9ad2.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F003db0b3627745349897397cc17f11e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/003db0b3627745349897397cc17f11e3.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7febaafa73b546a99378cc00e4e1bbb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7febaafa73b546a99378cc00e4e1bbb2.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dde9a9552994288801bf379f154bde9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dde9a9552994288801bf379f154bde9.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5451ef52ac03479e9fa0c97aae5df324.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5451ef52ac03479e9fa0c97aae5df324.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb075f1de13804e55af9e1304fce08ab3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b075f1de13804e55af9e1304fce08ab3.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc6690debe9e548cc969a0a4806a66add.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c6690debe9e548cc969a0a4806a66add.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe6064bf3b0de4aac9327be00e3ffbcda.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e6064bf3b0de4aac9327be00e3ffbcda.jpg already downloaded
2026-03-30 15:08:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5fac28-a490-5245-9fe1-f379eb8043ea with identifier: 202602169969504
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae5fac28-a490-5245-9fe1-f379eb8043ea
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F74e54e6cc0804b078f2fa88b97e3e7e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/74e54e6cc0804b078f2fa88b97e3e7e0.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2a360e98e204aa7b8184a283b07ede1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2a360e98e204aa7b8184a283b07ede1.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7861a777a01f417fb6f078a8f8a6cfe2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7861a777a01f417fb6f078a8f8a6cfe2.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b86ebeb94ae4cf4a717ec0ba654cd3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b86ebeb94ae4cf4a717ec0ba654cd3f.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ce265753572496ca00d4477c7987ea4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ce265753572496ca00d4477c7987ea4.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4eab3eef136648ba98514c064efb87d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4eab3eef136648ba98514c064efb87d4.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53c4fc52a0e440b5b1730673d2e02567.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53c4fc52a0e440b5b1730673d2e02567.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24632f28b0454aa78c289fb2ebd555cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24632f28b0454aa78c289fb2ebd555cd.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb4843c1426eb413c8c0c2aaa16c1f48f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b4843c1426eb413c8c0c2aaa16c1f48f.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1df79c9dca274e67a174b55be5b4e7f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1df79c9dca274e67a174b55be5b4e7f7.jpg already downloaded
2026-03-30 15:08:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b73318-4579-5994-a46f-56a12c891875 with identifier: 202602029613284
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3b73318-4579-5994-a46f-56a12c891875
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a7d1826dd4d4f22952c7855e86898af.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a7d1826dd4d4f22952c7855e86898af.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb49e28ae7ea740bd985be7d93e075835.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b49e28ae7ea740bd985be7d93e075835.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff7040de9ccc64b8e915d5bbeabed3828.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f7040de9ccc64b8e915d5bbeabed3828.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb56f40e79fe14cdaa962da1d60d1af59.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b56f40e79fe14cdaa962da1d60d1af59.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9c1465ec4e2442f39873ee2fcda75742.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9c1465ec4e2442f39873ee2fcda75742.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4cf56b4adf1480cbefda8c99ce287e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4cf56b4adf1480cbefda8c99ce287e8.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa8914d82b084124a3ce3c21869be0ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa8914d82b084124a3ce3c21869be0ce.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F46acdb5d8e624167a90c0cb92ddddd38.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/46acdb5d8e624167a90c0cb92ddddd38.jpg already downloaded
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F848fda2dd77b4ecaa3e67a327a053ab1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/848fda2dd77b4ecaa3e67a327a053ab1.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71127570fb74495a9c0660c1a58c5335.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71127570fb74495a9c0660c1a58c5335.jpg already downloaded
2026-03-30 15:08:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 91372755-7b29-52c2-9c7d-6b3a8f572499 with identifier 202512048365542
2026-03-30 15:08:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 91372755-7b29-52c2-9c7d-6b3a8f572499
2026-03-30 15:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 230,
'color': 'Blue',
'currency': 'GBP',
'description': 'Performance - Drive with confidence in the GWM POER300. With '
'its turbocharged engine, responsive transmission and '
'impressive towing power, you’ll be ready to tackle any '
'challenge.\n'
'\n'
'Tech- Make every journey a pleasure with innovative safety '
'features and driver assistance systems embedded to give you '
'peace of mind. Stay connected with Apple CarPlay and Android '
'Auto standard across the range. Enjoy features like Wireless '
'Charging, Smart Keyless Entry and Push Button Start to make '
'everyday practical.\n'
'\n'
'More power. More performance. More possibilities with 5 '
'years/125,000 miles warranty.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 180,
'fuel_type': 'Diesel',
'id': '91372755-7b29-52c2-9c7d-6b3a8f572499',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048365542',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'POER300',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/7e53ab9a832643898e854e99822cdec1.jpg',
'https://m.atcdn.co.uk/a/media/b7944efb61494611adc6c491ff1543eb.jpg',
'https://m.atcdn.co.uk/a/media/958cdebe3f7648bf878a715ba0dc9ad2.jpg',
'https://m.atcdn.co.uk/a/media/003db0b3627745349897397cc17f11e3.jpg',
'https://m.atcdn.co.uk/a/media/7febaafa73b546a99378cc00e4e1bbb2.jpg',
'https://m.atcdn.co.uk/a/media/0dde9a9552994288801bf379f154bde9.jpg',
'https://m.atcdn.co.uk/a/media/5451ef52ac03479e9fa0c97aae5df324.jpg',
'https://m.atcdn.co.uk/a/media/b075f1de13804e55af9e1304fce08ab3.jpg',
'https://m.atcdn.co.uk/a/media/c6690debe9e548cc969a0a4806a66add.jpg',
'https://m.atcdn.co.uk/a/media/e6064bf3b0de4aac9327be00e3ffbcda.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227734,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7e53ab9a832643898e854e99822cdec1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151173,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7944efb61494611adc6c491ff1543eb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155271,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/958cdebe3f7648bf878a715ba0dc9ad2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237447,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/003db0b3627745349897397cc17f11e3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226793,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7febaafa73b546a99378cc00e4e1bbb2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182894,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dde9a9552994288801bf379f154bde9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172918,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5451ef52ac03479e9fa0c97aae5df324.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119131,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b075f1de13804e55af9e1304fce08ab3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216759,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c6690debe9e548cc969a0a4806a66add.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91372755-7b29-52c2-9c7d-6b3a8f572499/91372755-7b29-52c2-9c7d-6b3a8f572499_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95506,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e6064bf3b0de4aac9327be00e3ffbcda.jpg',
'Width': 1280}],
'price': 41994,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'GWM POER300 Ultra 2.4 4dr Pick Up Automatic Diesel',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2026}
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048365542%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048365542: {'created_time': 1774883295.423512, 'last_price_update_time': 1774883295.423521}
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048365542') HTTP/1.1" 204 0
2026-03-30 15:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:08:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ae5fac28-a490-5245-9fe1-f379eb8043ea with identifier 202602169969504
2026-03-30 15:08:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ae5fac28-a490-5245-9fe1-f379eb8043ea
2026-03-30 15:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2025 Suzuki e Vitara Ultra is a remarkable example, '
'boasting exceptionally low mileage for its age, having '
'covered just 1159 miles. This electric, Four Wheel Drive '
'model offers a substantial battery capacity of 61 kWh, '
'providing a maximum range of 246 miles on a full charge. '
'Recharging at home using a 7kW charger takes approximately 10 '
'hours, while rapid public charging can replenish the battery '
'from empty to 80% in just 51 minutes.\n'
'\n'
'The Ultra trim level comes equipped with a suite of advanced '
'features designed to enhance your driving experience. These '
'include a Blind Spot Monitor with Blind Spot Assistance, '
'Automatic Air Conditioning with Climate Control, and Front '
'and Rear Parking Distance Sensors with Parking Assistance. '
'The striking 3 Point Design LED Headlamps ensure excellent '
'visibility, and the Wireless Smartphone Link, compatible with '
'both Android Auto and Apple CarPlay, keeps you seamlessly '
'connected. These features collectively demonstrate the '
'superior level of technology and convenience offered by this '
'Suzuki e Vitara compared to other vehicles in its class.',
'doors_number': 5,
'engine_horse_power': 180,
'fuel_type': 'Electric',
'id': 'ae5fac28-a490-5245-9fe1-f379eb8043ea',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169969504',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Suzuki',
'model': 'e Vitara',
'odometer': 1159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/74e54e6cc0804b078f2fa88b97e3e7e0.jpg',
'https://m.atcdn.co.uk/a/media/f2a360e98e204aa7b8184a283b07ede1.jpg',
'https://m.atcdn.co.uk/a/media/7861a777a01f417fb6f078a8f8a6cfe2.jpg',
'https://m.atcdn.co.uk/a/media/4b86ebeb94ae4cf4a717ec0ba654cd3f.jpg',
'https://m.atcdn.co.uk/a/media/3ce265753572496ca00d4477c7987ea4.jpg',
'https://m.atcdn.co.uk/a/media/4eab3eef136648ba98514c064efb87d4.jpg',
'https://m.atcdn.co.uk/a/media/53c4fc52a0e440b5b1730673d2e02567.jpg',
'https://m.atcdn.co.uk/a/media/24632f28b0454aa78c289fb2ebd555cd.jpg',
'https://m.atcdn.co.uk/a/media/b4843c1426eb413c8c0c2aaa16c1f48f.jpg',
'https://m.atcdn.co.uk/a/media/1df79c9dca274e67a174b55be5b4e7f7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211330,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/74e54e6cc0804b078f2fa88b97e3e7e0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142905,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2a360e98e204aa7b8184a283b07ede1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117388,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7861a777a01f417fb6f078a8f8a6cfe2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197108,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b86ebeb94ae4cf4a717ec0ba654cd3f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199083,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ce265753572496ca00d4477c7987ea4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178059,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4eab3eef136648ba98514c064efb87d4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130053,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53c4fc52a0e440b5b1730673d2e02567.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166363,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/24632f28b0454aa78c289fb2ebd555cd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153971,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b4843c1426eb413c8c0c2aaa16c1f48f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae5fac28-a490-5245-9fe1-f379eb8043ea/ae5fac28-a490-5245-9fe1-f379eb8043ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192203,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1df79c9dca274e67a174b55be5b4e7f7.jpg',
'Width': 1280}],
'price': 28495,
'price_includes_vat': True,
'registration_date': '2025-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki E Vitara 61kWh Ultra SUV 5dr Electric Auto ALLGRIP (183 ps)',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2025}
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169969504%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169969504: {'created_time': 1774883295.479937, 'last_price_update_time': 1774883295.479948}
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169969504') HTTP/1.1" 204 0
2026-03-30 15:08:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f3b73318-4579-5994-a46f-56a12c891875 with identifier 202602029613284
2026-03-30 15:08:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f3b73318-4579-5994-a46f-56a12c891875
2026-03-30 15:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Grey',
'currency': 'GBP',
'description': 'AWAITING PREP',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 120,
'fuel_type': 'Petrol',
'id': 'f3b73318-4579-5994-a46f-56a12c891875',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602029613284',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Mazda',
'model': 'Mazda3',
'odometer': 29748,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6a7d1826dd4d4f22952c7855e86898af.jpg',
'https://m.atcdn.co.uk/a/media/b49e28ae7ea740bd985be7d93e075835.jpg',
'https://m.atcdn.co.uk/a/media/f7040de9ccc64b8e915d5bbeabed3828.jpg',
'https://m.atcdn.co.uk/a/media/b56f40e79fe14cdaa962da1d60d1af59.jpg',
'https://m.atcdn.co.uk/a/media/9c1465ec4e2442f39873ee2fcda75742.jpg',
'https://m.atcdn.co.uk/a/media/d4cf56b4adf1480cbefda8c99ce287e8.jpg',
'https://m.atcdn.co.uk/a/media/aa8914d82b084124a3ce3c21869be0ce.jpg',
'https://m.atcdn.co.uk/a/media/46acdb5d8e624167a90c0cb92ddddd38.jpg',
'https://m.atcdn.co.uk/a/media/848fda2dd77b4ecaa3e67a327a053ab1.jpg',
'https://m.atcdn.co.uk/a/media/71127570fb74495a9c0660c1a58c5335.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218198,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6a7d1826dd4d4f22952c7855e86898af.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169950,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b49e28ae7ea740bd985be7d93e075835.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157835,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f7040de9ccc64b8e915d5bbeabed3828.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192218,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b56f40e79fe14cdaa962da1d60d1af59.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202324,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9c1465ec4e2442f39873ee2fcda75742.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210738,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d4cf56b4adf1480cbefda8c99ce287e8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157740,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa8914d82b084124a3ce3c21869be0ce.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188621,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/46acdb5d8e624167a90c0cb92ddddd38.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186955,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/848fda2dd77b4ecaa3e67a327a053ab1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3b73318-4579-5994-a46f-56a12c891875/f3b73318-4579-5994-a46f-56a12c891875_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223091,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/71127570fb74495a9c0660c1a58c5335.jpg',
'Width': 1280}],
'price': 14495,
'price_includes_vat': True,
'registration_date': '2019-04-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda3 2.0 SKYACTIV-G MHEV GT Sport Hatchback 5dr Petrol Manual '
'Euro 6 (s/s) (122 ps)',
'transmission': 'manual',
'trim': 'GT Sport',
'year': 2019}
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602029613284%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602029613284: {'created_time': 1774883295.53655, 'last_price_update_time': 1774883295.536558}
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602029613284') HTTP/1.1" 204 0
2026-03-30 15:08:15 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:15 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fe8c1aae-664f-5851-a18c-5621cdac6a57 with identifier: 202511288214031
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe8c1aae-664f-5851-a18c-5621cdac6a57
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F061bf40296ae4d20a04f4510b8f985c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/061bf40296ae4d20a04f4510b8f985c5.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F974b6c01e6c1472b8ade3e45f7b32275.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/974b6c01e6c1472b8ade3e45f7b32275.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb3feacae25046eebd68ba14d456f410.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb3feacae25046eebd68ba14d456f410.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F87384b19c059483398a47d685debbfcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/87384b19c059483398a47d685debbfcd.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F74c74f4b9323461cbe2de06e0142f6d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/74c74f4b9323461cbe2de06e0142f6d2.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91cffaa9e0d94f71bc01971dfc02e08d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91cffaa9e0d94f71bc01971dfc02e08d.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c309f9b8f85482383570046710bd892.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c309f9b8f85482383570046710bd892.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F34952e61d1114c7c849863f71f5b2c39.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/34952e61d1114c7c849863f71f5b2c39.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7828ee75df5541bba5ee7bbdfd77d602.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7828ee75df5541bba5ee7bbdfd77d602.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1472a38e146f445b84b7a301d157da2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1472a38e146f445b84b7a301d157da2d.jpg already downloaded
2026-03-30 15:08:15 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:15 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ba3f362f-2748-5241-9c5a-a188aa3c5292 with identifier: 202601269435342
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba3f362f-2748-5241-9c5a-a188aa3c5292
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa7b3a4f0044a4ed69f386889a558aedf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a7b3a4f0044a4ed69f386889a558aedf.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9088a7d5ea84e2d9b87db59b4776497.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9088a7d5ea84e2d9b87db59b4776497.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F05709d5231d44e0590d491122952871e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/05709d5231d44e0590d491122952871e.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff7725bc34234be58e7c45d93f69e1d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff7725bc34234be58e7c45d93f69e1d6.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9466eeac5464a29b7232a0bff88083c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9466eeac5464a29b7232a0bff88083c.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F42caafb1d2db4d3d8f00f1608eaaf4df.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/42caafb1d2db4d3d8f00f1608eaaf4df.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcc793655fa4349f1bd3f32cb01a3e5ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cc793655fa4349f1bd3f32cb01a3e5ad.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1c1b492e36140c18d3ba40d9b9d7604.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1c1b492e36140c18d3ba40d9b9d7604.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc51047195ea34e23ad7c11cc5ab98a00.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c51047195ea34e23ad7c11cc5ab98a00.jpg already downloaded
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8367de014698453dacc9f639670c4b47.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8367de014698453dacc9f639670c4b47.jpg already downloaded
2026-03-30 15:08:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fe8c1aae-664f-5851-a18c-5621cdac6a57 with identifier 202511288214031
2026-03-30 15:08:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fe8c1aae-664f-5851-a18c-5621cdac6a57
2026-03-30 15:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 230,
'color': 'Blue',
'currency': 'GBP',
'description': 'Performance - Drive with confidence in the GWM POER300. With '
'its turbocharged engine, responsive transmission and '
'impressive towing power, you’ll be ready to tackle any '
'challenge.\n'
'\n'
'Tech- Make every journey a pleasure with innovative safety '
'features and driver assistance systems embedded to give you '
'peace of mind. Stay connected with Apple CarPlay and Android '
'Auto standard across the range. Enjoy features like Wireless '
'Charging, Smart Keyless Entry and Push Button Start to make '
'everyday practical.\n'
'\n'
'More power. More performance. More possibilities with 5 '
'years/125,000 miles warranty.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 180,
'fuel_type': 'Diesel',
'id': 'fe8c1aae-664f-5851-a18c-5621cdac6a57',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511288214031',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'POER300',
'odometer': 2750,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/061bf40296ae4d20a04f4510b8f985c5.jpg',
'https://m.atcdn.co.uk/a/media/974b6c01e6c1472b8ade3e45f7b32275.jpg',
'https://m.atcdn.co.uk/a/media/eb3feacae25046eebd68ba14d456f410.jpg',
'https://m.atcdn.co.uk/a/media/87384b19c059483398a47d685debbfcd.jpg',
'https://m.atcdn.co.uk/a/media/74c74f4b9323461cbe2de06e0142f6d2.jpg',
'https://m.atcdn.co.uk/a/media/91cffaa9e0d94f71bc01971dfc02e08d.jpg',
'https://m.atcdn.co.uk/a/media/2c309f9b8f85482383570046710bd892.jpg',
'https://m.atcdn.co.uk/a/media/34952e61d1114c7c849863f71f5b2c39.jpg',
'https://m.atcdn.co.uk/a/media/7828ee75df5541bba5ee7bbdfd77d602.jpg',
'https://m.atcdn.co.uk/a/media/1472a38e146f445b84b7a301d157da2d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231746,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/061bf40296ae4d20a04f4510b8f985c5.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111359,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/974b6c01e6c1472b8ade3e45f7b32275.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171607,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eb3feacae25046eebd68ba14d456f410.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212706,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/87384b19c059483398a47d685debbfcd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220036,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/74c74f4b9323461cbe2de06e0142f6d2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193444,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/91cffaa9e0d94f71bc01971dfc02e08d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141296,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c309f9b8f85482383570046710bd892.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181824,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/34952e61d1114c7c849863f71f5b2c39.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191665,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7828ee75df5541bba5ee7bbdfd77d602.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8cc1e6d-9028-58c3-b981-84a635993c0c/e8cc1e6d-9028-58c3-b981-84a635993c0c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238992,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1472a38e146f445b84b7a301d157da2d.jpg',
'Width': 1280}],
'price': 43194,
'price_includes_vat': True,
'registration_date': '2025-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'GWM POER300 2.4D Ultra Pickup Double Cab 4dr Diesel Auto 4WD Euro 6 '
'(s/s) (183 ps)',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2025}
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511288214031%27 HTTP/1.1" 200 None
2026-03-30 15:08:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511288214031: {'created_time': 1774883295.969522, 'last_price_update_time': 1774883295.969533}
2026-03-30 15:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511288214031') HTTP/1.1" 204 0
2026-03-30 15:08:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ba3f362f-2748-5241-9c5a-a188aa3c5292 with identifier 202601269435342
2026-03-30 15:08:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ba3f362f-2748-5241-9c5a-a188aa3c5292
2026-03-30 15:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2022 BMW 1 Series 118i M Sport (LCP) presents an '
'exceptional opportunity with its remarkably low mileage of '
'just over 23,000 miles for its age. This Euro 6 compliant '
'model boasts a spirited 1.5 litre petrol engine, delivering '
'an engaging 0-62mph acceleration in a brisk 8.9 seconds. '
"Inside, you'll find the premium feel of Perforated Dakota "
'Leather in Black with a striking Blue Highlight, complemented '
'by a comprehensive Bluetooth system for both audio streaming '
'and hands free calls, all managed through a USB audio '
'interface.\n'
'\n'
'Further enhancing your driving experience are the practical '
'Park Distance Control sensors for both the front and rear, '
'making manoeuvring effortless. The cruise control system, '
'complete with a brake function, speed limiter, and adaptive '
'capabilities, ensures relaxed journeys. This BMW 1 Series '
'also offers generous boot space, making it a versatile choice '
'for everyday needs and longer trips. These carefully selected '
'features and its impressive performance metrics set this '
'vehicle apart from others in its class.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 134,
'fuel_type': 'Petrol',
'id': 'ba3f362f-2748-5241-9c5a-a188aa3c5292',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269435342',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'BMW',
'model': '1 Series',
'odometer': 23301,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 44,
'photo_urls': ['https://m.atcdn.co.uk/a/media/a7b3a4f0044a4ed69f386889a558aedf.jpg',
'https://m.atcdn.co.uk/a/media/b9088a7d5ea84e2d9b87db59b4776497.jpg',
'https://m.atcdn.co.uk/a/media/05709d5231d44e0590d491122952871e.jpg',
'https://m.atcdn.co.uk/a/media/ff7725bc34234be58e7c45d93f69e1d6.jpg',
'https://m.atcdn.co.uk/a/media/b9466eeac5464a29b7232a0bff88083c.jpg',
'https://m.atcdn.co.uk/a/media/42caafb1d2db4d3d8f00f1608eaaf4df.jpg',
'https://m.atcdn.co.uk/a/media/cc793655fa4349f1bd3f32cb01a3e5ad.jpg',
'https://m.atcdn.co.uk/a/media/c1c1b492e36140c18d3ba40d9b9d7604.jpg',
'https://m.atcdn.co.uk/a/media/c51047195ea34e23ad7c11cc5ab98a00.jpg',
'https://m.atcdn.co.uk/a/media/8367de014698453dacc9f639670c4b47.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214203,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a7b3a4f0044a4ed69f386889a558aedf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160360,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9088a7d5ea84e2d9b87db59b4776497.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150057,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/05709d5231d44e0590d491122952871e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201144,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ff7725bc34234be58e7c45d93f69e1d6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205971,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9466eeac5464a29b7232a0bff88083c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182914,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/42caafb1d2db4d3d8f00f1608eaaf4df.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165601,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cc793655fa4349f1bd3f32cb01a3e5ad.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181158,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c1c1b492e36140c18d3ba40d9b9d7604.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174938,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c51047195ea34e23ad7c11cc5ab98a00.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba3f362f-2748-5241-9c5a-a188aa3c5292/ba3f362f-2748-5241-9c5a-a188aa3c5292_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213256,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8367de014698453dacc9f639670c4b47.jpg',
'Width': 1280}],
'price': 19995,
'price_includes_vat': True,
'registration_date': '2022-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1 Series 1.5 118i M Sport (LCP) Hatchback 5dr Petrol Manual '
'Euro 6 (s/s) (136 ps)',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2022}
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269435342%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269435342: {'created_time': 1774883296.067951, 'last_price_update_time': 1774883296.067965}
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269435342') HTTP/1.1" 204 0
2026-03-30 15:08:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b89ee648-d236-5e93-b90c-6773be644b6b with identifier: 202511288203102
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b89ee648-d236-5e93-b90c-6773be644b6b
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F183d2a9fedf3431c82288926a4b63eee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/183d2a9fedf3431c82288926a4b63eee.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd61e426389314ceba4fe1adc3aeddfb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d61e426389314ceba4fe1adc3aeddfb4.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F426c65124021402f93152dadd5b2cc96.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/426c65124021402f93152dadd5b2cc96.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85704cc759fb4658b6dd59770cab9c55.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85704cc759fb4658b6dd59770cab9c55.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F743998aa329242ab864a335c63582849.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/743998aa329242ab864a335c63582849.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45c7661eb7eb4a5b9fe1633e5db49366.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45c7661eb7eb4a5b9fe1633e5db49366.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4563ad51853244a791d72f66839547cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4563ad51853244a791d72f66839547cd.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49693ffa67a94ab291a521e4983e1a50.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49693ffa67a94ab291a521e4983e1a50.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F34a335657e76490c9ec47f2cd876ed73.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/34a335657e76490c9ec47f2cd876ed73.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0421d5d768de46449a8a08e1442858c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0421d5d768de46449a8a08e1442858c6.jpg already downloaded
2026-03-30 15:08:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c0fcc14a-9199-5702-8e86-34be1be22565 with identifier: 202601269435260
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0fcc14a-9199-5702-8e86-34be1be22565
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9e68e1b45544b3da91d981392d5b630.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9e68e1b45544b3da91d981392d5b630.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe1e5803271864a28b41e7a64ce0784d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e1e5803271864a28b41e7a64ce0784d3.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F53957ec7c07c40f599dd126420552178.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/53957ec7c07c40f599dd126420552178.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F035182a6590e465ea731a9e0486b4fe2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/035182a6590e465ea731a9e0486b4fe2.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1a44389c8484a80b399f7a277ade370.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1a44389c8484a80b399f7a277ade370.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa03d2a14fce94a6fa99b5f5a222e9a28.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a03d2a14fce94a6fa99b5f5a222e9a28.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F499e579b2b8144c68e3242bbc17a7316.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/499e579b2b8144c68e3242bbc17a7316.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e388e5a7eb84e7288d1fa1d2ad7c1f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e388e5a7eb84e7288d1fa1d2ad7c1f0.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f7eb86c53324e2bac5cf734620ccd8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f7eb86c53324e2bac5cf734620ccd8d.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff82428bdc7114b0b85472d896c2fb7e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f82428bdc7114b0b85472d896c2fb7e6.jpg already downloaded
2026-03-30 15:08:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b89ee648-d236-5e93-b90c-6773be644b6b with identifier 202511288203102
2026-03-30 15:08:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b89ee648-d236-5e93-b90c-6773be644b6b
2026-03-30 15:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Black',
'currency': 'GBP',
'description': '3 YEARS FREE SERVICING!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': 'b89ee648-d236-5e93-b90c-6773be644b6b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511288203102',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/183d2a9fedf3431c82288926a4b63eee.jpg',
'https://m.atcdn.co.uk/a/media/d61e426389314ceba4fe1adc3aeddfb4.jpg',
'https://m.atcdn.co.uk/a/media/426c65124021402f93152dadd5b2cc96.jpg',
'https://m.atcdn.co.uk/a/media/85704cc759fb4658b6dd59770cab9c55.jpg',
'https://m.atcdn.co.uk/a/media/743998aa329242ab864a335c63582849.jpg',
'https://m.atcdn.co.uk/a/media/45c7661eb7eb4a5b9fe1633e5db49366.jpg',
'https://m.atcdn.co.uk/a/media/4563ad51853244a791d72f66839547cd.jpg',
'https://m.atcdn.co.uk/a/media/49693ffa67a94ab291a521e4983e1a50.jpg',
'https://m.atcdn.co.uk/a/media/34a335657e76490c9ec47f2cd876ed73.jpg',
'https://m.atcdn.co.uk/a/media/0421d5d768de46449a8a08e1442858c6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220578,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/183d2a9fedf3431c82288926a4b63eee.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172473,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d61e426389314ceba4fe1adc3aeddfb4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173809,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/426c65124021402f93152dadd5b2cc96.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202351,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85704cc759fb4658b6dd59770cab9c55.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203673,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/743998aa329242ab864a335c63582849.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188972,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/45c7661eb7eb4a5b9fe1633e5db49366.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167814,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4563ad51853244a791d72f66839547cd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181305,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/49693ffa67a94ab291a521e4983e1a50.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212476,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/34a335657e76490c9ec47f2cd876ed73.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145371,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0421d5d768de46449a8a08e1442858c6.jpg',
'Width': 1280}],
'price': 35795,
'price_includes_vat': True,
'registration_date': '2025-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback Limited 2.5 5dr Estate CVT Petrol',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2025}
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511288203102%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511288203102: {'created_time': 1774883296.544909, 'last_price_update_time': 1774883296.544919}
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511288203102') HTTP/1.1" 204 0
2026-03-30 15:08:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c0fcc14a-9199-5702-8e86-34be1be22565 with identifier 202601269435260
2026-03-30 15:08:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c0fcc14a-9199-5702-8e86-34be1be22565
2026-03-30 15:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 220,
'color': 'Red',
'currency': 'GBP',
'description': 'This 2022 Isuzu D Max DL40 presents an exceptional ownership '
'proposition with its remarkably low mileage of just over '
'22,900 miles, a testament to its single owner and full '
'service history. This Euro 6 compliant, four wheel drive '
'model is powered by an efficient 1.9L diesel engine, offering '
'robust performance for any task. The DL40 trim level comes '
'equipped with desirable features such as Bi-LED headlights '
'for enhanced visibility, a convenient keyless entry and push '
'button start system, and Bluetooth connectivity for seamless '
'integration of your devices.\n'
'\n'
'Further enhancing the driving experience, this D Max includes '
'a reversing camera to aid with parking manoeuvres and dual '
'zone climate control, ensuring comfort for both driver and '
"passengers. These features, combined with the vehicle's "
'excellent provenance and low mileage, clearly set this 2022 '
'Isuzu D Max DL40 apart from other similar vehicles on the '
'market, offering a compelling blend of capability, comfort, '
'and value.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': 'c0fcc14a-9199-5702-8e86-34be1be22565',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269435260',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 22934,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photo_urls': ['https://m.atcdn.co.uk/a/media/e9e68e1b45544b3da91d981392d5b630.jpg',
'https://m.atcdn.co.uk/a/media/e1e5803271864a28b41e7a64ce0784d3.jpg',
'https://m.atcdn.co.uk/a/media/53957ec7c07c40f599dd126420552178.jpg',
'https://m.atcdn.co.uk/a/media/035182a6590e465ea731a9e0486b4fe2.jpg',
'https://m.atcdn.co.uk/a/media/d1a44389c8484a80b399f7a277ade370.jpg',
'https://m.atcdn.co.uk/a/media/a03d2a14fce94a6fa99b5f5a222e9a28.jpg',
'https://m.atcdn.co.uk/a/media/499e579b2b8144c68e3242bbc17a7316.jpg',
'https://m.atcdn.co.uk/a/media/3e388e5a7eb84e7288d1fa1d2ad7c1f0.jpg',
'https://m.atcdn.co.uk/a/media/9f7eb86c53324e2bac5cf734620ccd8d.jpg',
'https://m.atcdn.co.uk/a/media/f82428bdc7114b0b85472d896c2fb7e6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223299,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9e68e1b45544b3da91d981392d5b630.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165368,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e1e5803271864a28b41e7a64ce0784d3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172721,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/53957ec7c07c40f599dd126420552178.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206986,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/035182a6590e465ea731a9e0486b4fe2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217466,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1a44389c8484a80b399f7a277ade370.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190372,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a03d2a14fce94a6fa99b5f5a222e9a28.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134316,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/499e579b2b8144c68e3242bbc17a7316.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171630,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e388e5a7eb84e7288d1fa1d2ad7c1f0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173649,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f7eb86c53324e2bac5cf734620ccd8d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0fcc14a-9199-5702-8e86-34be1be22565/c0fcc14a-9199-5702-8e86-34be1be22565_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227128,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f82428bdc7114b0b85472d896c2fb7e6.jpg',
'Width': 1280}],
'price': 32394,
'price_includes_vat': True,
'registration_date': '2022-05-25',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max 1.9 TD DL40 Pickup Double Cab 4dr Diesel Manual 4WD '
'Euro 6 (s/s) (164 ps)',
'transmission': 'manual',
'trim': 'DL40',
'year': 2022}
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269435260%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269435260: {'created_time': 1774883296.599002, 'last_price_update_time': 1774883296.599012}
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269435260') HTTP/1.1" 204 0
2026-03-30 15:08:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 01fc7d13-4328-5895-a255-efeccf44537a with identifier: 202511228070362
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01fc7d13-4328-5895-a255-efeccf44537a
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4ff08ca346c4c05b564be30037e83fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4ff08ca346c4c05b564be30037e83fd.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F415e645343e34c29a27f1905cbac22d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/415e645343e34c29a27f1905cbac22d4.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e45d93b852a47e5afddf53e2a4aeb8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e45d93b852a47e5afddf53e2a4aeb8e.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e8db607f33c4e00841f0f196476c5af.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e8db607f33c4e00841f0f196476c5af.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1cda89b6fdfd466e8c600ec084ed9749.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1cda89b6fdfd466e8c600ec084ed9749.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F599f4a8af6f741f19ea67e1352a73e6d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/599f4a8af6f741f19ea67e1352a73e6d.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa748d902225442c499817e5e8e410218.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a748d902225442c499817e5e8e410218.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffafee97e91954d6a880ab017759bbb34.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fafee97e91954d6a880ab017759bbb34.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3953fd2a5f234fa880b330f8e3f4d84b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3953fd2a5f234fa880b330f8e3f4d84b.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3de55ce3320747a09a5d18a0554b2d8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3de55ce3320747a09a5d18a0554b2d8f.jpg already downloaded
2026-03-30 15:08:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 01fc7d13-4328-5895-a255-efeccf44537a with identifier 202511228070362
2026-03-30 15:08:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 01fc7d13-4328-5895-a255-efeccf44537a
2026-03-30 15:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 230,
'color': 'Silver',
'currency': 'GBP',
'description': 'Performance - Drive with confidence in the GWM POER300. With '
'its turbocharged engine, responsive transmission and '
'impressive towing power, you’ll be ready to tackle any '
'challenge.\n'
'\n'
'Tech- Make every journey a pleasure with innovative safety '
'features and driver assistance systems embedded to give you '
'peace of mind. Stay connected with Apple CarPlay and Android '
'Auto standard across the range. Enjoy features like Wireless '
'Charging, Smart Keyless Entry and Push Button Start to make '
'everyday practical.\n'
'\n'
'More power. More performance. More possibilities with 5 '
'years/125,000 miles warranty.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 180,
'fuel_type': 'Diesel',
'id': '01fc7d13-4328-5895-a255-efeccf44537a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511228070362',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'POER300',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c4ff08ca346c4c05b564be30037e83fd.jpg',
'https://m.atcdn.co.uk/a/media/415e645343e34c29a27f1905cbac22d4.jpg',
'https://m.atcdn.co.uk/a/media/8e45d93b852a47e5afddf53e2a4aeb8e.jpg',
'https://m.atcdn.co.uk/a/media/5e8db607f33c4e00841f0f196476c5af.jpg',
'https://m.atcdn.co.uk/a/media/1cda89b6fdfd466e8c600ec084ed9749.jpg',
'https://m.atcdn.co.uk/a/media/599f4a8af6f741f19ea67e1352a73e6d.jpg',
'https://m.atcdn.co.uk/a/media/a748d902225442c499817e5e8e410218.jpg',
'https://m.atcdn.co.uk/a/media/fafee97e91954d6a880ab017759bbb34.jpg',
'https://m.atcdn.co.uk/a/media/3953fd2a5f234fa880b330f8e3f4d84b.jpg',
'https://m.atcdn.co.uk/a/media/3de55ce3320747a09a5d18a0554b2d8f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227213,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c4ff08ca346c4c05b564be30037e83fd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115004,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/415e645343e34c29a27f1905cbac22d4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144960,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8e45d93b852a47e5afddf53e2a4aeb8e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215260,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e8db607f33c4e00841f0f196476c5af.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229925,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1cda89b6fdfd466e8c600ec084ed9749.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210042,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/599f4a8af6f741f19ea67e1352a73e6d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135105,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a748d902225442c499817e5e8e410218.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184710,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fafee97e91954d6a880ab017759bbb34.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181689,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3953fd2a5f234fa880b330f8e3f4d84b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3394c0a3-4035-5ae3-9f73-a06fe2a803f9/3394c0a3-4035-5ae3-9f73-a06fe2a803f9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237969,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3de55ce3320747a09a5d18a0554b2d8f.jpg',
'Width': 1280}],
'price': 41994,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'GWM POER300 Ultra 2.4 4dr PickUp Automatic Diesel',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2026}
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511228070362%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511228070362: {'created_time': 1774883296.852445, 'last_price_update_time': 1774883296.85246}
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511228070362') HTTP/1.1" 204 0
2026-03-30 15:08:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 18f9b6c5-b50c-55a6-baad-1dada97c8a39 with identifier: 202511208024452
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18f9b6c5-b50c-55a6-baad-1dada97c8a39
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0785e6830a2542f5bde08dd9ecbe9352.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0785e6830a2542f5bde08dd9ecbe9352.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb61aad61589748f4b567d55857712ae4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b61aad61589748f4b567d55857712ae4.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb15fef310d64a0ab2db4289da4422e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb15fef310d64a0ab2db4289da4422e6.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29a197be5af54818891f2472a9283989.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29a197be5af54818891f2472a9283989.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c2644efa7dd48d7a1decc12d9d18460.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c2644efa7dd48d7a1decc12d9d18460.jpg already downloaded
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4342c831644e4668ba9aa5221e319531.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4342c831644e4668ba9aa5221e319531.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8d84f3d474a846c59112e59980ac6fb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8d84f3d474a846c59112e59980ac6fb0.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea9bacf645ba4a1eadd73048509fdf03.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea9bacf645ba4a1eadd73048509fdf03.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd395adfdb6404bc98e24399eb1f23087.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d395adfdb6404bc98e24399eb1f23087.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F319f26eb27d5460ea09c0a9bd18743b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/319f26eb27d5460ea09c0a9bd18743b5.jpg already downloaded
2026-03-30 15:08:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 18f9b6c5-b50c-55a6-baad-1dada97c8a39 with identifier 202511208024452
2026-03-30 15:08:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 18f9b6c5-b50c-55a6-baad-1dada97c8a39
2026-03-30 15:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 230,
'color': 'Silver',
'currency': 'GBP',
'description': 'Performance - Drive with confidence in the GWM POER300. With '
'its turbocharged engine, responsive transmission and '
'impressive towing power, you’ll be ready to tackle any '
'challenge.\n'
'\n'
'Tech- Make every journey a pleasure with innovative safety '
'features and driver assistance systems embedded to give you '
'peace of mind. Stay connected with Apple CarPlay and Android '
'Auto standard across the range. Enjoy features like Wireless '
'Charging, Smart Keyless Entry and Push Button Start to make '
'everyday practical.\n'
'\n'
'More power. More performance. More possibilities with 5 '
'years/125,000 miles warranty.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 180,
'fuel_type': 'Diesel',
'id': '18f9b6c5-b50c-55a6-baad-1dada97c8a39',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511208024452',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'POER300',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/0785e6830a2542f5bde08dd9ecbe9352.jpg',
'https://m.atcdn.co.uk/a/media/b61aad61589748f4b567d55857712ae4.jpg',
'https://m.atcdn.co.uk/a/media/bb15fef310d64a0ab2db4289da4422e6.jpg',
'https://m.atcdn.co.uk/a/media/29a197be5af54818891f2472a9283989.jpg',
'https://m.atcdn.co.uk/a/media/8c2644efa7dd48d7a1decc12d9d18460.jpg',
'https://m.atcdn.co.uk/a/media/4342c831644e4668ba9aa5221e319531.jpg',
'https://m.atcdn.co.uk/a/media/8d84f3d474a846c59112e59980ac6fb0.jpg',
'https://m.atcdn.co.uk/a/media/ea9bacf645ba4a1eadd73048509fdf03.jpg',
'https://m.atcdn.co.uk/a/media/d395adfdb6404bc98e24399eb1f23087.jpg',
'https://m.atcdn.co.uk/a/media/319f26eb27d5460ea09c0a9bd18743b5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192280,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0785e6830a2542f5bde08dd9ecbe9352.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117676,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b61aad61589748f4b567d55857712ae4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131689,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb15fef310d64a0ab2db4289da4422e6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195648,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/29a197be5af54818891f2472a9283989.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225237,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c2644efa7dd48d7a1decc12d9d18460.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193431,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4342c831644e4668ba9aa5221e319531.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136785,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8d84f3d474a846c59112e59980ac6fb0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173493,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea9bacf645ba4a1eadd73048509fdf03.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196837,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d395adfdb6404bc98e24399eb1f23087.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85779325-913b-5b21-abc2-86cefcb91693/85779325-913b-5b21-abc2-86cefcb91693_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230920,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/319f26eb27d5460ea09c0a9bd18743b5.jpg',
'Width': 1280}],
'price': 38394,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'GWM POER300 Lux 2.4 4dr PickUp Automatic Diesel',
'transmission': 'automatic',
'trim': 'Lux',
'year': 2026}
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208024452%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511208024452: {'created_time': 1774883297.151578, 'last_price_update_time': 1774883297.151589}
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511208024452') HTTP/1.1" 204 0
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fbacc2ae-c008-5246-a6c2-1fe19238d38e with identifier: 202511197999123
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbacc2ae-c008-5246-a6c2-1fe19238d38e
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9aaaf2a3f184e78ae40ebdf9a6cfb45.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9aaaf2a3f184e78ae40ebdf9a6cfb45.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb0fc79ebcf94ac8b6a6aad0a53f67ad.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb0fc79ebcf94ac8b6a6aad0a53f67ad.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3d710c9b293a4b1e8707a8141fb8f707.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3d710c9b293a4b1e8707a8141fb8f707.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28cc1de52fe149c78da4b82faf59f74e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28cc1de52fe149c78da4b82faf59f74e.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F15d3f923288c4b89a9b6182b5c3b7616.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/15d3f923288c4b89a9b6182b5c3b7616.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff799fa19d4b94b6fa0221db0a0756fb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f799fa19d4b94b6fa0221db0a0756fb7.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fabf830f516bb4dc0b62842d33188cb72.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/abf830f516bb4dc0b62842d33188cb72.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3261ec92a7648809f93d68a4e862a56.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3261ec92a7648809f93d68a4e862a56.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbac4353b323147a28690db52908cdd7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bac4353b323147a28690db52908cdd7c.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F82a604a139814a58baf945ab5c275f04.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/82a604a139814a58baf945ab5c275f04.jpg already downloaded
2026-03-30 15:08:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fbacc2ae-c008-5246-a6c2-1fe19238d38e with identifier 202511197999123
2026-03-30 15:08:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fbacc2ae-c008-5246-a6c2-1fe19238d38e
2026-03-30 15:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Blue',
'currency': 'GBP',
'description': 'Performance - With a 1.5L hybrid engine, the most powerful '
'electric motor in its class. Enjoy better performance, '
'improved fuel efficiency and a smoother drive – all without '
'plugging in.\n'
'\n'
'Design -Stand out with more style. A specially-designed, '
'sleek aerodynamic sports exterior kit, full-width rear '
'lightbar and LED headlights come as standard, giving your car '
'a bold and unique look.\n'
'\n'
'Safety - You deserve more innovative safety features. With a '
'comprehensive ADAS package, from Adaptive Cruise Control to '
'Automatic Emergency Braking and Blind Spot Detection, you’ll '
'always feel protected.\n'
'\n'
'Infotainment - Stay connected with more tech at your '
'fingertips. A 12.3” infotainment display, complete with '
'Bluetooth, Apple CarPlay and Android Auto meaning every '
'journey is as entertaining as it is effortless.\n'
'\n'
'Elegant design, efficient hybrid performance with 5 years '
'unlimited mileage vehicle warranty.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 186,
'fuel_type': 'Petrol Hybrid',
'id': 'fbacc2ae-c008-5246-a6c2-1fe19238d38e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511197999123',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'Haval Jolion Pro',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b9aaaf2a3f184e78ae40ebdf9a6cfb45.jpg',
'https://m.atcdn.co.uk/a/media/eb0fc79ebcf94ac8b6a6aad0a53f67ad.jpg',
'https://m.atcdn.co.uk/a/media/3d710c9b293a4b1e8707a8141fb8f707.jpg',
'https://m.atcdn.co.uk/a/media/28cc1de52fe149c78da4b82faf59f74e.jpg',
'https://m.atcdn.co.uk/a/media/15d3f923288c4b89a9b6182b5c3b7616.jpg',
'https://m.atcdn.co.uk/a/media/f799fa19d4b94b6fa0221db0a0756fb7.jpg',
'https://m.atcdn.co.uk/a/media/abf830f516bb4dc0b62842d33188cb72.jpg',
'https://m.atcdn.co.uk/a/media/f3261ec92a7648809f93d68a4e862a56.jpg',
'https://m.atcdn.co.uk/a/media/bac4353b323147a28690db52908cdd7c.jpg',
'https://m.atcdn.co.uk/a/media/82a604a139814a58baf945ab5c275f04.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212575,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9aaaf2a3f184e78ae40ebdf9a6cfb45.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148683,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eb0fc79ebcf94ac8b6a6aad0a53f67ad.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151740,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3d710c9b293a4b1e8707a8141fb8f707.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184852,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/28cc1de52fe149c78da4b82faf59f74e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191035,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/15d3f923288c4b89a9b6182b5c3b7616.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212212,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f799fa19d4b94b6fa0221db0a0756fb7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159065,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/abf830f516bb4dc0b62842d33188cb72.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187924,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3261ec92a7648809f93d68a4e862a56.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164336,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bac4353b323147a28690db52908cdd7c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbacc2ae-c008-5246-a6c2-1fe19238d38e/fbacc2ae-c008-5246-a6c2-1fe19238d38e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220645,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/82a604a139814a58baf945ab5c275f04.jpg',
'Width': 1280}],
'price': 23995,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'GWM Haval Jolion Pro Premium 1.5 5dr SUV Automatic Petrol/Hybrid',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2026}
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511197999123%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511197999123: {'created_time': 1774883297.424068, 'last_price_update_time': 1774883297.424079}
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511197999123') HTTP/1.1" 204 0
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fcbf7043-8336-5d84-83af-a9e9b8c58bd5 with identifier: 202511197998852
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcbf7043-8336-5d84-83af-a9e9b8c58bd5
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4984a088335849f681e70050ed2e1f95.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4984a088335849f681e70050ed2e1f95.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a29d38b842643d18be06aa5e5e319a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a29d38b842643d18be06aa5e5e319a9.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44d4b68f8b964dd1972238fd4d102f40.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44d4b68f8b964dd1972238fd4d102f40.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5a9a0f5cf5cd4d33b0468093875837ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5a9a0f5cf5cd4d33b0468093875837ff.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcda1cea370f54dffa99318cfc845ea13.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cda1cea370f54dffa99318cfc845ea13.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac6819fbf4e948b79b28809099fe6b57.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac6819fbf4e948b79b28809099fe6b57.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f56e414b7c747e69f0075977e3d60f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f56e414b7c747e69f0075977e3d60f5.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fffe16b5ee3524799b83ecbc181614fea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ffe16b5ee3524799b83ecbc181614fea.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf36795602284d41a6a3b31db6b7c187.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf36795602284d41a6a3b31db6b7c187.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd7ffdb77fbf14f9f8590881d2e52f427.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d7ffdb77fbf14f9f8590881d2e52f427.jpg already downloaded
2026-03-30 15:08:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fcbf7043-8336-5d84-83af-a9e9b8c58bd5 with identifier 202511197998852
2026-03-30 15:08:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fcbf7043-8336-5d84-83af-a9e9b8c58bd5
2026-03-30 15:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 230,
'color': 'Red',
'currency': 'GBP',
'description': 'Performance - Drive with confidence in the GWM POER300. With '
'its turbocharged engine, responsive transmission and '
'impressive towing power, you’ll be ready to tackle any '
'challenge.\n'
'\n'
'Tech- Make every journey a pleasure with innovative safety '
'features and driver assistance systems embedded to give you '
'peace of mind. Stay connected with Apple CarPlay and Android '
'Auto standard across the range. Enjoy features like Wireless '
'Charging, Smart Keyless Entry and Push Button Start to make '
'everyday practical.\n'
'\n'
'More power. More performance. More possibilities with 5 '
'years/125,000 miles warranty.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 180,
'fuel_type': 'Diesel',
'id': 'fcbf7043-8336-5d84-83af-a9e9b8c58bd5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511197998852',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'POER300',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4984a088335849f681e70050ed2e1f95.jpg',
'https://m.atcdn.co.uk/a/media/3a29d38b842643d18be06aa5e5e319a9.jpg',
'https://m.atcdn.co.uk/a/media/44d4b68f8b964dd1972238fd4d102f40.jpg',
'https://m.atcdn.co.uk/a/media/5a9a0f5cf5cd4d33b0468093875837ff.jpg',
'https://m.atcdn.co.uk/a/media/cda1cea370f54dffa99318cfc845ea13.jpg',
'https://m.atcdn.co.uk/a/media/ac6819fbf4e948b79b28809099fe6b57.jpg',
'https://m.atcdn.co.uk/a/media/9f56e414b7c747e69f0075977e3d60f5.jpg',
'https://m.atcdn.co.uk/a/media/ffe16b5ee3524799b83ecbc181614fea.jpg',
'https://m.atcdn.co.uk/a/media/cf36795602284d41a6a3b31db6b7c187.jpg',
'https://m.atcdn.co.uk/a/media/d7ffdb77fbf14f9f8590881d2e52f427.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198300,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4984a088335849f681e70050ed2e1f95.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83112,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3a29d38b842643d18be06aa5e5e319a9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113693,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/44d4b68f8b964dd1972238fd4d102f40.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183209,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5a9a0f5cf5cd4d33b0468093875837ff.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199579,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cda1cea370f54dffa99318cfc845ea13.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180655,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac6819fbf4e948b79b28809099fe6b57.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143030,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f56e414b7c747e69f0075977e3d60f5.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153537,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ffe16b5ee3524799b83ecbc181614fea.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169930,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf36795602284d41a6a3b31db6b7c187.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cabbf4-d725-5f95-9c6c-dd8d58592ea8/b8cabbf4-d725-5f95-9c6c-dd8d58592ea8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214910,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d7ffdb77fbf14f9f8590881d2e52f427.jpg',
'Width': 1280}],
'price': 41994,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'GWM POER300 Ultra 2.4 4dr Pickup Automatic Diesel',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2026}
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511197998852%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511197998852: {'created_time': 1774883297.688137, 'last_price_update_time': 1774883297.688151}
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511197998852') HTTP/1.1" 204 0
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: afc60221-e3ff-5bf4-bad0-c9f5c9f1d0b4 with identifier: 202510317555316
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afc60221-e3ff-5bf4-bad0-c9f5c9f1d0b4
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0e499f323ae4eb2b80871eb027902ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0e499f323ae4eb2b80871eb027902ee.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4303a73023554978aefe5821e7157bf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4303a73023554978aefe5821e7157bf9.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcface8e007ff44df85efea851473c93b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cface8e007ff44df85efea851473c93b.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29f685596d3e41e8813d2865050b073a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29f685596d3e41e8813d2865050b073a.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe50841f49b3c4ce0aa2af8ed6019aaca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e50841f49b3c4ce0aa2af8ed6019aaca.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc948d81e44b94e3a8eb0c411fa3b45c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c948d81e44b94e3a8eb0c411fa3b45c9.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2859eeadb4b4390aef0cbe6cb61d1b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2859eeadb4b4390aef0cbe6cb61d1b3.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fd032ddc0784589a270743b902ac6cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fd032ddc0784589a270743b902ac6cc.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F82270de906c7487e9df916a13517ed7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/82270de906c7487e9df916a13517ed7e.jpg already downloaded
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fab8473eb5e834424a8b8c960173b4264.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ab8473eb5e834424a8b8c960173b4264.jpg already downloaded
2026-03-30 15:08:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: afc60221-e3ff-5bf4-bad0-c9f5c9f1d0b4 with identifier 202510317555316
2026-03-30 15:08:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item afc60221-e3ff-5bf4-bad0-c9f5c9f1d0b4
2026-03-30 15:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Blue',
'currency': 'GBP',
'description': 'CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': 'afc60221-e3ff-5bf4-bad0-c9f5c9f1d0b4',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510317555316',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c0e499f323ae4eb2b80871eb027902ee.jpg',
'https://m.atcdn.co.uk/a/media/4303a73023554978aefe5821e7157bf9.jpg',
'https://m.atcdn.co.uk/a/media/cface8e007ff44df85efea851473c93b.jpg',
'https://m.atcdn.co.uk/a/media/29f685596d3e41e8813d2865050b073a.jpg',
'https://m.atcdn.co.uk/a/media/e50841f49b3c4ce0aa2af8ed6019aaca.jpg',
'https://m.atcdn.co.uk/a/media/c948d81e44b94e3a8eb0c411fa3b45c9.jpg',
'https://m.atcdn.co.uk/a/media/f2859eeadb4b4390aef0cbe6cb61d1b3.jpg',
'https://m.atcdn.co.uk/a/media/4fd032ddc0784589a270743b902ac6cc.jpg',
'https://m.atcdn.co.uk/a/media/82270de906c7487e9df916a13517ed7e.jpg',
'https://m.atcdn.co.uk/a/media/ab8473eb5e834424a8b8c960173b4264.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215426,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c0e499f323ae4eb2b80871eb027902ee.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164533,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4303a73023554978aefe5821e7157bf9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168857,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cface8e007ff44df85efea851473c93b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209708,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/29f685596d3e41e8813d2865050b073a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198093,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e50841f49b3c4ce0aa2af8ed6019aaca.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176043,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c948d81e44b94e3a8eb0c411fa3b45c9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148966,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2859eeadb4b4390aef0cbe6cb61d1b3.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180300,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4fd032ddc0784589a270743b902ac6cc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184095,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/82270de906c7487e9df916a13517ed7e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1bd97ef6-549a-558f-af28-7aff2aa8815b/1bd97ef6-549a-558f-af28-7aff2aa8815b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224328,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ab8473eb5e834424a8b8c960173b4264.jpg',
'Width': 1280}],
'price': 42995,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback Field 2.5 5dr Estate CVT Petrol',
'transmission': 'automatic',
'trim': 'Field',
'year': 2026}
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510317555316%27 HTTP/1.1" 200 None
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510317555316: {'created_time': 1774883297.949892, 'last_price_update_time': 1774883297.949905}
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510317555316') HTTP/1.1" 204 0
2026-03-30 15:08:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f50f6575-66c2-5adc-98bd-eaf58f930ef9 with identifier: 202510317555028
2026-03-30 15:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f50f6575-66c2-5adc-98bd-eaf58f930ef9
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd700dd0955b240aba077757b17804e85.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d700dd0955b240aba077757b17804e85.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc859e0bef5a94882b2b0b29e62d97781.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c859e0bef5a94882b2b0b29e62d97781.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9fbe939ba47140c19d91550d1ea752a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9fbe939ba47140c19d91550d1ea752a9.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F22f91711c88d477786e67b6b7009cc09.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/22f91711c88d477786e67b6b7009cc09.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e3a7f1228a24d92ac92512fd48335f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e3a7f1228a24d92ac92512fd48335f9.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcbc983e693db41d5ae657046be5d8114.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cbc983e693db41d5ae657046be5d8114.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8bd30643bdc4ea4963b7f1f2254b7ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8bd30643bdc4ea4963b7f1f2254b7ab.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc72e49daa53e40e68ab71d279ad3f9d6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c72e49daa53e40e68ab71d279ad3f9d6.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F301a3cdc54594beaaa946f999c61c9b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/301a3cdc54594beaaa946f999c61c9b7.jpg already downloaded
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdeee1aa5345b4e7da1bbc0be0a31cc63.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/deee1aa5345b4e7da1bbc0be0a31cc63.jpg already downloaded
2026-03-30 15:08:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f50f6575-66c2-5adc-98bd-eaf58f930ef9 with identifier 202510317555028
2026-03-30 15:08:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f50f6575-66c2-5adc-98bd-eaf58f930ef9
2026-03-30 15:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 183,
'color': 'Grey',
'currency': 'GBP',
'description': 'CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': 'f50f6575-66c2-5adc-98bd-eaf58f930ef9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510317555028',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Forester',
'odometer': 10,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 48,
'photo_urls': ['https://m.atcdn.co.uk/a/media/d700dd0955b240aba077757b17804e85.jpg',
'https://m.atcdn.co.uk/a/media/c859e0bef5a94882b2b0b29e62d97781.jpg',
'https://m.atcdn.co.uk/a/media/9fbe939ba47140c19d91550d1ea752a9.jpg',
'https://m.atcdn.co.uk/a/media/22f91711c88d477786e67b6b7009cc09.jpg',
'https://m.atcdn.co.uk/a/media/5e3a7f1228a24d92ac92512fd48335f9.jpg',
'https://m.atcdn.co.uk/a/media/cbc983e693db41d5ae657046be5d8114.jpg',
'https://m.atcdn.co.uk/a/media/d8bd30643bdc4ea4963b7f1f2254b7ab.jpg',
'https://m.atcdn.co.uk/a/media/c72e49daa53e40e68ab71d279ad3f9d6.jpg',
'https://m.atcdn.co.uk/a/media/301a3cdc54594beaaa946f999c61c9b7.jpg',
'https://m.atcdn.co.uk/a/media/deee1aa5345b4e7da1bbc0be0a31cc63.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210348,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d700dd0955b240aba077757b17804e85.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170879,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c859e0bef5a94882b2b0b29e62d97781.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173651,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9fbe939ba47140c19d91550d1ea752a9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196452,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/22f91711c88d477786e67b6b7009cc09.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199601,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e3a7f1228a24d92ac92512fd48335f9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197525,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cbc983e693db41d5ae657046be5d8114.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159175,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d8bd30643bdc4ea4963b7f1f2254b7ab.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196456,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c72e49daa53e40e68ab71d279ad3f9d6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186151,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/301a3cdc54594beaaa946f999c61c9b7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91cde2fb-4fea-5d57-8ec7-25156c49b34b/91cde2fb-4fea-5d57-8ec7-25156c49b34b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226088,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/deee1aa5345b4e7da1bbc0be0a31cc63.jpg',
'Width': 1280}],
'price': 36995,
'price_includes_vat': True,
'registration_date': '2026-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester Limited 2.0 5dr Estate CVT Petrol/Electric',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2025}
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510317555028%27 HTTP/1.1" 200 None
2026-03-30 15:08:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510317555028: {'created_time': 1774883298.311633, 'last_price_update_time': 1774883298.311647}
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510317555028') HTTP/1.1" 204 0
2026-03-30 15:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0ff3fc-5127-58cd-ae07-444ba38954b5 with identifier: 202510217309096
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f0ff3fc-5127-58cd-ae07-444ba38954b5
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F065195756ff64e4cb05c9c13941eb345.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/065195756ff64e4cb05c9c13941eb345.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78ba4611765d4f37a5401eca68d4a535.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78ba4611765d4f37a5401eca68d4a535.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc8c07cfc158414f85ebfa78099d7e0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc8c07cfc158414f85ebfa78099d7e0f.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F378d627540774e78ad93781933cbec64.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/378d627540774e78ad93781933cbec64.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa61e8dd8c183464ab515f4d22365bb0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a61e8dd8c183464ab515f4d22365bb0e.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd65eac4b8a4c4ef9bd08066e39eb8489.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d65eac4b8a4c4ef9bd08066e39eb8489.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb58b275a0074fae97393e8232fb1203.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb58b275a0074fae97393e8232fb1203.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb11abf9b14594e39bb779e050601fd57.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b11abf9b14594e39bb779e050601fd57.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7895612a654a41f9adee4041f9f6e726.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7895612a654a41f9adee4041f9f6e726.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b3e34e3fd0346f39024b2bdd532c9d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b3e34e3fd0346f39024b2bdd532c9d1.jpg already downloaded
2026-03-30 15:08:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7f0ff3fc-5127-58cd-ae07-444ba38954b5 with identifier 202510217309096
2026-03-30 15:08:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7f0ff3fc-5127-58cd-ae07-444ba38954b5
2026-03-30 15:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Blue',
'currency': 'GBP',
'description': 'APPLE CAR PLAY ¦ REVERSING CAMERA ¦ ADAPTIVE CRUISE CONTROL ¦ '
'5 YEAR WARRANTY',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 186,
'fuel_type': 'Petrol Hybrid',
'id': '7f0ff3fc-5127-58cd-ae07-444ba38954b5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510217309096',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'Haval Jolion Pro',
'odometer': 1500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photo_urls': ['https://m.atcdn.co.uk/a/media/065195756ff64e4cb05c9c13941eb345.jpg',
'https://m.atcdn.co.uk/a/media/78ba4611765d4f37a5401eca68d4a535.jpg',
'https://m.atcdn.co.uk/a/media/bc8c07cfc158414f85ebfa78099d7e0f.jpg',
'https://m.atcdn.co.uk/a/media/378d627540774e78ad93781933cbec64.jpg',
'https://m.atcdn.co.uk/a/media/a61e8dd8c183464ab515f4d22365bb0e.jpg',
'https://m.atcdn.co.uk/a/media/d65eac4b8a4c4ef9bd08066e39eb8489.jpg',
'https://m.atcdn.co.uk/a/media/bb58b275a0074fae97393e8232fb1203.jpg',
'https://m.atcdn.co.uk/a/media/b11abf9b14594e39bb779e050601fd57.jpg',
'https://m.atcdn.co.uk/a/media/7895612a654a41f9adee4041f9f6e726.jpg',
'https://m.atcdn.co.uk/a/media/4b3e34e3fd0346f39024b2bdd532c9d1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225959,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/065195756ff64e4cb05c9c13941eb345.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204895,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/78ba4611765d4f37a5401eca68d4a535.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224812,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc8c07cfc158414f85ebfa78099d7e0f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206339,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/378d627540774e78ad93781933cbec64.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173845,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a61e8dd8c183464ab515f4d22365bb0e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186574,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d65eac4b8a4c4ef9bd08066e39eb8489.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172292,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb58b275a0074fae97393e8232fb1203.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196905,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b11abf9b14594e39bb779e050601fd57.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137839,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7895612a654a41f9adee4041f9f6e726.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4813fa41-abb4-5192-84f4-8a485345a449/4813fa41-abb4-5192-84f4-8a485345a449_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97022,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b3e34e3fd0346f39024b2bdd532c9d1.jpg',
'Width': 1280}],
'price': 23495,
'price_includes_vat': True,
'registration_date': '2025-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'GWM Haval Jolion Pro 1.5 Lux SUV 5dr Petrol Hybrid DHT Euro 6 (s/s) '
'(189 ps)',
'transmission': 'automatic',
'trim': 'Lux',
'year': 2025}
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510217309096%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510217309096: {'created_time': 1774883299.370171, 'last_price_update_time': 1774883299.370181}
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510217309096') HTTP/1.1" 204 0
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 446e46ab-715c-58a6-85cc-48b8582df680 with identifier: 202510207281701
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 446e46ab-715c-58a6-85cc-48b8582df680
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f7249e0b3314faa9c3703be74eaaa72.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f7249e0b3314faa9c3703be74eaaa72.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7d07434bb5494bf1881d532009138e30.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7d07434bb5494bf1881d532009138e30.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24c0a4b36e734e0cb724b47085bccdf4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24c0a4b36e734e0cb724b47085bccdf4.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7fbcd23bddcf435d95ded75331f60e34.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7fbcd23bddcf435d95ded75331f60e34.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fddec570e77ea470bbc071791f3ec4c7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ddec570e77ea470bbc071791f3ec4c7e.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c2bc06214614bbba7d5735ae251b92a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c2bc06214614bbba7d5735ae251b92a.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f4fbc623a604f029c57b1fc80bd9297.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f4fbc623a604f029c57b1fc80bd9297.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea4fda15521249dab574b39d2dd03637.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea4fda15521249dab574b39d2dd03637.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00ee4fde44d2400eaff5d934dd1df05f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00ee4fde44d2400eaff5d934dd1df05f.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6312bca976614462a37dda87ae8b706e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6312bca976614462a37dda87ae8b706e.jpg already downloaded
2026-03-30 15:08:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 446e46ab-715c-58a6-85cc-48b8582df680 with identifier 202510207281701
2026-03-30 15:08:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 446e46ab-715c-58a6-85cc-48b8582df680
2026-03-30 15:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Multicolour',
'currency': 'GBP',
'description': 'CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'engine_horse_power': 169,
'fuel_type': 'Electric',
'id': '446e46ab-715c-58a6-85cc-48b8582df680',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510207281701',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'ORA 03',
'odometer': 10,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9f7249e0b3314faa9c3703be74eaaa72.jpg',
'https://m.atcdn.co.uk/a/media/7d07434bb5494bf1881d532009138e30.jpg',
'https://m.atcdn.co.uk/a/media/24c0a4b36e734e0cb724b47085bccdf4.jpg',
'https://m.atcdn.co.uk/a/media/7fbcd23bddcf435d95ded75331f60e34.jpg',
'https://m.atcdn.co.uk/a/media/ddec570e77ea470bbc071791f3ec4c7e.jpg',
'https://m.atcdn.co.uk/a/media/2c2bc06214614bbba7d5735ae251b92a.jpg',
'https://m.atcdn.co.uk/a/media/8f4fbc623a604f029c57b1fc80bd9297.jpg',
'https://m.atcdn.co.uk/a/media/ea4fda15521249dab574b39d2dd03637.jpg',
'https://m.atcdn.co.uk/a/media/00ee4fde44d2400eaff5d934dd1df05f.jpg',
'https://m.atcdn.co.uk/a/media/6312bca976614462a37dda87ae8b706e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213435,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f7249e0b3314faa9c3703be74eaaa72.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130856,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7d07434bb5494bf1881d532009138e30.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143020,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/24c0a4b36e734e0cb724b47085bccdf4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216579,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7fbcd23bddcf435d95ded75331f60e34.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217901,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ddec570e77ea470bbc071791f3ec4c7e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190571,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c2bc06214614bbba7d5735ae251b92a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195910,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f4fbc623a604f029c57b1fc80bd9297.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202766,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea4fda15521249dab574b39d2dd03637.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181874,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/00ee4fde44d2400eaff5d934dd1df05f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d569c9f-860b-53ff-ae12-64d781676945/1d569c9f-860b-53ff-ae12-64d781676945_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215790,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6312bca976614462a37dda87ae8b706e.jpg',
'Width': 1280}],
'price': 15995,
'price_includes_vat': True,
'registration_date': '2026-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'GWM 03 Pure 0.0 5dr Hatchback Automatic Electric',
'transmission': 'automatic',
'trim': 'PURE',
'year': 2025}
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510207281701%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510207281701: {'created_time': 1774883299.613082, 'last_price_update_time': 1774883299.613092}
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510207281701') HTTP/1.1" 204 0
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 223bbbcc-f8d2-5db5-91c3-6002bcdb75b3 with identifier: 202510187244312
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 223bbbcc-f8d2-5db5-91c3-6002bcdb75b3
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9a2e0d4509c4102a650c7debdee9e84.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9a2e0d4509c4102a650c7debdee9e84.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe07c752e7f8d4ce9bf71c983b3e145a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e07c752e7f8d4ce9bf71c983b3e145a0.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69db3bb3353c47cab77feb4f266edd0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69db3bb3353c47cab77feb4f266edd0e.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa160a6b2e632483a9ec6a30d401f8332.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a160a6b2e632483a9ec6a30d401f8332.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b573f69630747628ed66489efb31cfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b573f69630747628ed66489efb31cfc.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F92321588577e40479d583f10290eca45.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/92321588577e40479d583f10290eca45.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F95adb049cad34fb2ba2f2f7db1ece413.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/95adb049cad34fb2ba2f2f7db1ece413.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7d7379b683694b1990d3473027dad66f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7d7379b683694b1990d3473027dad66f.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73b8a6670ef345a0b02b65b039d00a87.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73b8a6670ef345a0b02b65b039d00a87.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5e6755c85fe541fd9c16d1b2bfa2f85d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5e6755c85fe541fd9c16d1b2bfa2f85d.jpg already downloaded
2026-03-30 15:08:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 223bbbcc-f8d2-5db5-91c3-6002bcdb75b3 with identifier 202510187244312
2026-03-30 15:08:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 223bbbcc-f8d2-5db5-91c3-6002bcdb75b3
2026-03-30 15:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Grey',
'currency': 'GBP',
'description': 'APPLE CAR PLAY ¦ REVERSING CAMERA ¦ ADAPTIVE CRUISE CONTROL ¦ '
'5 YEAR WARRANTY',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1.5L',
'engine_horse_power': 186,
'fuel_type': 'Petrol Hybrid',
'id': '223bbbcc-f8d2-5db5-91c3-6002bcdb75b3',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510187244312',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'GWM',
'model': 'Haval Jolion Pro',
'odometer': 1800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f9a2e0d4509c4102a650c7debdee9e84.jpg',
'https://m.atcdn.co.uk/a/media/e07c752e7f8d4ce9bf71c983b3e145a0.jpg',
'https://m.atcdn.co.uk/a/media/69db3bb3353c47cab77feb4f266edd0e.jpg',
'https://m.atcdn.co.uk/a/media/a160a6b2e632483a9ec6a30d401f8332.jpg',
'https://m.atcdn.co.uk/a/media/9b573f69630747628ed66489efb31cfc.jpg',
'https://m.atcdn.co.uk/a/media/92321588577e40479d583f10290eca45.jpg',
'https://m.atcdn.co.uk/a/media/95adb049cad34fb2ba2f2f7db1ece413.jpg',
'https://m.atcdn.co.uk/a/media/7d7379b683694b1990d3473027dad66f.jpg',
'https://m.atcdn.co.uk/a/media/73b8a6670ef345a0b02b65b039d00a87.jpg',
'https://m.atcdn.co.uk/a/media/5e6755c85fe541fd9c16d1b2bfa2f85d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207366,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9a2e0d4509c4102a650c7debdee9e84.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119172,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e07c752e7f8d4ce9bf71c983b3e145a0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136814,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/69db3bb3353c47cab77feb4f266edd0e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199582,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a160a6b2e632483a9ec6a30d401f8332.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179830,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9b573f69630747628ed66489efb31cfc.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195874,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/92321588577e40479d583f10290eca45.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144477,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/95adb049cad34fb2ba2f2f7db1ece413.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183874,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7d7379b683694b1990d3473027dad66f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186605,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73b8a6670ef345a0b02b65b039d00a87.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d33cfe8-9496-5daa-8a24-070a26b35f1b/7d33cfe8-9496-5daa-8a24-070a26b35f1b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217001,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5e6755c85fe541fd9c16d1b2bfa2f85d.jpg',
'Width': 1280}],
'price': 23995,
'price_includes_vat': True,
'registration_date': '2025-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'GWM Haval Jolion Pro 1.5 Ultra SUV 5dr Petrol Hybrid DHT Euro 6 '
'(s/s) (189 ps)',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2025}
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510187244312%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510187244312: {'created_time': 1774883299.889594, 'last_price_update_time': 1774883299.889606}
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510187244312') HTTP/1.1" 204 0
2026-03-30 15:08:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ae9bf12c-42ef-5cf4-92c7-5119e62d4a16 with identifier: 202509306762637
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae9bf12c-42ef-5cf4-92c7-5119e62d4a16
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb9bd3a9c5aa401eb037d9d399e04fa7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db9bd3a9c5aa401eb037d9d399e04fa7.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F61f4e80a5c48402f9ea899a191ee1038.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/61f4e80a5c48402f9ea899a191ee1038.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F70b4b4fa69b445a9abca820dec23d398.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/70b4b4fa69b445a9abca820dec23d398.jpg already downloaded
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F61a7370d0c904970b60251f8df0d761e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/61a7370d0c904970b60251f8df0d761e.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe5e198a8797b496a85884c1c933b9481.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e5e198a8797b496a85884c1c933b9481.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb513610fde514b8faf7bd19bc66328cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b513610fde514b8faf7bd19bc66328cb.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F14012eff093441c19dc1044440f2589c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/14012eff093441c19dc1044440f2589c.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7519623ba9f24e70b1750779d6eb7c00.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7519623ba9f24e70b1750779d6eb7c00.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F941beb20fb8f4d8e83fc9b8a4d215d53.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/941beb20fb8f4d8e83fc9b8a4d215d53.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe2a1a9505eb045ffb72adcd7327699f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e2a1a9505eb045ffb72adcd7327699f2.jpg already downloaded
2026-03-30 15:08:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ae9bf12c-42ef-5cf4-92c7-5119e62d4a16 with identifier 202509306762637
2026-03-30 15:08:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ae9bf12c-42ef-5cf4-92c7-5119e62d4a16
2026-03-30 15:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 130,
'color': 'White',
'currency': 'GBP',
'description': 'This 2020 Toyota RAV4 VVT-h Excel presents an exceptional '
'ownership proposition with its remarkably low mileage of just '
'over 22,000 miles and a single owner. This Euro 6 compliant '
'2.5L Petrol Hybrid is presented in the Excel trim & boasts a '
"full Toyota service history. Inside, you'll find a wealth of "
'technology designed for comfort and convenience, including a '
'JBL Premium Sound System, Smartphone Integration with Apple '
'CarPlay and Android Auto, and a Skyview Panoramic Roof with '
'an opening sunroof. Parking is made effortless with front and '
'rear parking sensors and a Panoramic View Monitor offering a '
'360 degree camera view, further enhanced by Blind Spot '
'Monitor and Rear Cross Traffic Alert for added safety.\n'
'\n'
'The RAV4 VVT-h Excel excels in several key areas, '
'demonstrating its superiority over comparable vehicles. Its '
'impressive acceleration, reaching 0-62mph in just 8.1 '
'seconds, offers a dynamic driving experience. Furthermore, '
'its low insurance group rating contributes to lower running '
'costs, making it an economical choice. The generous boot '
'space provides ample room for luggage or shopping, catering '
'to families and active lifestyles alike. This combination of '
'performance, practicality, and advanced features makes this '
'RAV4 a truly outstanding option.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 215,
'fuel_type': 'Petrol Hybrid',
'id': 'ae9bf12c-42ef-5cf4-92c7-5119e62d4a16',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509306762637',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Toyota',
'model': 'RAV4',
'odometer': 22121,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/db9bd3a9c5aa401eb037d9d399e04fa7.jpg',
'https://m.atcdn.co.uk/a/media/61f4e80a5c48402f9ea899a191ee1038.jpg',
'https://m.atcdn.co.uk/a/media/70b4b4fa69b445a9abca820dec23d398.jpg',
'https://m.atcdn.co.uk/a/media/61a7370d0c904970b60251f8df0d761e.jpg',
'https://m.atcdn.co.uk/a/media/e5e198a8797b496a85884c1c933b9481.jpg',
'https://m.atcdn.co.uk/a/media/b513610fde514b8faf7bd19bc66328cb.jpg',
'https://m.atcdn.co.uk/a/media/14012eff093441c19dc1044440f2589c.jpg',
'https://m.atcdn.co.uk/a/media/7519623ba9f24e70b1750779d6eb7c00.jpg',
'https://m.atcdn.co.uk/a/media/941beb20fb8f4d8e83fc9b8a4d215d53.jpg',
'https://m.atcdn.co.uk/a/media/e2a1a9505eb045ffb72adcd7327699f2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190360,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db9bd3a9c5aa401eb037d9d399e04fa7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135631,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/61f4e80a5c48402f9ea899a191ee1038.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197786,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/61a7370d0c904970b60251f8df0d761e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133580,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/70b4b4fa69b445a9abca820dec23d398.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191493,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e5e198a8797b496a85884c1c933b9481.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182670,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b513610fde514b8faf7bd19bc66328cb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 131797,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/14012eff093441c19dc1044440f2589c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150275,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7519623ba9f24e70b1750779d6eb7c00.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154758,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/941beb20fb8f4d8e83fc9b8a4d215d53.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0375ac87-8b15-5b5a-bd46-923b65de3d27/0375ac87-8b15-5b5a-bd46-923b65de3d27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218799,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e2a1a9505eb045ffb72adcd7327699f2.jpg',
'Width': 1280}],
'price': 27495,
'price_includes_vat': True,
'registration_date': '2020-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV4 2.5 VVT-h Excel SUV 5dr Petrol Hybrid CVT Euro 6 (s/s) '
'(218 ps)',
'transmission': 'automatic',
'trim': 'Excel',
'year': 2020}
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306762637%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509306762637: {'created_time': 1774883300.148403, 'last_price_update_time': 1774883300.148416}
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509306762637') HTTP/1.1" 204 0
2026-03-30 15:08:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 56dd45c0-0d7d-5c29-b27e-08eb416b661b with identifier: 202508315919840
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56dd45c0-0d7d-5c29-b27e-08eb416b661b
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc1422a5c5db44f23ae673bf8d3f1686b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c1422a5c5db44f23ae673bf8d3f1686b.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F508c150001964d1f9421af6d1fced6a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/508c150001964d1f9421af6d1fced6a6.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27eac4ff4a6e448382d5a5c0bae4dcea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27eac4ff4a6e448382d5a5c0bae4dcea.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F67a1b9269acc4b34ac929ac5001a82b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/67a1b9269acc4b34ac929ac5001a82b9.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdbdb1d862ee045b0813033769efe9dc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dbdb1d862ee045b0813033769efe9dc4.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20fbc49dc7b14b56ab139cd7e8533e80.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20fbc49dc7b14b56ab139cd7e8533e80.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe408af08484a498f8922dcdcfa3e4dd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e408af08484a498f8922dcdcfa3e4dd8.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb012290c439f4abca138896c31d79aa8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b012290c439f4abca138896c31d79aa8.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbec132ed57894275b6195e453f557052.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bec132ed57894275b6195e453f557052.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa6c3579c584a4ceaa1204dd2fdd85a9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a6c3579c584a4ceaa1204dd2fdd85a9c.jpg already downloaded
2026-03-30 15:08:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 56dd45c0-0d7d-5c29-b27e-08eb416b661b with identifier 202508315919840
2026-03-30 15:08:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 56dd45c0-0d7d-5c29-b27e-08eb416b661b
2026-03-30 15:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 183,
'color': 'Grey',
'currency': 'GBP',
'description': '3 YEARS FREE SERVICING!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 134,
'fuel_type': 'Petrol Hybrid',
'id': '56dd45c0-0d7d-5c29-b27e-08eb416b661b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508315919840',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Forester',
'odometer': 1400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/c1422a5c5db44f23ae673bf8d3f1686b.jpg',
'https://m.atcdn.co.uk/a/media/508c150001964d1f9421af6d1fced6a6.jpg',
'https://m.atcdn.co.uk/a/media/27eac4ff4a6e448382d5a5c0bae4dcea.jpg',
'https://m.atcdn.co.uk/a/media/67a1b9269acc4b34ac929ac5001a82b9.jpg',
'https://m.atcdn.co.uk/a/media/dbdb1d862ee045b0813033769efe9dc4.jpg',
'https://m.atcdn.co.uk/a/media/20fbc49dc7b14b56ab139cd7e8533e80.jpg',
'https://m.atcdn.co.uk/a/media/e408af08484a498f8922dcdcfa3e4dd8.jpg',
'https://m.atcdn.co.uk/a/media/b012290c439f4abca138896c31d79aa8.jpg',
'https://m.atcdn.co.uk/a/media/bec132ed57894275b6195e453f557052.jpg',
'https://m.atcdn.co.uk/a/media/a6c3579c584a4ceaa1204dd2fdd85a9c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209617,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c1422a5c5db44f23ae673bf8d3f1686b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145634,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/508c150001964d1f9421af6d1fced6a6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145150,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/27eac4ff4a6e448382d5a5c0bae4dcea.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214044,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/67a1b9269acc4b34ac929ac5001a82b9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204281,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dbdb1d862ee045b0813033769efe9dc4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177392,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/20fbc49dc7b14b56ab139cd7e8533e80.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168260,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e408af08484a498f8922dcdcfa3e4dd8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179806,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b012290c439f4abca138896c31d79aa8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199582,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bec132ed57894275b6195e453f557052.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff7473e5-12ab-5d31-8c5e-f724315cb622/ff7473e5-12ab-5d31-8c5e-f724315cb622_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229765,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a6c3579c584a4ceaa1204dd2fdd85a9c.jpg',
'Width': 1280}],
'price': 38895,
'price_includes_vat': True,
'registration_date': '2025-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Forester 2.0 i e-Boxer Touring SUV 5dr Petrol Hybrid '
'Lineartronic 4WD Euro 6 (s/s) (136 ps)',
'transmission': 'automatic',
'trim': 'Touring',
'year': 2025}
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508315919840%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508315919840: {'created_time': 1774883300.391245, 'last_price_update_time': 1774883300.391257}
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508315919840') HTTP/1.1" 204 0
2026-03-30 15:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:08:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 99f35979-bfd9-5e78-a89b-ca99be16e19d with identifier: 202601149149574
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99f35979-bfd9-5e78-a89b-ca99be16e19d
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fefeb97c0f441401caa5ff1c1d78a11b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/efeb97c0f441401caa5ff1c1d78a11b8.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf0da6d438014d7baea81c3c9913a582.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df0da6d438014d7baea81c3c9913a582.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff8793ef9fb4447788b561ac7ed98d776.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f8793ef9fb4447788b561ac7ed98d776.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9bbc7b23860f439d96416ed125c9243f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9bbc7b23860f439d96416ed125c9243f.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe91a524ee38041dda07b3a62a02c9f5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e91a524ee38041dda07b3a62a02c9f5c.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3615f5f2c694c259ece9eb6aa902a4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3615f5f2c694c259ece9eb6aa902a4f.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F66cbad1f269845ae88e097e4295b9db8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/66cbad1f269845ae88e097e4295b9db8.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe5359afc26a549cd872a1451b84c4760.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e5359afc26a549cd872a1451b84c4760.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b03979447c84e25b2981e572b9616b9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b03979447c84e25b2981e572b9616b9.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b8dc8ae7ec84a4dba8602739511c0ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b8dc8ae7ec84a4dba8602739511c0ed.jpg already downloaded
2026-03-30 15:08:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 99f35979-bfd9-5e78-a89b-ca99be16e19d with identifier 202601149149574
2026-03-30 15:08:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 99f35979-bfd9-5e78-a89b-ca99be16e19d
2026-03-30 15:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2024 Toyota bZ4X Vision boasts exceptionally low mileage '
'for its age, having covered just over 10,000 miles and '
'benefits from a full Toyota service history. This electric, '
'Four Wheel Drive SUV features a 71 kWh battery offering a '
'maximum range of 260 miles. Charging at home with a 7kW '
'charger takes approximately 9 hours and 10 minutes, while '
'rapid public charging can replenish the battery from empty to '
'80% in as little as 34 minutes. Notable features include a '
"wireless mobile phone charger, driver's seat memory function, "
'a 12.3in HD Toyota Smart Connect multimedia system with '
'wireless Apple CarPlay and Android Auto, intelligent adaptive '
'cruise control, and front parking sensors with automatic '
'object braking.\n'
'\n'
'The Toyota bZ4X Vision stands out with its advanced '
'technology and practical capabilities. The inclusion of '
'wireless smartphone integration for both Apple CarPlay and '
'Android Auto, alongside the 12.3in HD Toyota Smart Connect '
'system, ensures seamless connectivity and entertainment. '
'Intelligent adaptive cruise control enhances the driving '
'experience by maintaining a set speed and distance from the '
'vehicle ahead, while front parking sensors with automatic '
'object braking provide added confidence when manoeuvring. '
'These features collectively offer a superior and more '
'convenient driving experience compared to many other vehicles '
'in its class.',
'doors_number': 5,
'engine_horse_power': 214,
'fuel_type': 'Electric',
'id': '99f35979-bfd9-5e78-a89b-ca99be16e19d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149149574',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Toyota',
'model': 'bZ4X',
'odometer': 10350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://m.atcdn.co.uk/a/media/efeb97c0f441401caa5ff1c1d78a11b8.jpg',
'https://m.atcdn.co.uk/a/media/df0da6d438014d7baea81c3c9913a582.jpg',
'https://m.atcdn.co.uk/a/media/f8793ef9fb4447788b561ac7ed98d776.jpg',
'https://m.atcdn.co.uk/a/media/9bbc7b23860f439d96416ed125c9243f.jpg',
'https://m.atcdn.co.uk/a/media/e91a524ee38041dda07b3a62a02c9f5c.jpg',
'https://m.atcdn.co.uk/a/media/c3615f5f2c694c259ece9eb6aa902a4f.jpg',
'https://m.atcdn.co.uk/a/media/66cbad1f269845ae88e097e4295b9db8.jpg',
'https://m.atcdn.co.uk/a/media/e5359afc26a549cd872a1451b84c4760.jpg',
'https://m.atcdn.co.uk/a/media/7b03979447c84e25b2981e572b9616b9.jpg',
'https://m.atcdn.co.uk/a/media/7b8dc8ae7ec84a4dba8602739511c0ed.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198769,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/efeb97c0f441401caa5ff1c1d78a11b8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115056,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/df0da6d438014d7baea81c3c9913a582.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144698,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f8793ef9fb4447788b561ac7ed98d776.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161800,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9bbc7b23860f439d96416ed125c9243f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182787,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e91a524ee38041dda07b3a62a02c9f5c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187293,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c3615f5f2c694c259ece9eb6aa902a4f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142191,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/66cbad1f269845ae88e097e4295b9db8.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188130,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e5359afc26a549cd872a1451b84c4760.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177942,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7b03979447c84e25b2981e572b9616b9.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99f35979-bfd9-5e78-a89b-ca99be16e19d/99f35979-bfd9-5e78-a89b-ca99be16e19d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218378,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7b8dc8ae7ec84a4dba8602739511c0ed.jpg',
'Width': 1280}],
'price': 25995,
'price_includes_vat': True,
'registration_date': '2024-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota bZ4X 71.4kWh Vision SUV 5dr Electric Auto AWD (11kW OBC) '
'(218 ps)',
'transmission': 'automatic',
'trim': 'Vision',
'year': 2024}
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149149574%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149149574: {'created_time': 1774883300.752071, 'last_price_update_time': 1774883300.75208}
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149149574') HTTP/1.1" 204 0
2026-03-30 15:08:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d26fb0ad-d458-5705-86d5-b79ad9545659 with identifier: 202512318865371
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d26fb0ad-d458-5705-86d5-b79ad9545659
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fee01bd1ea6ee4aaab4dac35e2b4bcaae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ee01bd1ea6ee4aaab4dac35e2b4bcaae.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F602aceed672f4f6584a5e418e7c61510.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/602aceed672f4f6584a5e418e7c61510.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2ff55f5b8f22446e9a6b5c269f6da69d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2ff55f5b8f22446e9a6b5c269f6da69d.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feebf45cd490d450ea107b5d0a6f4989a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eebf45cd490d450ea107b5d0a6f4989a.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa13742b0004c4e588ca4ec06f8938806.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a13742b0004c4e588ca4ec06f8938806.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F14c1977904b04910b665f52ce4d35832.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/14c1977904b04910b665f52ce4d35832.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b2a984e4b5c4fbfa2d1cc138359f646.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b2a984e4b5c4fbfa2d1cc138359f646.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb5bd54fa9a1b4cfb9870853c29b2f22c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b5bd54fa9a1b4cfb9870853c29b2f22c.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffd25a175d44044ba9bc7feca72396d9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fd25a175d44044ba9bc7feca72396d9f.jpg already downloaded
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4a27114372248eb9d2bbd2a95a8200d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4a27114372248eb9d2bbd2a95a8200d.jpg already downloaded
2026-03-30 15:08:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d26fb0ad-d458-5705-86d5-b79ad9545659 with identifier 202512318865371
2026-03-30 15:08:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d26fb0ad-d458-5705-86d5-b79ad9545659
2026-03-30 15:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 235,
'color': 'Black',
'currency': 'GBP',
'description': 'REVERSING CAMERA ¦ FULL LEATHER ¦ LOAD LINER ¦ TOW BAR ¦ '
'GREAT SAVING ON NEW!!',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': 'd26fb0ad-d458-5705-86d5-b79ad9545659',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512318865371',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 38,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ee01bd1ea6ee4aaab4dac35e2b4bcaae.jpg',
'https://m.atcdn.co.uk/a/media/602aceed672f4f6584a5e418e7c61510.jpg',
'https://m.atcdn.co.uk/a/media/2ff55f5b8f22446e9a6b5c269f6da69d.jpg',
'https://m.atcdn.co.uk/a/media/eebf45cd490d450ea107b5d0a6f4989a.jpg',
'https://m.atcdn.co.uk/a/media/a13742b0004c4e588ca4ec06f8938806.jpg',
'https://m.atcdn.co.uk/a/media/14c1977904b04910b665f52ce4d35832.jpg',
'https://m.atcdn.co.uk/a/media/3b2a984e4b5c4fbfa2d1cc138359f646.jpg',
'https://m.atcdn.co.uk/a/media/b5bd54fa9a1b4cfb9870853c29b2f22c.jpg',
'https://m.atcdn.co.uk/a/media/fd25a175d44044ba9bc7feca72396d9f.jpg',
'https://m.atcdn.co.uk/a/media/c4a27114372248eb9d2bbd2a95a8200d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226218,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ee01bd1ea6ee4aaab4dac35e2b4bcaae.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120829,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/602aceed672f4f6584a5e418e7c61510.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146277,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2ff55f5b8f22446e9a6b5c269f6da69d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196600,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eebf45cd490d450ea107b5d0a6f4989a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212710,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a13742b0004c4e588ca4ec06f8938806.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189276,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/14c1977904b04910b665f52ce4d35832.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139541,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b2a984e4b5c4fbfa2d1cc138359f646.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165448,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b5bd54fa9a1b4cfb9870853c29b2f22c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180532,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fd25a175d44044ba9bc7feca72396d9f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d26fb0ad-d458-5705-86d5-b79ad9545659/d26fb0ad-d458-5705-86d5-b79ad9545659_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230197,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c4a27114372248eb9d2bbd2a95a8200d.jpg',
'Width': 1280}],
'price': 43194,
'price_includes_vat': True,
'registration_date': '2025-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max DL40 Dcb 1.9 4dr Pick Up Automatic Diesel',
'transmission': 'automatic',
'trim': 'DL40',
'year': 2025}
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865371%27 HTTP/1.1" 200 None
2026-03-30 15:08:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512318865371: {'created_time': 1774883300.996054, 'last_price_update_time': 1774883300.996066}
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512318865371') HTTP/1.1" 204 0
2026-03-30 15:08:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b26168f2-3b37-58a5-b402-5230805e728d with identifier: 202512318865367
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b26168f2-3b37-58a5-b402-5230805e728d
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb39f473e1a2e405e9bd29520234407cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b39f473e1a2e405e9bd29520234407cf.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa80c21c83c3b43b5b8785a0399f2fe8c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a80c21c83c3b43b5b8785a0399f2fe8c.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0f4f03ed2910426ba9765c4875044f92.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0f4f03ed2910426ba9765c4875044f92.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb1f8ad5efae541ddbf044ba74544ffd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b1f8ad5efae541ddbf044ba74544ffd2.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d7f218c50344428810873b593602206.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d7f218c50344428810873b593602206.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdc13e76a9872496abfbdf517f16cfdd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dc13e76a9872496abfbdf517f16cfdd2.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e7731e595c94b48978777f10335c151.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e7731e595c94b48978777f10335c151.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7bd5b1849c1d49a48bc1770b0c563b64.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7bd5b1849c1d49a48bc1770b0c563b64.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcb9903e765164c8b8b6ce43669cbe746.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cb9903e765164c8b8b6ce43669cbe746.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa17dcff772c5476ab1508570366e158e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a17dcff772c5476ab1508570366e158e.jpg already downloaded
2026-03-30 15:08:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b26168f2-3b37-58a5-b402-5230805e728d with identifier 202512318865367
2026-03-30 15:08:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b26168f2-3b37-58a5-b402-5230805e728d
2026-03-30 15:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 235,
'color': 'Black',
'currency': 'GBP',
'description': 'REVERSING CAMERA ¦ FULL LEATHER ¦ LOAD LINER ¦ TOW BAR ¦ '
'GREAT SAVING ON NEW!!',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': 'b26168f2-3b37-58a5-b402-5230805e728d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512318865367',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photo_urls': ['https://m.atcdn.co.uk/a/media/b39f473e1a2e405e9bd29520234407cf.jpg',
'https://m.atcdn.co.uk/a/media/a80c21c83c3b43b5b8785a0399f2fe8c.jpg',
'https://m.atcdn.co.uk/a/media/0f4f03ed2910426ba9765c4875044f92.jpg',
'https://m.atcdn.co.uk/a/media/b1f8ad5efae541ddbf044ba74544ffd2.jpg',
'https://m.atcdn.co.uk/a/media/6d7f218c50344428810873b593602206.jpg',
'https://m.atcdn.co.uk/a/media/dc13e76a9872496abfbdf517f16cfdd2.jpg',
'https://m.atcdn.co.uk/a/media/9e7731e595c94b48978777f10335c151.jpg',
'https://m.atcdn.co.uk/a/media/7bd5b1849c1d49a48bc1770b0c563b64.jpg',
'https://m.atcdn.co.uk/a/media/cb9903e765164c8b8b6ce43669cbe746.jpg',
'https://m.atcdn.co.uk/a/media/a17dcff772c5476ab1508570366e158e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204917,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b39f473e1a2e405e9bd29520234407cf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130721,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a80c21c83c3b43b5b8785a0399f2fe8c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134900,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0f4f03ed2910426ba9765c4875044f92.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173918,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b1f8ad5efae541ddbf044ba74544ffd2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189803,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d7f218c50344428810873b593602206.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181171,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/dc13e76a9872496abfbdf517f16cfdd2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153557,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e7731e595c94b48978777f10335c151.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165899,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7bd5b1849c1d49a48bc1770b0c563b64.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157038,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cb9903e765164c8b8b6ce43669cbe746.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b26168f2-3b37-58a5-b402-5230805e728d/b26168f2-3b37-58a5-b402-5230805e728d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210114,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a17dcff772c5476ab1508570366e158e.jpg',
'Width': 1280}],
'price': 41994,
'price_includes_vat': True,
'registration_date': '2025-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max V-Cross Dcb 1.9 4dr Pick Up Automatic Diesel',
'transmission': 'automatic',
'trim': 'V-Cross',
'year': 2025}
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865367%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512318865367: {'created_time': 1774883301.322612, 'last_price_update_time': 1774883301.322624}
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512318865367') HTTP/1.1" 204 0
2026-03-30 15:08:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d570105a-f070-5a15-9e4d-cfedf3c3364a with identifier: 202512318865358
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d570105a-f070-5a15-9e4d-cfedf3c3364a
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F18ced4dbb2c045ffa8cd03adc15286f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/18ced4dbb2c045ffa8cd03adc15286f2.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e7415adceae46ea8138760319e13444.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e7415adceae46ea8138760319e13444.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6362c8b6796b41caa925e21c1e02463b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6362c8b6796b41caa925e21c1e02463b.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffc91906ac9fd4f4d9b8f4f8ddba4d188.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fc91906ac9fd4f4d9b8f4f8ddba4d188.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb2b39b7774ff46cea4a683fad0abc095.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b2b39b7774ff46cea4a683fad0abc095.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbdca2f4d31b34572b0269698a657a2bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bdca2f4d31b34572b0269698a657a2bf.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F318747090e5a49288914a3f03ac28d37.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/318747090e5a49288914a3f03ac28d37.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F22d90158dd8442ea975cdd2f5527115a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/22d90158dd8442ea975cdd2f5527115a.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ae90fcb8322425b9b741ef8e3185981.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ae90fcb8322425b9b741ef8e3185981.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff42b19bba6c542379919844fa725d6cc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f42b19bba6c542379919844fa725d6cc.jpg already downloaded
2026-03-30 15:08:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d570105a-f070-5a15-9e4d-cfedf3c3364a with identifier 202512318865358
2026-03-30 15:08:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d570105a-f070-5a15-9e4d-cfedf3c3364a
2026-03-30 15:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 235,
'color': 'Grey',
'currency': 'GBP',
'description': 'REVERSING CAMERA ¦ FULL LEATHER ¦ LOAD LINER ¦ TOW BAR ¦ '
'GREAT SAVING ON NEW!!',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': 'd570105a-f070-5a15-9e4d-cfedf3c3364a',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512318865358',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/18ced4dbb2c045ffa8cd03adc15286f2.jpg',
'https://m.atcdn.co.uk/a/media/3e7415adceae46ea8138760319e13444.jpg',
'https://m.atcdn.co.uk/a/media/6362c8b6796b41caa925e21c1e02463b.jpg',
'https://m.atcdn.co.uk/a/media/fc91906ac9fd4f4d9b8f4f8ddba4d188.jpg',
'https://m.atcdn.co.uk/a/media/b2b39b7774ff46cea4a683fad0abc095.jpg',
'https://m.atcdn.co.uk/a/media/bdca2f4d31b34572b0269698a657a2bf.jpg',
'https://m.atcdn.co.uk/a/media/318747090e5a49288914a3f03ac28d37.jpg',
'https://m.atcdn.co.uk/a/media/22d90158dd8442ea975cdd2f5527115a.jpg',
'https://m.atcdn.co.uk/a/media/6ae90fcb8322425b9b741ef8e3185981.jpg',
'https://m.atcdn.co.uk/a/media/f42b19bba6c542379919844fa725d6cc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226595,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/18ced4dbb2c045ffa8cd03adc15286f2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93549,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e7415adceae46ea8138760319e13444.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123407,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6362c8b6796b41caa925e21c1e02463b.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202290,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fc91906ac9fd4f4d9b8f4f8ddba4d188.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210669,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b2b39b7774ff46cea4a683fad0abc095.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213839,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bdca2f4d31b34572b0269698a657a2bf.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145136,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/318747090e5a49288914a3f03ac28d37.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171282,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/22d90158dd8442ea975cdd2f5527115a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168933,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ae90fcb8322425b9b741ef8e3185981.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d570105a-f070-5a15-9e4d-cfedf3c3364a/d570105a-f070-5a15-9e4d-cfedf3c3364a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223232,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f42b19bba6c542379919844fa725d6cc.jpg',
'Width': 1280}],
'price': 43194,
'price_includes_vat': True,
'registration_date': '2025-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max 1.9 TD DL40 Pickup Double Cab 4dr Diesel Auto 4WD Euro '
'6 (s/s) (164 ps)',
'transmission': 'automatic',
'trim': 'DL40',
'year': 2025}
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865358%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512318865358: {'created_time': 1774883301.600221, 'last_price_update_time': 1774883301.60023}
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512318865358') HTTP/1.1" 204 0
2026-03-30 15:08:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c928945-acd6-528d-bba3-4594ca341f61 with identifier: 202512318865352
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c928945-acd6-528d-bba3-4594ca341f61
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F591a6e0f78094cabb83ada137f57ef55.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/591a6e0f78094cabb83ada137f57ef55.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7740d1f2d6fd4a05a45c85d02a63a0e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7740d1f2d6fd4a05a45c85d02a63a0e6.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73124635eaae4815b62a77b0a8a6229f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73124635eaae4815b62a77b0a8a6229f.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffd21c44bfc2f4225a80df6c11da97043.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fd21c44bfc2f4225a80df6c11da97043.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb25952dc0a6547319aa990a75d00e4f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b25952dc0a6547319aa990a75d00e4f0.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa15bb09a97084491963e5f14067decaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a15bb09a97084491963e5f14067decaa.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F072b4ae53d8349668b5c96e1b6c6359d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/072b4ae53d8349668b5c96e1b6c6359d.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7b05cf4da45444b964a1838acf3dda0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7b05cf4da45444b964a1838acf3dda0.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd138c0a84f4f4b5e94daf0f6d84d887d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d138c0a84f4f4b5e94daf0f6d84d887d.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff0c0108c70e4647b60a80cf28678bc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff0c0108c70e4647b60a80cf28678bc6.jpg already downloaded
2026-03-30 15:08:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0c928945-acd6-528d-bba3-4594ca341f61 with identifier 202512318865352
2026-03-30 15:08:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0c928945-acd6-528d-bba3-4594ca341f61
2026-03-30 15:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 235,
'color': 'Blue',
'currency': 'GBP',
'description': 'REVERSING CAMERA ¦ FULL LEATHER ¦ LOAD LINER ¦ TOW BAR ¦ '
'GREAT SAVING ON NEW!!',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': '0c928945-acd6-528d-bba3-4594ca341f61',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512318865352',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photo_urls': ['https://m.atcdn.co.uk/a/media/591a6e0f78094cabb83ada137f57ef55.jpg',
'https://m.atcdn.co.uk/a/media/7740d1f2d6fd4a05a45c85d02a63a0e6.jpg',
'https://m.atcdn.co.uk/a/media/73124635eaae4815b62a77b0a8a6229f.jpg',
'https://m.atcdn.co.uk/a/media/fd21c44bfc2f4225a80df6c11da97043.jpg',
'https://m.atcdn.co.uk/a/media/b25952dc0a6547319aa990a75d00e4f0.jpg',
'https://m.atcdn.co.uk/a/media/a15bb09a97084491963e5f14067decaa.jpg',
'https://m.atcdn.co.uk/a/media/072b4ae53d8349668b5c96e1b6c6359d.jpg',
'https://m.atcdn.co.uk/a/media/b7b05cf4da45444b964a1838acf3dda0.jpg',
'https://m.atcdn.co.uk/a/media/d138c0a84f4f4b5e94daf0f6d84d887d.jpg',
'https://m.atcdn.co.uk/a/media/ff0c0108c70e4647b60a80cf28678bc6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218153,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/591a6e0f78094cabb83ada137f57ef55.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108596,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7740d1f2d6fd4a05a45c85d02a63a0e6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106064,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73124635eaae4815b62a77b0a8a6229f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202261,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fd21c44bfc2f4225a80df6c11da97043.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189184,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b25952dc0a6547319aa990a75d00e4f0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182357,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a15bb09a97084491963e5f14067decaa.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141021,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/072b4ae53d8349668b5c96e1b6c6359d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155374,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7b05cf4da45444b964a1838acf3dda0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152403,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d138c0a84f4f4b5e94daf0f6d84d887d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c928945-acd6-528d-bba3-4594ca341f61/0c928945-acd6-528d-bba3-4594ca341f61_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223728,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ff0c0108c70e4647b60a80cf28678bc6.jpg',
'Width': 1280}],
'price': 43194,
'price_includes_vat': True,
'registration_date': '2025-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max DL40 Dcb 1.9 4dr Pick Up Automatic Diesel',
'transmission': 'automatic',
'trim': 'DL40',
'year': 2025}
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865352%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512318865352: {'created_time': 1774883301.847504, 'last_price_update_time': 1774883301.847514}
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512318865352') HTTP/1.1" 204 0
2026-03-30 15:08:21 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:21 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 65dd5a8d-ba68-5663-982f-04ba26f3a1b9 with identifier: 202512318865347
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65dd5a8d-ba68-5663-982f-04ba26f3a1b9
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b371bb1ee0c47738de53495c2286639.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b371bb1ee0c47738de53495c2286639.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1d1c9f21f3c04a519a8814f79be03e2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1d1c9f21f3c04a519a8814f79be03e2a.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6687ab6eb13b4e9aaa02324c7ca00334.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6687ab6eb13b4e9aaa02324c7ca00334.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73e2c8c176504c0fa3055021fd675ff2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73e2c8c176504c0fa3055021fd675ff2.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe59d2967c6be4f77bc8090aec73f13f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e59d2967c6be4f77bc8090aec73f13f6.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9b81387204d942e09224da0efa39e969.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9b81387204d942e09224da0efa39e969.jpg already downloaded
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98d6f6d7b38347a79185498ee4040062.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98d6f6d7b38347a79185498ee4040062.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd9f1c261fa2d4bd0adbcd6ffa4f8cda7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d9f1c261fa2d4bd0adbcd6ffa4f8cda7.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F752331400f6a49599a4d56f4714b64a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/752331400f6a49599a4d56f4714b64a0.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb241f3b3541a48a5b63bb9422ea4be76.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b241f3b3541a48a5b63bb9422ea4be76.jpg already downloaded
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 65dd5a8d-ba68-5663-982f-04ba26f3a1b9 with identifier 202512318865347
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 65dd5a8d-ba68-5663-982f-04ba26f3a1b9
2026-03-30 15:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 227,
'color': 'Red',
'currency': 'GBP',
'description': 'REVERSING CAMERA ¦ FULL LEATHER ¦ LOAD LINER ¦ TOW BAR ¦ '
'GREAT SAVING ON NEW!!',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': '65dd5a8d-ba68-5663-982f-04ba26f3a1b9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512318865347',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 46,
'photo_urls': ['https://m.atcdn.co.uk/a/media/2b371bb1ee0c47738de53495c2286639.jpg',
'https://m.atcdn.co.uk/a/media/1d1c9f21f3c04a519a8814f79be03e2a.jpg',
'https://m.atcdn.co.uk/a/media/6687ab6eb13b4e9aaa02324c7ca00334.jpg',
'https://m.atcdn.co.uk/a/media/73e2c8c176504c0fa3055021fd675ff2.jpg',
'https://m.atcdn.co.uk/a/media/e59d2967c6be4f77bc8090aec73f13f6.jpg',
'https://m.atcdn.co.uk/a/media/9b81387204d942e09224da0efa39e969.jpg',
'https://m.atcdn.co.uk/a/media/98d6f6d7b38347a79185498ee4040062.jpg',
'https://m.atcdn.co.uk/a/media/d9f1c261fa2d4bd0adbcd6ffa4f8cda7.jpg',
'https://m.atcdn.co.uk/a/media/752331400f6a49599a4d56f4714b64a0.jpg',
'https://m.atcdn.co.uk/a/media/b241f3b3541a48a5b63bb9422ea4be76.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193297,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b371bb1ee0c47738de53495c2286639.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190700,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1d1c9f21f3c04a519a8814f79be03e2a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197912,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6687ab6eb13b4e9aaa02324c7ca00334.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167290,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73e2c8c176504c0fa3055021fd675ff2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196009,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e59d2967c6be4f77bc8090aec73f13f6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195435,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9b81387204d942e09224da0efa39e969.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159222,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98d6f6d7b38347a79185498ee4040062.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168427,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d9f1c261fa2d4bd0adbcd6ffa4f8cda7.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187067,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/752331400f6a49599a4d56f4714b64a0.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65dd5a8d-ba68-5663-982f-04ba26f3a1b9/65dd5a8d-ba68-5663-982f-04ba26f3a1b9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202484,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b241f3b3541a48a5b63bb9422ea4be76.jpg',
'Width': 1280}],
'price': 39594,
'price_includes_vat': True,
'registration_date': '2025-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max DL40 Dcb 1.9 4dr Pick Up Manual Diesel',
'transmission': 'manual',
'trim': 'DL40',
'year': 2025}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865347%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512318865347: {'created_time': 1774883302.102554, 'last_price_update_time': 1774883302.102568}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512318865347') HTTP/1.1" 204 0
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 689ac07b-0878-5486-9b69-41fb496d371b with identifier: 202512318865327
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 689ac07b-0878-5486-9b69-41fb496d371b
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7395529ff4cf49e480877ae1b07acb88.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7395529ff4cf49e480877ae1b07acb88.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5189fec20c740148f58e7321141e5d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5189fec20c740148f58e7321141e5d1.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe1c0cd5d624646e1942708f10716e703.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e1c0cd5d624646e1942708f10716e703.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F570c6af6186646c8b9ff96b7520e276c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/570c6af6186646c8b9ff96b7520e276c.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5025f73cd765458397b186fb28fcab40.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5025f73cd765458397b186fb28fcab40.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faaf770f0ba704554ac3052e6b0d7bc4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aaf770f0ba704554ac3052e6b0d7bc4e.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F488ca97910c6496c9018eb54daaa11cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/488ca97910c6496c9018eb54daaa11cb.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e4cdff239b9469390816a2f857c1180.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e4cdff239b9469390816a2f857c1180.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7832943a13ad4db6982cf9740b574bd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7832943a13ad4db6982cf9740b574bd6.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c6b1b26aeef4882b537cd451d9ac738.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c6b1b26aeef4882b537cd451d9ac738.jpg already downloaded
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 689ac07b-0878-5486-9b69-41fb496d371b with identifier 202512318865327
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 689ac07b-0878-5486-9b69-41fb496d371b
2026-03-30 15:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 235,
'color': 'Grey',
'currency': 'GBP',
'description': 'REVERSING CAMERA ¦ LOAD LINER ¦ TOW BAR ¦ GREAT SAVING ON '
'NEW!!',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': '689ac07b-0878-5486-9b69-41fb496d371b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512318865327',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photo_urls': ['https://m.atcdn.co.uk/a/media/7395529ff4cf49e480877ae1b07acb88.jpg',
'https://m.atcdn.co.uk/a/media/f5189fec20c740148f58e7321141e5d1.jpg',
'https://m.atcdn.co.uk/a/media/e1c0cd5d624646e1942708f10716e703.jpg',
'https://m.atcdn.co.uk/a/media/570c6af6186646c8b9ff96b7520e276c.jpg',
'https://m.atcdn.co.uk/a/media/5025f73cd765458397b186fb28fcab40.jpg',
'https://m.atcdn.co.uk/a/media/aaf770f0ba704554ac3052e6b0d7bc4e.jpg',
'https://m.atcdn.co.uk/a/media/488ca97910c6496c9018eb54daaa11cb.jpg',
'https://m.atcdn.co.uk/a/media/6e4cdff239b9469390816a2f857c1180.jpg',
'https://m.atcdn.co.uk/a/media/7832943a13ad4db6982cf9740b574bd6.jpg',
'https://m.atcdn.co.uk/a/media/0c6b1b26aeef4882b537cd451d9ac738.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209346,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7395529ff4cf49e480877ae1b07acb88.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132662,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f5189fec20c740148f58e7321141e5d1.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129691,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e1c0cd5d624646e1942708f10716e703.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191751,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/570c6af6186646c8b9ff96b7520e276c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195271,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5025f73cd765458397b186fb28fcab40.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179581,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aaf770f0ba704554ac3052e6b0d7bc4e.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141530,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/488ca97910c6496c9018eb54daaa11cb.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176662,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6e4cdff239b9469390816a2f857c1180.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169086,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7832943a13ad4db6982cf9740b574bd6.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_689ac07b-0878-5486-9b69-41fb496d371b/689ac07b-0878-5486-9b69-41fb496d371b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227252,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c6b1b26aeef4882b537cd451d9ac738.jpg',
'Width': 1280}],
'price': 41514,
'price_includes_vat': True,
'registration_date': '2025-12-30',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max 1.9 TD DL20 Pickup Double Cab 4dr Diesel Auto 4WD Euro '
'6 (s/s) (164 ps)',
'transmission': 'automatic',
'trim': 'DL20',
'year': 2025}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512318865327%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512318865327: {'created_time': 1774883302.348849, 'last_price_update_time': 1774883302.348857}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512318865327') HTTP/1.1" 204 0
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 499a5774-95a9-5b00-a68a-a1b34e184b51 with identifier: 202512308848456
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 499a5774-95a9-5b00-a68a-a1b34e184b51
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffdb37dcad97442e0a36a559a39951658.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fdb37dcad97442e0a36a559a39951658.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ad82a9ef6aa4af098b1147f7168a690.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ad82a9ef6aa4af098b1147f7168a690.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a321a9e4a7c41c9a0c2d7b6cc160a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a321a9e4a7c41c9a0c2d7b6cc160a4a.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F689e92fbef1a4dc487ffaf576a9adb2a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/689e92fbef1a4dc487ffaf576a9adb2a.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73c18a643be549eab30c7338e807b853.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73c18a643be549eab30c7338e807b853.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7121087f1487438eb077f3cfafc8c579.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7121087f1487438eb077f3cfafc8c579.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7bc733d7ec4646b389b4246834ba1a83.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7bc733d7ec4646b389b4246834ba1a83.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc7abfa715847460ebb08fefa3738c2d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c7abfa715847460ebb08fefa3738c2d2.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d0c486a48cd4490890d9ad47363510a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d0c486a48cd4490890d9ad47363510a.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8925352d3aa248c8a05783bcd460114c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8925352d3aa248c8a05783bcd460114c.jpg already downloaded
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 499a5774-95a9-5b00-a68a-a1b34e184b51 with identifier 202512308848456
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 499a5774-95a9-5b00-a68a-a1b34e184b51
2026-03-30 15:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 227,
'color': 'Grey',
'currency': 'GBP',
'description': 'REVERSING CAMERA ¦ LOAD LINER ¦ TOW BAR ¦ GREAT SAVING ON '
'NEW!!',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': '499a5774-95a9-5b00-a68a-a1b34e184b51',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512308848456',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 5,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photo_urls': ['https://m.atcdn.co.uk/a/media/fdb37dcad97442e0a36a559a39951658.jpg',
'https://m.atcdn.co.uk/a/media/8ad82a9ef6aa4af098b1147f7168a690.jpg',
'https://m.atcdn.co.uk/a/media/0a321a9e4a7c41c9a0c2d7b6cc160a4a.jpg',
'https://m.atcdn.co.uk/a/media/689e92fbef1a4dc487ffaf576a9adb2a.jpg',
'https://m.atcdn.co.uk/a/media/73c18a643be549eab30c7338e807b853.jpg',
'https://m.atcdn.co.uk/a/media/7121087f1487438eb077f3cfafc8c579.jpg',
'https://m.atcdn.co.uk/a/media/7bc733d7ec4646b389b4246834ba1a83.jpg',
'https://m.atcdn.co.uk/a/media/c7abfa715847460ebb08fefa3738c2d2.jpg',
'https://m.atcdn.co.uk/a/media/9d0c486a48cd4490890d9ad47363510a.jpg',
'https://m.atcdn.co.uk/a/media/8925352d3aa248c8a05783bcd460114c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208837,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fdb37dcad97442e0a36a559a39951658.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112899,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8ad82a9ef6aa4af098b1147f7168a690.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110619,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a321a9e4a7c41c9a0c2d7b6cc160a4a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181297,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/689e92fbef1a4dc487ffaf576a9adb2a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188598,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73c18a643be549eab30c7338e807b853.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191200,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7121087f1487438eb077f3cfafc8c579.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139699,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7bc733d7ec4646b389b4246834ba1a83.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155509,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c7abfa715847460ebb08fefa3738c2d2.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155708,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d0c486a48cd4490890d9ad47363510a.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_499a5774-95a9-5b00-a68a-a1b34e184b51/499a5774-95a9-5b00-a68a-a1b34e184b51_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219946,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8925352d3aa248c8a05783bcd460114c.jpg',
'Width': 1280}],
'price': 37914,
'price_includes_vat': True,
'registration_date': '2025-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max 1.9 TD DL20 Pickup Double Cab 4dr Diesel Manual 4WD '
'Euro 6 (s/s) (164 ps)',
'transmission': 'manual',
'trim': 'DL20',
'year': 2025}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512308848456%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512308848456: {'created_time': 1774883302.596589, 'last_price_update_time': 1774883302.596601}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512308848456') HTTP/1.1" 204 0
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c03c772-a27b-59ed-bec7-27b23c9fff22 with identifier: 202512308848455
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c03c772-a27b-59ed-bec7-27b23c9fff22
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F183d2a9fedf3431c82288926a4b63eee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/183d2a9fedf3431c82288926a4b63eee.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd61e426389314ceba4fe1adc3aeddfb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d61e426389314ceba4fe1adc3aeddfb4.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F426c65124021402f93152dadd5b2cc96.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/426c65124021402f93152dadd5b2cc96.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85704cc759fb4658b6dd59770cab9c55.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85704cc759fb4658b6dd59770cab9c55.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F743998aa329242ab864a335c63582849.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/743998aa329242ab864a335c63582849.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F45c7661eb7eb4a5b9fe1633e5db49366.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/45c7661eb7eb4a5b9fe1633e5db49366.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4563ad51853244a791d72f66839547cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4563ad51853244a791d72f66839547cd.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49693ffa67a94ab291a521e4983e1a50.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49693ffa67a94ab291a521e4983e1a50.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F34a335657e76490c9ec47f2cd876ed73.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/34a335657e76490c9ec47f2cd876ed73.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0421d5d768de46449a8a08e1442858c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0421d5d768de46449a8a08e1442858c6.jpg already downloaded
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4c03c772-a27b-59ed-bec7-27b23c9fff22 with identifier 202512308848455
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4c03c772-a27b-59ed-bec7-27b23c9fff22
2026-03-30 15:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Black',
'currency': 'GBP',
'description': 'CALL FOR THE BEST DEAL!!',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2.5L',
'engine_horse_power': 167,
'fuel_type': 'Petrol',
'id': '4c03c772-a27b-59ed-bec7-27b23c9fff22',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512308848455',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Subaru',
'model': 'Outback',
'odometer': 0,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 40,
'photo_urls': ['https://m.atcdn.co.uk/a/media/183d2a9fedf3431c82288926a4b63eee.jpg',
'https://m.atcdn.co.uk/a/media/d61e426389314ceba4fe1adc3aeddfb4.jpg',
'https://m.atcdn.co.uk/a/media/426c65124021402f93152dadd5b2cc96.jpg',
'https://m.atcdn.co.uk/a/media/85704cc759fb4658b6dd59770cab9c55.jpg',
'https://m.atcdn.co.uk/a/media/743998aa329242ab864a335c63582849.jpg',
'https://m.atcdn.co.uk/a/media/45c7661eb7eb4a5b9fe1633e5db49366.jpg',
'https://m.atcdn.co.uk/a/media/4563ad51853244a791d72f66839547cd.jpg',
'https://m.atcdn.co.uk/a/media/49693ffa67a94ab291a521e4983e1a50.jpg',
'https://m.atcdn.co.uk/a/media/34a335657e76490c9ec47f2cd876ed73.jpg',
'https://m.atcdn.co.uk/a/media/0421d5d768de46449a8a08e1442858c6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220578,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/183d2a9fedf3431c82288926a4b63eee.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172473,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d61e426389314ceba4fe1adc3aeddfb4.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173809,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/426c65124021402f93152dadd5b2cc96.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202351,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85704cc759fb4658b6dd59770cab9c55.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203673,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/743998aa329242ab864a335c63582849.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188972,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/45c7661eb7eb4a5b9fe1633e5db49366.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167814,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4563ad51853244a791d72f66839547cd.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181305,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/49693ffa67a94ab291a521e4983e1a50.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212476,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/34a335657e76490c9ec47f2cd876ed73.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d852939f-e6c9-5464-b816-bdc1b22bd9b7/d852939f-e6c9-5464-b816-bdc1b22bd9b7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145371,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0421d5d768de46449a8a08e1442858c6.jpg',
'Width': 1280}],
'price': 40995,
'price_includes_vat': True,
'registration_date': '2026-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Subaru Outback Limited 2.5 5dr Estate CVT Petrol',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2026}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512308848455%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512308848455: {'created_time': 1774883302.879044, 'last_price_update_time': 1774883302.879057}
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512308848455') HTTP/1.1" 204 0
2026-03-30 15:08:22 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:08:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b42356d-1524-52a6-b26a-aeb406baef43 with identifier: 202512238767099
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b42356d-1524-52a6-b26a-aeb406baef43
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8715b0ebb4094415ab3563ee194f536d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8715b0ebb4094415ab3563ee194f536d.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f6349780aaf4d1eba25e7930a0b5825.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f6349780aaf4d1eba25e7930a0b5825.jpg already downloaded
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F32f4da1a9c174a57bdc31621bb190887.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/32f4da1a9c174a57bdc31621bb190887.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F67a8d47a249042088de0e2f73bae891c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/67a8d47a249042088de0e2f73bae891c.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F359f5707744c48b7800d160f4baba577.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/359f5707744c48b7800d160f4baba577.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1c96eecf8e8b4657ba2a69ee9972c84f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1c96eecf8e8b4657ba2a69ee9972c84f.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F636365f28f944ad282db1891de42cc75.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/636365f28f944ad282db1891de42cc75.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa3670a0a9fa54b4bb0194ec8d2d0e551.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a3670a0a9fa54b4bb0194ec8d2d0e551.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ed24124e579409fafcd8a9e0b8ff124.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ed24124e579409fafcd8a9e0b8ff124.jpg already downloaded
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6cb21a8658f44d51ace7159956b81dff.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6cb21a8658f44d51ace7159956b81dff.jpg already downloaded
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9b42356d-1524-52a6-b26a-aeb406baef43 with identifier 202512238767099
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9b42356d-1524-52a6-b26a-aeb406baef43
2026-03-30 15:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 241,
'color': 'Silver',
'currency': 'GBP',
'description': 'Boasting a full Isuzu service history, this 2022 Isuzu D Max '
'DL40 offers excellent provenance. This four wheel drive model '
'is powered by an efficient 1.9L diesel engine and meets Euro '
'6 emission standards. It comes equipped with Bi LED '
'headlights, dual zone climate control for personalised '
'comfort, and front and rear parking sensors to aid '
'manoeuvrability. Enjoy the convenience of keyless entry and '
'push button start, alongside adaptive cruise control for '
'relaxed journeys.\n'
'\n'
'The DL40 trim level of this Isuzu D Max showcases a range of '
'features designed to enhance your driving experience. The '
'inclusion of adaptive cruise control, for instance, sets it '
'apart by offering a more sophisticated approach to managing '
'speed on longer trips compared to standard cruise control '
'systems. Similarly, the combination of Bi LED headlights and '
'dual zone climate control demonstrates a higher level of '
'comfort and visibility, indicating a superior specification '
'over many other vehicles in its class.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '1.9L',
'engine_horse_power': 162,
'fuel_type': 'Diesel',
'id': '9b42356d-1524-52a6-b26a-aeb406baef43',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512238767099',
'listing': 'directbuy',
'location': 'Kirriemuir, Angus',
'make': 'Isuzu',
'model': 'D-Max',
'odometer': 49843,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photo_urls': ['https://m.atcdn.co.uk/a/media/8715b0ebb4094415ab3563ee194f536d.jpg',
'https://m.atcdn.co.uk/a/media/5f6349780aaf4d1eba25e7930a0b5825.jpg',
'https://m.atcdn.co.uk/a/media/32f4da1a9c174a57bdc31621bb190887.jpg',
'https://m.atcdn.co.uk/a/media/67a8d47a249042088de0e2f73bae891c.jpg',
'https://m.atcdn.co.uk/a/media/359f5707744c48b7800d160f4baba577.jpg',
'https://m.atcdn.co.uk/a/media/1c96eecf8e8b4657ba2a69ee9972c84f.jpg',
'https://m.atcdn.co.uk/a/media/636365f28f944ad282db1891de42cc75.jpg',
'https://m.atcdn.co.uk/a/media/a3670a0a9fa54b4bb0194ec8d2d0e551.jpg',
'https://m.atcdn.co.uk/a/media/4ed24124e579409fafcd8a9e0b8ff124.jpg',
'https://m.atcdn.co.uk/a/media/6cb21a8658f44d51ace7159956b81dff.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222912,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8715b0ebb4094415ab3563ee194f536d.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148127,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f6349780aaf4d1eba25e7930a0b5825.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125239,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/32f4da1a9c174a57bdc31621bb190887.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210330,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/67a8d47a249042088de0e2f73bae891c.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217068,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/359f5707744c48b7800d160f4baba577.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204909,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1c96eecf8e8b4657ba2a69ee9972c84f.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152597,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/636365f28f944ad282db1891de42cc75.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186598,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a3670a0a9fa54b4bb0194ec8d2d0e551.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176133,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ed24124e579409fafcd8a9e0b8ff124.jpg',
'Width': 1280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b42356d-1524-52a6-b26a-aeb406baef43/9b42356d-1524-52a6-b26a-aeb406baef43_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214598,
'Height': 960,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6cb21a8658f44d51ace7159956b81dff.jpg',
'Width': 1280}],
'price': 29994,
'price_includes_vat': True,
'registration_date': '2022-09-10',
'seats_number': 5,
'seller_name': None,
'title': 'Isuzu D-Max 1.9 TD DL40 Pickup Double Cab 4dr Diesel Auto 4WD Euro '
'6 (s/s) (164 ps)',
'transmission': 'automatic',
'trim': 'DL40',
'year': 2022}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238767099%27 HTTP/1.1" 200 None
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512238767099: {'created_time': 1774883303.249622, 'last_price_update_time': 1774883303.249635}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512238767099') HTTP/1.1" 204 0
2026-03-30 15:08:23 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:08:23 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:08:23 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4a6e01c62c1f11f18e133aacc95538c6
2026-03-30 15:08:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:08:23 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:08:23 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:23 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:08:23 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:08:23 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 5, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587303 HTTP/1.1" 200 None
2026-03-30 15:08:24 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (65 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4a6e01c62c1f11f18e133aacc95538c6.jl
2026-03-30 15:08:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 491098,
'downloader/request_count': 11,
'downloader/request_method_count/POST': 11,
'downloader/response_bytes': 2992353,
'downloader/response_count': 11,
'downloader/response_status_count/200': 11,
'elapsed_time_seconds': 31.136438,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 15, 8, 24, 155015, tzinfo=datetime.timezone.utc),
'item_scraped_count': 65,
'log_count/DEBUG': 1998,
'log_count/INFO': 1116,
'memusage/max': 149618688,
'memusage/startup': 149618688,
'request_depth_max': 4,
'response_received_count': 11,
'scheduler/dequeued': 11,
'scheduler/dequeued/memory': 11,
'scheduler/enqueued': 11,
'scheduler/enqueued/memory': 11,
'scrape_type/new': 65,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 11,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.965718149122867,
'scrapy-zyte-api/mean_response_seconds': 4.148031042719429,
'scrapy-zyte-api/processed': 11,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 11,
'scrapy-zyte-api/request_args/experimental.requestCookies': 10,
'scrapy-zyte-api/request_args/experimental.responseCookies': 11,
'scrapy-zyte-api/request_args/httpRequestBody': 11,
'scrapy-zyte-api/request_args/httpRequestMethod': 11,
'scrapy-zyte-api/request_args/httpResponseBody': 11,
'scrapy-zyte-api/request_args/httpResponseHeaders': 11,
'scrapy-zyte-api/request_args/url': 11,
'scrapy-zyte-api/status_codes/200': 11,
'scrapy-zyte-api/success': 11,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 30, 15, 7, 53, 18577, tzinfo=datetime.timezone.utc)}
2026-03-30 15:08:24 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:08:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb4d5793590>
2026-03-30 15:08:24 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fb4d5793e10>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)