2026-03-26 14:39:59 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 14:39:59 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 14:39:59 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-26 14:39:59 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-26 14:39:59 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-26 14:39:59 [auto_selling_autotrader.co.uk] INFO: _job: a7f8eeb0292111f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-26 14:39:59 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 14:39:59 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 14:39:59 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 14:39:59 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 14:39:59 [scrapy.extensions.telnet] INFO: Telnet Password: ddaf8271ec14fae6
2026-03-26 14:39:59 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-26 14:39:59 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/a7f8eeb0292111f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-26 14:39:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 14:39:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 14:39:59 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 14:39:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-26 14:39:59 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 14:39:59 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-26 14:39:59 [scrapy.core.engine] INFO: Spider opened
2026-03-26 14:39:59 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 14:39:59 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-26 14:39:59 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-26 14:39:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 14:39:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 14:39:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-26 14:39:59 [scrapy-playwright] INFO: Starting download handler
2026-03-26 14:39:59 [scrapy-playwright] INFO: Starting download handler
2026-03-26 14:40:04 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10029686 and multipost_profile_id: e3724921-a382-412a-8da1-167cd3b0592c and job_id: a7f8eeb0292111f18f76c264925fbcfa and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=MK17%200PP&retailerId=10029686&sort=price-asc
2026-03-26 14:40:04 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10029686, page: 1
2026-03-26 14:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 20
2026-03-26 14:40:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-26 14:40:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250988862%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250988862: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230937962%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230937962: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230923126%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230923126: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921979%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230921979: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190829165%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190829165: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140707755%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603140707755: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090526303%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090526303: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060466392%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060466392: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040389359%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040389359: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270256334%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270256334: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260235611%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260235611: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260228776%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260228776: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240170657%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240170657: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190053250%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190053250: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179985786%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179985786: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099782079%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602099782079: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299527417%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299527417: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601259405681%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601259405681: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512258799672%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512258799672: 1
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511097763515%27 HTTP/1.1" 200 None
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511097763515: 1
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 14:40:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 14:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 14:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 14:40:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: aff55752-cecd-5f09-a948-0f87c0002265 with identifier: 202602260235611
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item aff55752-cecd-5f09-a948-0f87c0002265
2026-03-26 14:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ab399b6ab7342f99f1aadfdf0c087d1.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ab399b6ab7342f99f1aadfdf0c087d1.jpg not downloaded yet
2026-03-26 14:40:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca with identifier: 202602260228776
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca
2026-03-26 14:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29cf895597434343969e3ae0be4c227e.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29cf895597434343969e3ae0be4c227e.jpg not downloaded yet
2026-03-26 14:40:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 51d3fb56-1762-596e-88f5-5a05738609b3 with identifier: 202602240170657
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 51d3fb56-1762-596e-88f5-5a05738609b3
2026-03-26 14:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe6fece543c814af6bb9858a05c58e578.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e6fece543c814af6bb9858a05c58e578.jpg not downloaded yet
2026-03-26 14:40:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a9bf4d-e6d1-51fc-97f0-330c48eb7aa9 with identifier: 202602190053250
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a3a9bf4d-e6d1-51fc-97f0-330c48eb7aa9
2026-03-26 14:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fca5eb963ff754ae6b16599539f0cb801.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ca5eb963ff754ae6b16599539f0cb801.jpg not downloaded yet
2026-03-26 14:40:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ffffecac-6f32-58fa-acff-fda93e6cf390 with identifier: 202602179985786
2026-03-26 14:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffffecac-6f32-58fa-acff-fda93e6cf390
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a4375b142b049f3bf667a6ae4348ba8.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a4375b142b049f3bf667a6ae4348ba8.jpg not downloaded yet
2026-03-26 14:40:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b70adb9-5492-528a-a613-dec12867cf69 with identifier: 202602099782079
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5b70adb9-5492-528a-a613-dec12867cf69
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf487b3c873f4644950e2c70664d305c.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df487b3c873f4644950e2c70664d305c.jpg not downloaded yet
2026-03-26 14:40:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c91080-4bd6-51f3-8ab4-ef5c3d142f45 with identifier: 202601299527417
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a2c91080-4bd6-51f3-8ab4-ef5c3d142f45
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a0a862e8589433195dba7d1d7dd3cc7.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a0a862e8589433195dba7d1d7dd3cc7.jpg not downloaded yet
2026-03-26 14:40:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6294eeb5-d8aa-560b-92c7-6a457ac5b252 with identifier: 202601259405681
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6294eeb5-d8aa-560b-92c7-6a457ac5b252
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe7e80562b72e481887fb632ebb1cf4e1.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e7e80562b72e481887fb632ebb1cf4e1.jpg not downloaded yet
2026-03-26 14:40:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e1693a5e-a1d8-5e2c-a416-a72d7446949a with identifier: 202512258799672
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1693a5e-a1d8-5e2c-a416-a72d7446949a
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30d58ec8e2e5416ab800da68cbddaa8e.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30d58ec8e2e5416ab800da68cbddaa8e.jpg not downloaded yet
2026-03-26 14:40:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c with identifier: 202511097763515
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f1685d05b8f46ae89df45e7e50ec367.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f1685d05b8f46ae89df45e7e50ec367.jpg not downloaded yet
2026-03-26 14:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/29cf895597434343969e3ae0be4c227e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/30d58ec8e2e5416ab800da68cbddaa8e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 14:40:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 14:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c10903250>
2026-03-26 14:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca/d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29cf895597434343969e3ae0be4c227e.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29cf895597434343969e3ae0be4c227e.jpg saved to cache
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca
2026-03-26 14:40:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca sending to next pipeline
2026-03-26 14:40:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca with identifier 202602260228776
2026-03-26 14:40:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-26 14:40:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 14:40:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 14:40:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-26 14:40:10 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-26 14:40:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:40:10 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:40:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:40:10 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:40:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-26 14:40:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-26 14:40:11 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-26 14:40:11 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:40:11 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:40:11 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:40:11 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2021
2026-03-26 14:40:11 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774536011
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774536011
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 14:40:11 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca
2026-03-26 14:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/29cf895597434343969e3ae0be4c227e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Renault Clio 1.2 TCe Dynamique TomTom 3dr in very good '
                'condition and comes with service history. Fresh service and '
                'MOT . New front brake discs.New front Anti-roll bars. 2 keys. '
                'HPI is clear. ULEZ compliant. Parking sensors, SAT Nav, '
                'Bluetooth connectivity, cruise control with speed limiter, '
                'Door Mirrors - Electrically Adjustable - Manual Folding and '
                'Heated, spare wheel. Two months free warranty. 12 Months free '
                'AA roadside breakdown cover. Nationwide delivery service is '
                'available.',
 'doors_number': 3,
 'emission_standard': 'Euro 5',
 'engine': '1.2L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': 'd7bf6061-4360-5bee-bb0c-6fd0e95ce9ca',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260228776',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 79100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 41,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca/d7bf6061-4360-5bee-bb0c-6fd0e95ce9ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88857,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/29cf895597434343969e3ae0be4c227e.jpg',
             'Width': 800}],
 'price': 2990,
 'price_includes_vat': True,
 'registration_date': '2012-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 TCe Dynamique TomTom Euro 5 3dr',
 'transmission': 'manual',
 'trim': 'Dynamique TomTom',
 'year': 2012}
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260228776%27 HTTP/1.1" 200 None
2026-03-26 14:40:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260228776: {'created_time': 1774536011.561483, 'last_price_update_time': 1774536011.561492}
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260228776') HTTP/1.1" 204 0
2026-03-26 14:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5f1685d05b8f46ae89df45e7e50ec367.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c13d01cd0>
2026-03-26 14:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1693a5e-a1d8-5e2c-a416-a72d7446949a/e1693a5e-a1d8-5e2c-a416-a72d7446949a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F30d58ec8e2e5416ab800da68cbddaa8e.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/30d58ec8e2e5416ab800da68cbddaa8e.jpg saved to cache
2026-03-26 14:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1693a5e-a1d8-5e2c-a416-a72d7446949a
2026-03-26 14:40:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1693a5e-a1d8-5e2c-a416-a72d7446949a sending to next pipeline
2026-03-26 14:40:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e1693a5e-a1d8-5e2c-a416-a72d7446949a with identifier 202512258799672
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e1693a5e-a1d8-5e2c-a416-a72d7446949a
2026-03-26 14:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/30d58ec8e2e5416ab800da68cbddaa8e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '**** RESERVED ***Citroen C4 Picasso 1.6 BlueHDi VTR+ EAT6 '
                'Euro 6 (s/s) 5dr in excellent condition and comes with full '
                'service history ( 9 stamps on the service book) , long clean '
                'MOT till 13/10/2026 ( all advisories have been repaired/ New '
                'rear brake discs and pads, New front link bars) , Fresh '
                'service . Two Months free nationwide warranty, Extended '
                'warranty is available. 12 months free AA roadside breakdown '
                'cover. 2 keys. £20 road Tax. HPI is clear. ULEZ compliant. '
                'Panoramic roof with electric blind, parking sensors, cruise '
                'control, Bluetooth media streaming, DAB radio, spare wheel. '
                'Finance option is available, please contact us for more '
                'information. Nationwide delivery service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 118,
 'fuel_type': 'Diesel',
 'id': 'e1693a5e-a1d8-5e2c-a416-a72d7446949a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512258799672',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 57700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1693a5e-a1d8-5e2c-a416-a72d7446949a/e1693a5e-a1d8-5e2c-a416-a72d7446949a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80899,
             'Height': 541,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/30d58ec8e2e5416ab800da68cbddaa8e.jpg',
             'Width': 800}],
 'price': 7000,
 'price_includes_vat': True,
 'registration_date': '2016-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 BlueHDi VTR+ EAT6 Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'VTR+',
 'year': 2016}
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512258799672%27 HTTP/1.1" 200 None
2026-03-26 14:40:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512258799672: {'created_time': 1774536011.875881, 'last_price_update_time': 1774536011.87589}
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512258799672') HTTP/1.1" 204 0
2026-03-26 14:40:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 51d3fb56-1762-596e-88f5-5a05738609b3 with identifier 202602240170657
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 51d3fb56-1762-596e-88f5-5a05738609b3
2026-03-26 14:40:11 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'Vauxhall Corsa 1.4i SE Auto Euro 6 5dr in excellent condition '
                'and comes with service history and long MOT. Fresh service '
                'and MOT to be carried out prior to sale. 2 keys. HPI is '
                'clear. Front and rear parking sensors, front heated seats, '
                'heated steering wheel, Bluetooth media streaming, cruise '
                'control, hill start assist,  Heated windscreen and rear '
                'screen. Two months free warranty, Extended warranty is '
                'available. 12 Months free AA roadside breakdown cover. '
                'Finance option is available, please contact us for more '
                'details. Nationwide delivery service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': '51d3fb56-1762-596e-88f5-5a05738609b3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240170657',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 40369,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 45,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/e6fece543c814af6bb9858a05c58e578.jpg'],
 'photos': [],
 'price': 8000,
 'price_includes_vat': True,
 'registration_date': '2015-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.4i SE Auto Euro 6 5dr',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2015}
2026-03-26 14:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240170657%27 HTTP/1.1" 200 None
2026-03-26 14:40:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240170657: {'created_time': 1774536012.001394, 'last_price_update_time': 1774536012.001404}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240170657') HTTP/1.1" 204 0
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: aff55752-cecd-5f09-a948-0f87c0002265 with identifier 202602260235611
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item aff55752-cecd-5f09-a948-0f87c0002265
2026-03-26 14:40:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Jeep Cherokee 2.2 MultiJetII Limited Auto 4WD Euro 6 (s/s) '
                '5dr in excellent condition and comes with Fresh service and '
                'Fresh clean MOT. SIX months free warranty, Extended warranty '
                'is available. 12 Months free AA roadside breakdown cover. 2 '
                'keys. Full leather interior with front heated seats, electric '
                'driver seat with memory, reverse camera with front and rear '
                'parking sensors,  keyless entry and start, electric tailgate, '
                'SAT Nav, Bluetooth media streaming, cruise control, DAB '
                'radio. Finance option is available, please contact us for '
                'more details. Nationwide delivery service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.2L',
 'engine_horse_power': 197,
 'fuel_type': 'Diesel',
 'id': 'aff55752-cecd-5f09-a948-0f87c0002265',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260235611',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 68900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/5ab399b6ab7342f99f1aadfdf0c087d1.jpg'],
 'photos': [],
 'price': 9900,
 'price_includes_vat': True,
 'registration_date': '2016-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 MultiJetII Limited Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2015}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260235611%27 HTTP/1.1" 200 None
2026-03-26 14:40:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260235611: {'created_time': 1774536012.052442, 'last_price_update_time': 1774536012.052451}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260235611') HTTP/1.1" 204 0
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a3a9bf4d-e6d1-51fc-97f0-330c48eb7aa9 with identifier 202602190053250
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a3a9bf4d-e6d1-51fc-97f0-330c48eb7aa9
2026-03-26 14:40:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'Renault Clio 1.5 dCi Dynamique S Nav EDC Euro 6 (s/s) 5dr '
                'with Low mileage in very good condition and comes with '
                'service history ( 7 Stamps on the service book/ Most recent '
                'one at 54000 Miles), Long clean MOT Till 04/11/2026. Timing '
                'belt and water pump were replaced at 48000 Miles. 2 Keys. Two '
                'Months free warranty, Extended warranty is available. 12 '
                'Months free AA Roadside breakdown cover. £20 Road Tax. ULEZ '
                'Compliant. HPI is clear. Parking sensors, SAT Nav, Bluetooth '
                'media streaming, Cruise control with speed limiter, Handsfree '
                'Keycard with Push Button Start-Stop Function, Hill start '
                'assist, Electrically folding mirrors. Finance option is '
                'available, Please contact us for more details. Nationwide '
                'delivery service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 89,
 'fuel_type': 'Diesel',
 'id': 'a3a9bf4d-e6d1-51fc-97f0-330c48eb7aa9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190053250',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 54515,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/ca5eb963ff754ae6b16599539f0cb801.jpg'],
 'photos': [],
 'price': 8000,
 'price_includes_vat': True,
 'registration_date': '2016-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Dynamique S Nav EDC Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Dynamique S Nav',
 'year': 2016}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190053250%27 HTTP/1.1" 200 None
2026-03-26 14:40:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190053250: {'created_time': 1774536012.109461, 'last_price_update_time': 1774536012.10947}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190053250') HTTP/1.1" 204 0
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ffffecac-6f32-58fa-acff-fda93e6cf390 with identifier 202602179985786
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ffffecac-6f32-58fa-acff-fda93e6cf390
2026-03-26 14:40:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Black',
 'currency': 'GBP',
 'description': '** Part Exchange to clear**SEAT Altea 1.6 TDI Ecomotive CR '
                'SE  (s/s) 5dr in  good condition and comes with full service '
                'history ( 17 stamps on the service book) and long clean MOT '
                'Till 09/10/2026. Timing belt and water pump were replaced at '
                '68833 Miles. HPI is clear. £35 Road Tax. One month free '
                'warranty, Extended warranty is available. 12Months free AA '
                'roadside breakdown cover.  Parking sensors, cruise control, '
                'Electrically Folding and Heated Door Mirrors, Hill hood '
                'control, spare wheel.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.6L',
 'engine_horse_power': 104,
 'fuel_type': 'Diesel',
 'id': 'ffffecac-6f32-58fa-acff-fda93e6cf390',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179985786',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'SEAT',
 'model': 'Altea',
 'odometer': 90713,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 35,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/4a4375b142b049f3bf667a6ae4348ba8.jpg'],
 'photos': [],
 'price': 2750,
 'price_includes_vat': True,
 'registration_date': '2010-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT Altea 1.6 TDI Ecomotive CR SE Euro 5 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2010}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179985786%27 HTTP/1.1" 200 None
2026-03-26 14:40:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179985786: {'created_time': 1774536012.156644, 'last_price_update_time': 1774536012.156653}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179985786') HTTP/1.1" 204 0
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5b70adb9-5492-528a-a613-dec12867cf69 with identifier 202602099782079
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5b70adb9-5492-528a-a613-dec12867cf69
2026-03-26 14:40:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Citroen Grand C4 Picasso 1.6 BlueHDi Flair EAT6 Euro 6 (s/s) '
                '5dr in excellent condition and comes with service history ( 7 '
                'Stamps on the service book). Fresh service and fresh clean '
                'MOT. 2 Keys. SIX Months free warranty, Extended warranty is '
                'available.12 Months free AA Roadside breakdown cover. ULEZ '
                'Compliant. Panoramic roof with electric blind, Advanced '
                'parking assist, Reverse camera with front and rear parking '
                'sensors, Electric tailgate, SAT Nav, Cruise control with '
                'speed limiter,Apple play, Android Auto, Bluetooth media '
                'streaming, DAB Radio, Front seats with massage function, '
                'Electrically folding mirrors, Spare wheel. Finance option is '
                'available, Please contact us for more details. Nationwide '
                'delievry service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 118,
 'fuel_type': 'Diesel',
 'id': '5b70adb9-5492-528a-a613-dec12867cf69',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602099782079',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Citroen',
 'model': 'Grand C4 Picasso',
 'odometer': 80985,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/df487b3c873f4644950e2c70664d305c.jpg'],
 'photos': [],
 'price': 9450,
 'price_includes_vat': True,
 'registration_date': '2017-12-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen Grand C4 Picasso 1.6 BlueHDi Flair EAT6 Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Flair',
 'year': 2017}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099782079%27 HTTP/1.1" 200 None
2026-03-26 14:40:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602099782079: {'created_time': 1774536012.206969, 'last_price_update_time': 1774536012.206978}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099782079') HTTP/1.1" 204 0
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a2c91080-4bd6-51f3-8ab4-ef5c3d142f45 with identifier 202601299527417
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a2c91080-4bd6-51f3-8ab4-ef5c3d142f45
2026-03-26 14:40:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'Citroen DS5 2.0 HDi DStyle Auto in excellent condition and '
                'comes with service history ( 9 services ) with most recent '
                'service at 57000 miles, long clean MOT Till 22/12/2026. '
                'Timing belt and water pump were replaced at 42000 miles. 2 '
                'keys. HPI is clear.  Panoramic roof with electric blind, '
                'reverse camera with parking sensors, SAT Nav, Bluetooth media '
                'streaming , cruise control with speed limiter, keyless entry '
                'and start, Detachable Tow bar. SIX months free warranty, '
                'Extended warranty is available. 12 months free AA roadside '
                'breakdown cover. Nationwide delivery service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '2L',
 'engine_horse_power': 158,
 'fuel_type': 'Diesel',
 'id': 'a2c91080-4bd6-51f3-8ab4-ef5c3d142f45',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299527417',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 58000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/8a0a862e8589433195dba7d1d7dd3cc7.jpg'],
 'photos': [],
 'price': 6500,
 'price_includes_vat': True,
 'registration_date': '2013-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen DS5 2.0 HDi DStyle Auto Euro 5 5dr',
 'transmission': 'automatic',
 'trim': 'DStyle',
 'year': 2013}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299527417%27 HTTP/1.1" 200 None
2026-03-26 14:40:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299527417: {'created_time': 1774536012.261649, 'last_price_update_time': 1774536012.261658}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299527417') HTTP/1.1" 204 0
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6294eeb5-d8aa-560b-92c7-6a457ac5b252 with identifier 202601259405681
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6294eeb5-d8aa-560b-92c7-6a457ac5b252
2026-03-26 14:40:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Brown',
 'currency': 'GBP',
 'description': '** ONE Owner**Mitsubishi ASX 1.6 ZC-M Euro 6 5dr in very good '
                'condition and comes with full service history . Fresh service '
                'and Fresh clean MOT. Two Months free warranty, Extended '
                'warranty is available. 12 Months free AA roadside breakdown '
                'cover. 2 keys. HPI is clear. Front heated seats, Bluetooth '
                'Hands Free Telephone Connection, USB & AUX Connection, DAB '
                'Radio, Cruise control, Hills tart assist, Spare wheel. '
                'Nationwide delivery service is available. Finance option is '
                'available, Please contact us for more details.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'fuel_type': 'Petrol',
 'id': '6294eeb5-d8aa-560b-92c7-6a457ac5b252',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601259405681',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 75600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/e7e80562b72e481887fb632ebb1cf4e1.jpg'],
 'photos': [],
 'price': 6000,
 'price_includes_vat': True,
 'registration_date': '2016-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 ZC-M Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'ZC-M',
 'year': 2016}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601259405681%27 HTTP/1.1" 200 None
2026-03-26 14:40:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601259405681: {'created_time': 1774536012.315355, 'last_price_update_time': 1774536012.315364}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601259405681') HTTP/1.1" 204 0
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 51d3fb56-1762-596e-88f5-5a05738609b3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item aff55752-cecd-5f09-a948-0f87c0002265 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item a3a9bf4d-e6d1-51fc-97f0-330c48eb7aa9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item ffffecac-6f32-58fa-acff-fda93e6cf390 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 5b70adb9-5492-528a-a613-dec12867cf69 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item a2c91080-4bd6-51f3-8ab4-ef5c3d142f45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 6294eeb5-d8aa-560b-92c7-6a457ac5b252 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-26 14:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c10933f90>
2026-03-26 14:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c/a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f1685d05b8f46ae89df45e7e50ec367.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f1685d05b8f46ae89df45e7e50ec367.jpg saved to cache
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c
2026-03-26 14:40:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c sending to next pipeline
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c with identifier 202511097763515
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c
2026-03-26 14:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5f1685d05b8f46ae89df45e7e50ec367.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Nissan Qashqai 1.5 dCi N-Motion Euro 6 (s/s) 5dr in excellent '
                'condition and comes with service history. Fresh service and '
                'long clean MOT. New clutch was fitted at 85000 miles. '
                'TwoMonths free warranty, Extended warranty is available. 12 '
                'Months free AA breakdown cover. 360 reverse camera with front '
                'and rear parking sensors, panoramic roof with electric blind, '
                'Bluetooth media streaming , DAB radio, cruise control with '
                'speed limiter, lane departure assist. Finance option is '
                'available, please contact us for more information. Nationwide '
                'delivery service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 113,
 'fuel_type': 'Diesel',
 'id': 'a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511097763515',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 85546,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c/a221ee07-ea8f-5fb2-95d4-bc3e3c0c2d4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82866,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f1685d05b8f46ae89df45e7e50ec367.jpg',
             'Width': 800}],
 'price': 8500,
 'price_includes_vat': True,
 'registration_date': '2019-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi N-Motion Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'N-Motion',
 'year': 2019}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511097763515%27 HTTP/1.1" 200 None
2026-03-26 14:40:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511097763515: {'created_time': 1774536012.425507, 'last_price_update_time': 1774536012.425518}
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511097763515') HTTP/1.1" 204 0
2026-03-26 14:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b6371ab-1857-59ad-aca0-be907dfa09b8 with identifier: 202603250988862
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4b6371ab-1857-59ad-aca0-be907dfa09b8
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbd5b4cdd164d4c91a5f173ff228f40ec.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bd5b4cdd164d4c91a5f173ff228f40ec.jpg not downloaded yet
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c1020f-daaa-5ed4-82d6-5f06bdca7111 with identifier: 202603230937962
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08c1020f-daaa-5ed4-82d6-5f06bdca7111
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F385a8757e9024361a3cc7a1ac74db1e1.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/385a8757e9024361a3cc7a1ac74db1e1.jpg not downloaded yet
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: eb46cd85-210d-546a-af48-fb7655d89983 with identifier: 202603230923126
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item eb46cd85-210d-546a-af48-fb7655d89983
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb829d0d8547947579f2ade393b27781e.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b829d0d8547947579f2ade393b27781e.jpg not downloaded yet
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: afcff135-12ae-5a71-87da-fa29747f9fbe with identifier: 202603230921979
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afcff135-12ae-5a71-87da-fa29747f9fbe
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac849a2f105d4733b4e9cc7ccf378b77.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac849a2f105d4733b4e9cc7ccf378b77.jpg not downloaded yet
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b128ee-88e4-5a19-8851-6f2da0732a97 with identifier: 202603190829165
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c7b128ee-88e4-5a19-8851-6f2da0732a97
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F518e28684e3943139d0f6647d4fcdff0.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/518e28684e3943139d0f6647d4fcdff0.jpg not downloaded yet
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 655f203d-2a01-54a3-8545-1c67b6bf1729 with identifier: 202603140707755
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 655f203d-2a01-54a3-8545-1c67b6bf1729
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60f3d38156594f288d341df3d8549b45.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60f3d38156594f288d341df3d8549b45.jpg not downloaded yet
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ac26d5f7-742f-50a5-9998-c611a8ff8318 with identifier: 202603090526303
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ac26d5f7-742f-50a5-9998-c611a8ff8318
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F876e2f7a11774305878621d8ba6b8156.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/876e2f7a11774305878621d8ba6b8156.jpg not downloaded yet
2026-03-26 14:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bd5b4cdd164d4c91a5f173ff228f40ec.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f8567a82-923e-50a0-999c-df2149b009a4 with identifier: 202603060466392
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8567a82-923e-50a0-999c-df2149b009a4
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44f0f7fd9e9b4f3ba51928b66260873f.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44f0f7fd9e9b4f3ba51928b66260873f.jpg not downloaded yet
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d2e54ce-82e6-5925-b97e-2541e2e2bde7 with identifier: 202603040389359
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1d2e54ce-82e6-5925-b97e-2541e2e2bde7
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8bcae8373a334e58a9bcd7ac44ddc178.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8bcae8373a334e58a9bcd7ac44ddc178.jpg not downloaded yet
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 14:40:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c0f31e94-508e-5869-ad45-30a440131c6a with identifier: 202602270256334
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c0f31e94-508e-5869-ad45-30a440131c6a
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F758cb911336d4735904eecf5827a0ea4.jpg%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/758cb911336d4735904eecf5827a0ea4.jpg not downloaded yet
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c108d26d0>
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b6371ab-1857-59ad-aca0-be907dfa09b8/4b6371ab-1857-59ad-aca0-be907dfa09b8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbd5b4cdd164d4c91a5f173ff228f40ec.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bd5b4cdd164d4c91a5f173ff228f40ec.jpg saved to cache
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b6371ab-1857-59ad-aca0-be907dfa09b8
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b6371ab-1857-59ad-aca0-be907dfa09b8 sending to next pipeline
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4b6371ab-1857-59ad-aca0-be907dfa09b8 with identifier 202603250988862
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4b6371ab-1857-59ad-aca0-be907dfa09b8
2026-03-26 14:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bd5b4cdd164d4c91a5f173ff228f40ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Low Mileage **Ford Ka 1.2 Edge (s/s) 3dr in excellent '
                'condition and comes with fresh service and fresh MoT. 2 keys. '
                'Two Months free warranty, Extended warranty is available. 12 '
                'Months free AA roadside breakdown cover. £35 Road Tax. HPI is '
                'clear. Finance option is available, please contact us for '
                'more information. Nationwide delivery service is available .',
 'doors_number': 3,
 'emission_standard': 'Euro 5',
 'engine': '1.2L',
 'engine_horse_power': 68,
 'fuel_type': 'Petrol',
 'id': '4b6371ab-1857-59ad-aca0-be907dfa09b8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250988862',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 41950,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b6371ab-1857-59ad-aca0-be907dfa09b8/4b6371ab-1857-59ad-aca0-be907dfa09b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82037,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bd5b4cdd164d4c91a5f173ff228f40ec.jpg',
             'Width': 800}],
 'price': 4400,
 'price_includes_vat': True,
 'registration_date': '2015-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford KA 1.2 Edge Euro 5 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'Edge',
 'year': 2015}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250988862%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250988862: {'created_time': 1774536018.470991, 'last_price_update_time': 1774536018.471001}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250988862') HTTP/1.1" 204 0
2026-03-26 14:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/876e2f7a11774305878621d8ba6b8156.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/385a8757e9024361a3cc7a1ac74db1e1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b829d0d8547947579f2ade393b27781e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/758cb911336d4735904eecf5827a0ea4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ac849a2f105d4733b4e9cc7ccf378b77.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c107729d0>
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac26d5f7-742f-50a5-9998-c611a8ff8318/ac26d5f7-742f-50a5-9998-c611a8ff8318_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F876e2f7a11774305878621d8ba6b8156.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/876e2f7a11774305878621d8ba6b8156.jpg saved to cache
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac26d5f7-742f-50a5-9998-c611a8ff8318
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac26d5f7-742f-50a5-9998-c611a8ff8318 sending to next pipeline
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ac26d5f7-742f-50a5-9998-c611a8ff8318 with identifier 202603090526303
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ac26d5f7-742f-50a5-9998-c611a8ff8318
2026-03-26 14:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/876e2f7a11774305878621d8ba6b8156.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Orange',
 'currency': 'GBP',
 'description': '** SOLD OUT **Vauxhall Mokka 1.4i Turbo SE Auto 2WD Euro 6 '
                '5dr in excellent condition and comes with full service '
                'history and long MOT Till  14/01/2027. SIX Months free '
                'warranty, Extended warranty is available. 12 Months free AA '
                'Roadside breakdown cover. 2 Keys. HPI is clear. Full leather '
                'interior with front heated seats, Heated steering wheel, '
                'front and rear parking sensors, Bluetooth media streaming, '
                'AUX, USB Connection with iPod Control, Cruise control, DAB '
                'radio, Door Mirrors - Electrically Foldable, Hill start '
                'assist, spare wheel. Finance option is available, Please '
                'contact us for more details. Nationwide delivery service is '
                'available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': 'ac26d5f7-742f-50a5-9998-c611a8ff8318',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090526303',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Vauxhall',
 'model': 'Mokka',
 'odometer': 62216,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac26d5f7-742f-50a5-9998-c611a8ff8318/ac26d5f7-742f-50a5-9998-c611a8ff8318_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86705,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/876e2f7a11774305878621d8ba6b8156.jpg',
             'Width': 800}],
 'price': 7500,
 'price_includes_vat': True,
 'registration_date': '2016-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka 1.4i Turbo SE Auto 2WD Euro 6 5dr',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2016}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090526303%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090526303: {'created_time': 1774536018.671011, 'last_price_update_time': 1774536018.67102}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090526303') HTTP/1.1" 204 0
2026-03-26 14:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/518e28684e3943139d0f6647d4fcdff0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/60f3d38156594f288d341df3d8549b45.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c1079b8d0>
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c1020f-daaa-5ed4-82d6-5f06bdca7111/08c1020f-daaa-5ed4-82d6-5f06bdca7111_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F385a8757e9024361a3cc7a1ac74db1e1.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/385a8757e9024361a3cc7a1ac74db1e1.jpg saved to cache
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08c1020f-daaa-5ed4-82d6-5f06bdca7111
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08c1020f-daaa-5ed4-82d6-5f06bdca7111 sending to next pipeline
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c1078d0d0>
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb46cd85-210d-546a-af48-fb7655d89983/eb46cd85-210d-546a-af48-fb7655d89983_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb829d0d8547947579f2ade393b27781e.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b829d0d8547947579f2ade393b27781e.jpg saved to cache
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb46cd85-210d-546a-af48-fb7655d89983
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb46cd85-210d-546a-af48-fb7655d89983 sending to next pipeline
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c13d2f210>
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0f31e94-508e-5869-ad45-30a440131c6a/c0f31e94-508e-5869-ad45-30a440131c6a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F758cb911336d4735904eecf5827a0ea4.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/758cb911336d4735904eecf5827a0ea4.jpg saved to cache
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0f31e94-508e-5869-ad45-30a440131c6a
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0f31e94-508e-5869-ad45-30a440131c6a sending to next pipeline
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c1251fb10>
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcff135-12ae-5a71-87da-fa29747f9fbe/afcff135-12ae-5a71-87da-fa29747f9fbe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fac849a2f105d4733b4e9cc7ccf378b77.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ac849a2f105d4733b4e9cc7ccf378b77.jpg saved to cache
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afcff135-12ae-5a71-87da-fa29747f9fbe
2026-03-26 14:40:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afcff135-12ae-5a71-87da-fa29747f9fbe sending to next pipeline
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 08c1020f-daaa-5ed4-82d6-5f06bdca7111 with identifier 202603230937962
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 08c1020f-daaa-5ed4-82d6-5f06bdca7111
2026-03-26 14:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/385a8757e9024361a3cc7a1ac74db1e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'Vauxhall Astra 1.4i Excite Euro 6 5dr in very good condition '
                'and comes with service history ( 9 stamps on the service '
                'book) . Fresh service and MOT to be carried out prior to '
                'sale. 2 keys. Two months free warranty, Extended warranty is '
                'available. 12 Months free AA roadside breakdown cover. '
                'Bluetooth connectivity, USB and AUX connection, cruise '
                'control. Finance option is available, please contact us for '
                'more information. Nationwide delivery service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '08c1020f-daaa-5ed4-82d6-5f06bdca7111',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230937962',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Vauxhall',
 'model': 'Astra',
 'odometer': 60400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c1020f-daaa-5ed4-82d6-5f06bdca7111/08c1020f-daaa-5ed4-82d6-5f06bdca7111_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88274,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/385a8757e9024361a3cc7a1ac74db1e1.jpg',
             'Width': 800}],
 'price': 4450,
 'price_includes_vat': True,
 'registration_date': '2015-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Astra 1.4i Excite Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'Excite',
 'year': 2015}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230937962%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230937962: {'created_time': 1774536018.907977, 'last_price_update_time': 1774536018.907985}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230937962') HTTP/1.1" 204 0
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: eb46cd85-210d-546a-af48-fb7655d89983 with identifier 202603230923126
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item eb46cd85-210d-546a-af48-fb7655d89983
2026-03-26 14:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b829d0d8547947579f2ade393b27781e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'White',
 'currency': 'GBP',
 'description': '** One Owner**Kia Sportage 1.7 CRDi Eco Dynamics 2 2WD  (s/s) '
                '5dr in very good condition and comes with full service '
                'history. Fresh service and MOT. New front brake discs and '
                'pads. HPI is clear. Panoramic sliding sun roof, parking '
                'sensors, Bluetooth media streaming, cruise control, '
                'electrically folding mirrors, spare wheel. Two months free '
                'warranty, Extended warranty is available. 12 Months free AA '
                'roadside breakdown cover. Nationwide delivery service is '
                'available.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.7L',
 'engine_horse_power': 114,
 'fuel_type': 'Diesel',
 'id': 'eb46cd85-210d-546a-af48-fb7655d89983',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230923126',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 69340,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 42,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb46cd85-210d-546a-af48-fb7655d89983/eb46cd85-210d-546a-af48-fb7655d89983_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79627,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b829d0d8547947579f2ade393b27781e.jpg',
             'Width': 800}],
 'price': 5950,
 'price_includes_vat': True,
 'registration_date': '2014-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage 1.7 CRDi EcoDynamics 2 2WD Euro 5 (s/s) 5dr',
 'transmission': 'manual',
 'trim': '2',
 'year': 2014}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230923126%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230923126: {'created_time': 1774536018.955581, 'last_price_update_time': 1774536018.95559}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230923126') HTTP/1.1" 204 0
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c0f31e94-508e-5869-ad45-30a440131c6a with identifier 202602270256334
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c0f31e94-508e-5869-ad45-30a440131c6a
2026-03-26 14:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/758cb911336d4735904eecf5827a0ea4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'Kia Ceed 1.6 CRDi 2 Auto 5dr in very good condition and comes '
                'with full service history. Fresh service and fresh clean MOT  '
                '.New tyres . 2 keys. Parking sensors, Bluetooth media '
                'streaming, cruise control with speed limiter, electrically '
                'folding mirrors, Steering Wheel - Paddle Shift, spare wheel. '
                'Two months free warranty, Extended warranty is available. 12 '
                'Months free AA roadside breakdown cover. Nationwide delivery '
                'service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.6L',
 'engine_horse_power': 126,
 'fuel_type': 'Diesel',
 'id': 'c0f31e94-508e-5869-ad45-30a440131c6a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270256334',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Kia',
 'model': 'Ceed',
 'odometer': 72250,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0f31e94-508e-5869-ad45-30a440131c6a/c0f31e94-508e-5869-ad45-30a440131c6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91777,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/758cb911336d4735904eecf5827a0ea4.jpg',
             'Width': 800}],
 'price': 5990,
 'price_includes_vat': True,
 'registration_date': '2014-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Ceed 1.6 CRDi 2 Auto Euro 5 5dr',
 'transmission': 'automatic',
 'trim': '2',
 'year': 2014}
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270256334%27 HTTP/1.1" 200 None
2026-03-26 14:40:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270256334: {'created_time': 1774536018.999807, 'last_price_update_time': 1774536018.999817}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270256334') HTTP/1.1" 204 0
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: afcff135-12ae-5a71-87da-fa29747f9fbe with identifier 202603230921979
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item afcff135-12ae-5a71-87da-fa29747f9fbe
2026-03-26 14:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ac849a2f105d4733b4e9cc7ccf378b77.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'MINI Hatch 1.2 One Euro 6 (s/s) 3dr in excellent condition '
                'and comes with fresh service and fresh MOT. 2 keys. £20 Road '
                'Tax. HPI is clear. Two months free warranty, Extended '
                'warranty is available. 12 Months free AA roadside breakdown '
                'cover. Bluetooth media streaming with USB, DAB radio, '
                'electrically folding mirrors, spare wheel. Finance option is '
                'available, please contact us for more information. Nationwide '
                'delivery service is available.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'fuel_type': 'Petrol',
 'id': 'afcff135-12ae-5a71-87da-fa29747f9fbe',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230921979',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 67800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 42,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcff135-12ae-5a71-87da-fa29747f9fbe/afcff135-12ae-5a71-87da-fa29747f9fbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88660,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ac849a2f105d4733b4e9cc7ccf378b77.jpg',
             'Width': 800}],
 'price': 6750,
 'price_includes_vat': True,
 'registration_date': '2015-12-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Hatch 1.2 One Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'One',
 'year': 2015}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230921979%27 HTTP/1.1" 200 None
2026-03-26 14:40:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230921979: {'created_time': 1774536019.046434, 'last_price_update_time': 1774536019.046442}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230921979') HTTP/1.1" 204 0
2026-03-26 14:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/44f0f7fd9e9b4f3ba51928b66260873f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8bcae8373a334e58a9bcd7ac44ddc178.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c1081ced0>
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7b128ee-88e4-5a19-8851-6f2da0732a97/c7b128ee-88e4-5a19-8851-6f2da0732a97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F518e28684e3943139d0f6647d4fcdff0.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/518e28684e3943139d0f6647d4fcdff0.jpg saved to cache
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7b128ee-88e4-5a19-8851-6f2da0732a97
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7b128ee-88e4-5a19-8851-6f2da0732a97 sending to next pipeline
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c108b7190>
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_655f203d-2a01-54a3-8545-1c67b6bf1729/655f203d-2a01-54a3-8545-1c67b6bf1729_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60f3d38156594f288d341df3d8549b45.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60f3d38156594f288d341df3d8549b45.jpg saved to cache
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 655f203d-2a01-54a3-8545-1c67b6bf1729
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 655f203d-2a01-54a3-8545-1c67b6bf1729 sending to next pipeline
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c7b128ee-88e4-5a19-8851-6f2da0732a97 with identifier 202603190829165
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c7b128ee-88e4-5a19-8851-6f2da0732a97
2026-03-26 14:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/518e28684e3943139d0f6647d4fcdff0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Black',
 'currency': 'GBP',
 'description': '** Low Mileage **Peugeot 308 1.4 VTi S 5dr in very good '
                'condition and comes with service history with most recent one '
                'at 52250 miles. long MOT till 18/02/2026. 2 keys. Two Months '
                'free warranty, Extended warranty is available. 12 Months free '
                'AA roadside breakdown cover. HPI is clear. Spare wheel.',
 'doors_number': 5,
 'emission_standard': 'Euro 4',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'fuel_type': 'Petrol',
 'id': 'c7b128ee-88e4-5a19-8851-6f2da0732a97',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190829165',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 52675,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b128ee-88e4-5a19-8851-6f2da0732a97/c7b128ee-88e4-5a19-8851-6f2da0732a97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83232,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/518e28684e3943139d0f6647d4fcdff0.jpg',
             'Width': 800}],
 'price': 2900,
 'price_includes_vat': True,
 'registration_date': '2010-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.4 VTi S 5dr',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2010}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190829165%27 HTTP/1.1" 200 None
2026-03-26 14:40:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190829165: {'created_time': 1774536019.203245, 'last_price_update_time': 1774536019.203253}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190829165') HTTP/1.1" 204 0
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 655f203d-2a01-54a3-8545-1c67b6bf1729 with identifier 202603140707755
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 655f203d-2a01-54a3-8545-1c67b6bf1729
2026-03-26 14:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/60f3d38156594f288d341df3d8549b45.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'Fiat 500 1.2 8V Cult Euro 6 (s/s) 3dr in very good condition '
                'and comes with service history. Fresh service, long clean MOT '
                'Till 15/12/2026 ( advisories have been repaired) . Two new '
                'front shock absorbers. Front link bars. New front tyres. 2 '
                'keys. £35 Road Tax. HPI is clear. Panoramic roof, full '
                'leather interior, parking sensors, Bluetooth, AUX, spare '
                'wheel. Two months free warranty, Extended warranty is '
                'available. 12 Months free AA roadside breakdown cover. '
                'Nationwide delivery service is available.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': '655f203d-2a01-54a3-8545-1c67b6bf1729',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603140707755',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Fiat',
 'model': '500',
 'odometer': 63500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_655f203d-2a01-54a3-8545-1c67b6bf1729/655f203d-2a01-54a3-8545-1c67b6bf1729_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 367265,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/60f3d38156594f288d341df3d8549b45.jpg',
             'Width': 2048}],
 'price': 4750,
 'price_includes_vat': True,
 'registration_date': '2014-06-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 8V Cult Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'Cult',
 'year': 2014}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140707755%27 HTTP/1.1" 200 None
2026-03-26 14:40:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603140707755: {'created_time': 1774536019.249623, 'last_price_update_time': 1774536019.249639}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603140707755') HTTP/1.1" 204 0
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c108637d0>
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8567a82-923e-50a0-999c-df2149b009a4/f8567a82-923e-50a0-999c-df2149b009a4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44f0f7fd9e9b4f3ba51928b66260873f.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44f0f7fd9e9b4f3ba51928b66260873f.jpg saved to cache
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8567a82-923e-50a0-999c-df2149b009a4
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8567a82-923e-50a0-999c-df2149b009a4 sending to next pipeline
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2c108ee310>
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 14:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d2e54ce-82e6-5925-b97e-2541e2e2bde7/1d2e54ce-82e6-5925-b97e-2541e2e2bde7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8bcae8373a334e58a9bcd7ac44ddc178.jpg') HTTP/1.1" 204 0
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8bcae8373a334e58a9bcd7ac44ddc178.jpg saved to cache
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d2e54ce-82e6-5925-b97e-2541e2e2bde7
2026-03-26 14:40:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d2e54ce-82e6-5925-b97e-2541e2e2bde7 sending to next pipeline
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f8567a82-923e-50a0-999c-df2149b009a4 with identifier 202603060466392
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f8567a82-923e-50a0-999c-df2149b009a4
2026-03-26 14:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/44f0f7fd9e9b4f3ba51928b66260873f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'Ford Focus 1.6 Zetec 3d with Low Mileage in very good '
                'condition and comes with fresh service and fresh clean MOT. '
                'Two months free warranty, Extended warranty is available. 12 '
                'Months free AA roadside breakdown cover. ULEZ compliant. HPI '
                'is clear. Parking sensors, spare wheel, Hill start assist, '
                'AUX socket. Nationwide delivery service is available.',
 'doors_number': 3,
 'emission_standard': 'Euro 4',
 'engine': '1.6L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': 'f8567a82-923e-50a0-999c-df2149b009a4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060466392',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 43050,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 37,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8567a82-923e-50a0-999c-df2149b009a4/f8567a82-923e-50a0-999c-df2149b009a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84228,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/44f0f7fd9e9b4f3ba51928b66260873f.jpg',
             'Width': 800}],
 'price': 4990,
 'price_includes_vat': True,
 'registration_date': '2010-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Zetec 3dr',
 'transmission': 'automatic',
 'trim': 'Zetec',
 'year': 2010}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060466392%27 HTTP/1.1" 200 None
2026-03-26 14:40:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060466392: {'created_time': 1774536019.396076, 'last_price_update_time': 1774536019.396091}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060466392') HTTP/1.1" 204 0
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1d2e54ce-82e6-5925-b97e-2541e2e2bde7 with identifier 202603040389359
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1d2e54ce-82e6-5925-b97e-2541e2e2bde7
2026-03-26 14:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8bcae8373a334e58a9bcd7ac44ddc178.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Nissan Qashqai 1.5 dCi n-tec 2WD Euro 6 (s/s) 5dr finished in '
                'Nightshade black in excellent condition and comes with  '
                'service history ( 9 Stamps/ Majority were carried out by main '
                'dealership), Timing belt and water pump were changed by main '
                'dealership at 47019 Miles on 11/2023. Long clean MOT Till '
                '12/11/2026. ULEZ Compliant. HPI is clear. £20 Road Tax. '
                'Reverse camera with front and rear parking sensors, Around '
                'View Monitor - 360 Bird-View, Cruise control, DAB Radio, '
                'Bluetooth media streaming, SAT Nav, Hill start assist, '
                'electrically folding mirrors. Two months free warranty, '
                'Extended warranty is available. 12 Months free AA Roadside '
                'breakdown cover. Finance option is available. Nationwide '
                'delivery service is available.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 108,
 'fuel_type': 'Diesel',
 'id': '1d2e54ce-82e6-5925-b97e-2541e2e2bde7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040389359',
 'listing': 'directbuy',
 'location': 'Nottingham, Nottinghamshire',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 60400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 45,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d2e54ce-82e6-5925-b97e-2541e2e2bde7/1d2e54ce-82e6-5925-b97e-2541e2e2bde7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86982,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8bcae8373a334e58a9bcd7ac44ddc178.jpg',
             'Width': 800}],
 'price': 7750,
 'price_includes_vat': True,
 'registration_date': '2015-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi n-tec 2WD Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'n-tec',
 'year': 2015}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040389359%27 HTTP/1.1" 200 None
2026-03-26 14:40:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040389359: {'created_time': 1774536019.442682, 'last_price_update_time': 1774536019.442697}
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040389359') HTTP/1.1" 204 0
2026-03-26 14:40:19 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 14:40:19 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-26 14:40:19 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item a7f8eeb0292111f18f76c264925fbcfa
2026-03-26 14:40:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-26 14:40:19 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-26 14:40:19 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:40:19 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 14:40:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-26 14:40:19 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-26 14:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 14:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773240020 HTTP/1.1" 200 None
2026-03-26 14:40:20 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (20 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/a7f8eeb0292111f18f76c264925fbcfa.jl
2026-03-26 14:40:20 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 7,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 7,
 'downloader/request_bytes': 159015,
 'downloader/request_count': 23,
 'downloader/request_method_count/GET': 20,
 'downloader/request_method_count/POST': 3,
 'downloader/response_bytes': 2367975,
 'downloader/response_count': 16,
 'downloader/response_status_count/200': 16,
 'elapsed_time_seconds': 20.596743,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 26, 14, 40, 20, 442409, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 20,
 'log_count/DEBUG': 344,
 'log_count/INFO': 295,
 'memusage/max': 147070976,
 'memusage/startup': 147070976,
 'photo_download_count': 13,
 'request_depth_max': 2,
 'response_received_count': 3,
 'scheduler/dequeued': 23,
 'scheduler/dequeued/memory': 23,
 'scheduler/enqueued': 23,
 'scheduler/enqueued/memory': 23,
 'scrape_type/new': 20,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 3,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.897081126614163,
 'scrapy-zyte-api/mean_response_seconds': 5.107967950093249,
 'scrapy-zyte-api/processed': 3,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 2,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
 'scrapy-zyte-api/request_args/httpRequestBody': 3,
 'scrapy-zyte-api/request_args/httpRequestMethod': 3,
 'scrapy-zyte-api/request_args/httpResponseBody': 3,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
 'scrapy-zyte-api/request_args/url': 3,
 'scrapy-zyte-api/status_codes/200': 3,
 'scrapy-zyte-api/success': 3,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 26, 14, 39, 59, 845666, tzinfo=datetime.timezone.utc)}
2026-03-26 14:40:20 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-26 14:40:20 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2c13d36ed0>
2026-03-26 14:40:20 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2c13d376d0>