log - ScrapydWeb

It's recommended to check out the latest log via: the Stats page >> View log >> Tail
PROJECT (sourcing_v2), SPIDER (auto_selling_autotrader.co.uk)

2026-03-26 11:09:59 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-26 11:09:59 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-26 11:09:59 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-26 11:09:59 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-26 11:09:59 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-26 11:09:59 [auto_selling_autotrader.co.uk] INFO: _job: 51994e1a290411f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-26 11:09:59 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-26 11:09:59 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-26 11:09:59 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-26 11:09:59 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-26 11:09:59 [scrapy.extensions.telnet] INFO: Telnet Password: 86f77cba1618fed9
2026-03-26 11:09:59 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-26 11:09:59 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/51994e1a290411f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-26 11:09:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 11:09:59 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-26 11:09:59 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-26 11:09:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-26 11:09:59 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-26 11:09:59 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-26 11:09:59 [scrapy.core.engine] INFO: Spider opened
2026-03-26 11:09:59 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 11:09:59 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-26 11:09:59 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-26 11:09:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-26 11:09:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-26 11:09:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-26 11:09:59 [scrapy-playwright] INFO: Starting download handler
2026-03-26 11:09:59 [scrapy-playwright] INFO: Starting download handler
2026-03-26 11:10:04 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 247 and multipost_profile_id: 24ee2b06-fac6-4854-902a-a2128cc48b9a and job_id: 51994e1a290411f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/sandles-car-supermarket-247
2026-03-26 11:10:04 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 1
2026-03-26 11:10:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Page: 1/16, total results: 304
2026-03-26 11:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-26 11:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250986290%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250986290: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250986176%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250986176: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250986071%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250986071: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250985914%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250985914: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250985791%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250985791: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230929036%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230929036: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230928885%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230928885: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230928701%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230928701: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230928515%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230928515: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200872986%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200872986: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200863676%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200863676: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200863579%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200863579: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725611%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160725611: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725515%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160725515: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725361%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160725361: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725310%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160725310: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725176%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160725176: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130683587%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130683587: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130663793%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130663793: 1
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130663543%27 HTTP/1.1" 200 None
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130663543: 1
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-26 11:10:06 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 2
2026-03-26 11:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Page: 2/16, total results: 304
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120647275%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120647275: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120636029%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120636029: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635689%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120635689: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635535%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120635535: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120634663%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120634663: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120634222%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120634222: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120634000%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120634000: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633728%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120633728: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633548%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120633548: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633373%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120633373: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633285%27 HTTP/1.1" 200 None
2026-03-26 11:10:07 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120633285: 1
2026-03-26 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633162%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120633162: 1
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120632905%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120632905: 1
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120632797%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120632797: 1
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120632685%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120632685: 1
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120632549%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120632549: 1
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110606407%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110606407: 1
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595953%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110595953: 1
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595850%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110595850: 1
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595746%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110595746: 1
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 3
2026-03-26 11:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe16cf1-451f-5a9c-8a3c-d6c587001ead with identifier: 202603200863676
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7fe16cf1-451f-5a9c-8a3c-d6c587001ead
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5048bbd36634363981f806e68a339a5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5048bbd36634363981f806e68a339a5.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5 with identifier: 202603200863579
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b735082-0502-5a26-8bec-626ffe185cfe with identifier: 202603160725611
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6b735082-0502-5a26-8bec-626ffe185cfe
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffafc00b8038147c59388c5c68ce93e3f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fafc00b8038147c59388c5c68ce93e3f.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5ec3d8-5535-5f63-93d2-79a271bd9be9 with identifier: 202603160725515
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d5ec3d8-5535-5f63-93d2-79a271bd9be9
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: df3d89eb-b8e3-517b-96ea-d124942445de with identifier: 202603250986290
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item df3d89eb-b8e3-517b-96ea-d124942445de
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5476199e-c6b9-5562-8b44-e98e13438ea3 with identifier: 202603160725361
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5476199e-c6b9-5562-8b44-e98e13438ea3
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a3966b-ee3e-5830-9cc4-f038f5dc7199 with identifier: 202603250986176
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 67a3966b-ee3e-5830-9cc4-f038f5dc7199
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e96de71-2327-5192-a08d-b366ce42ad4b with identifier: 202603160725310
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e96de71-2327-5192-a08d-b366ce42ad4b
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5017e434-a1bb-554b-9de1-f63c89dc0c57 with identifier: 202603250986071
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5017e434-a1bb-554b-9de1-f63c89dc0c57
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 497c1315-bd69-59da-82ed-1f00f85bafe9 with identifier: 202603160725176
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 497c1315-bd69-59da-82ed-1f00f85bafe9
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 44d217df-ab5c-5ea0-ac1e-f7cf19c3a530 with identifier: 202603250985914
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 44d217df-ab5c-5ea0-ac1e-f7cf19c3a530
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b79fb44f-c5f1-57f9-a887-393e3aec6d8a with identifier: 202603130683587
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b79fb44f-c5f1-57f9-a887-393e3aec6d8a
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84d106e8d5f74778ad941ac7e889ccdc.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84d106e8d5f74778ad941ac7e889ccdc.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 99cf9689-b6b7-55ea-ab42-69a584479624 with identifier: 202603250985791
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99cf9689-b6b7-55ea-ab42-69a584479624
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 27960c64-aa83-55ec-96a8-1e09c4757207 with identifier: 202603130663793
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 27960c64-aa83-55ec-96a8-1e09c4757207
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 681feff6-dad7-5959-9818-cc31a58f3c21 with identifier: 202603230929036
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 681feff6-dad7-5959-9818-cc31a58f3c21
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bcce212e-ccc7-5ab6-a738-9abbae28abbf with identifier: 202603130663543
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bcce212e-ccc7-5ab6-a738-9abbae28abbf
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e23adb45f0d4e0488bb492dfd2907cd.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e23adb45f0d4e0488bb492dfd2907cd.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7211b2-2aa1-599a-ac3e-f77898ec552a with identifier: 202603230928885
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a7211b2-2aa1-599a-ac3e-f77898ec552a
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4362044b42f4a1a8af1bd073ea8041f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4362044b42f4a1a8af1bd073ea8041f.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cfeb0687-3a44-5522-b12e-21c4e9e458a2 with identifier: 202603230928701
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cfeb0687-3a44-5522-b12e-21c4e9e458a2
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca4fb4e-5b54-5fde-ab69-6422904b0b89 with identifier: 202603230928515
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2ca4fb4e-5b54-5fde-ab69-6422904b0b89
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg not downloaded yet
2026-03-26 11:10:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 16246141-a97b-5491-b4c8-7e899084a2a8 with identifier: 202603200872986
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 16246141-a97b-5491-b4c8-7e899084a2a8
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F75570657b8c046d99edfb0020ef72c89.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/75570657b8c046d99edfb0020ef72c89.jpg not downloaded yet
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fafc00b8038147c59388c5c68ce93e3f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f5048bbd36634363981f806e68a339a5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-26 11:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-26 11:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e91ad0>
2026-03-26 11:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2119
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d5ec3d8-5535-5f63-93d2-79a271bd9be9/7d5ec3d8-5535-5f63-93d2-79a271bd9be9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d5ec3d8-5535-5f63-93d2-79a271bd9be9
2026-03-26 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d5ec3d8-5535-5f63-93d2-79a271bd9be9 sending to next pipeline
2026-03-26 11:10:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7d5ec3d8-5535-5f63-93d2-79a271bd9be9 with identifier 202603160725515
2026-03-26 11:10:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-26 11:10:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 11:10:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-26 11:10:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-26 11:10:09 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-26 11:10:09 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:10:09 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:10:09 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:10:09 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:10:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-26 11:10:09 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-26 11:10:10 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-26 11:10:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:10:10 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:10:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:10:10 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2013
2026-03-26 11:10:10 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774523410
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774523410
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-26 11:10:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7d5ec3d8-5535-5f63-93d2-79a271bd9be9
2026-03-26 11:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'This 2018 MINI Hatch John Cooper Works presents an '
                'exceptional opportunity with its remarkably low mileage of '
                'just 47,000 miles for its age. This performance focused '
                'variant, also a John Cooper Works trim, is powered by a '
                'potent 2.0 litre petrol engine and meets Euro 6 emissions '
                'standards. It comes equipped with the desirable CHILI Pack, '
                'which includes automatic climate control and automatic '
                'headlights, alongside rear park distance control for easier '
                'manoeuvring. Further enhancing comfort and convenience are '
                'the three stage heated seats for both the driver and front '
                'passenger, and a comprehensive navigation system featuring '
                'Apple CarPlay and Bluetooth connectivity. The inclusion of a '
                'rain sensor further contributes to the automatic headlight '
                'activation, ensuring a seamless driving experience.\n'
                '\n'
                'The John Cooper Works model truly stands out, offering a '
                'thrilling 0-62mph acceleration time of just 6.3 seconds, '
                'demonstrating its superior performance compared to other '
                'vehicles in its class. This combination of exhilarating '
                'speed, advanced technology, and thoughtful features makes '
                'this MINI Hatch a compelling choice for those seeking a '
                'dynamic and well equipped compact car.\n'
                '\n'
                'Call our sales team now to learn more.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 228,
 'fuel_type': 'Petrol',
 'id': '7d5ec3d8-5535-5f63-93d2-79a271bd9be9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160725515',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 47000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d5ec3d8-5535-5f63-93d2-79a271bd9be9/7d5ec3d8-5535-5f63-93d2-79a271bd9be9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 14499,
 'price_includes_vat': True,
 'registration_date': '2018-08-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 John Cooper Works Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'John Cooper Works',
 'year': 2018}
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725515%27 HTTP/1.1" 200 None
2026-03-26 11:10:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160725515: {'created_time': 1774523410.593625, 'last_price_update_time': 1774523410.593639}
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160725515') HTTP/1.1" 204 0
2026-03-26 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/84d106e8d5f74778ad941ac7e889ccdc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e7ead0>
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5/3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5
2026-03-26 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5 sending to next pipeline
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51df2f90>
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5476199e-c6b9-5562-8b44-e98e13438ea3/5476199e-c6b9-5562-8b44-e98e13438ea3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5476199e-c6b9-5562-8b44-e98e13438ea3
2026-03-26 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5476199e-c6b9-5562-8b44-e98e13438ea3 sending to next pipeline
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51defa90>
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df3d89eb-b8e3-517b-96ea-d124942445de/df3d89eb-b8e3-517b-96ea-d124942445de_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df3d89eb-b8e3-517b-96ea-d124942445de
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df3d89eb-b8e3-517b-96ea-d124942445de sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51defa90>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b735082-0502-5a26-8bec-626ffe185cfe/6b735082-0502-5a26-8bec-626ffe185cfe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffafc00b8038147c59388c5c68ce93e3f.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fafc00b8038147c59388c5c68ce93e3f.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b735082-0502-5a26-8bec-626ffe185cfe
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b735082-0502-5a26-8bec-626ffe185cfe sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51df2650>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a3966b-ee3e-5830-9cc4-f038f5dc7199/67a3966b-ee3e-5830-9cc4-f038f5dc7199_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67a3966b-ee3e-5830-9cc4-f038f5dc7199
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67a3966b-ee3e-5830-9cc4-f038f5dc7199 sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e7d1d0>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_497c1315-bd69-59da-82ed-1f00f85bafe9/497c1315-bd69-59da-82ed-1f00f85bafe9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 497c1315-bd69-59da-82ed-1f00f85bafe9
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 497c1315-bd69-59da-82ed-1f00f85bafe9 sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e94990>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e96de71-2327-5192-a08d-b366ce42ad4b/0e96de71-2327-5192-a08d-b366ce42ad4b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e96de71-2327-5192-a08d-b366ce42ad4b
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e96de71-2327-5192-a08d-b366ce42ad4b sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51df2850>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5017e434-a1bb-554b-9de1-f63c89dc0c57/5017e434-a1bb-554b-9de1-f63c89dc0c57_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5017e434-a1bb-554b-9de1-f63c89dc0c57
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5017e434-a1bb-554b-9de1-f63c89dc0c57 sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51417c50>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99cf9689-b6b7-55ea-ab42-69a584479624/99cf9689-b6b7-55ea-ab42-69a584479624_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99cf9689-b6b7-55ea-ab42-69a584479624
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99cf9689-b6b7-55ea-ab42-69a584479624 sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51400910>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe16cf1-451f-5a9c-8a3c-d6c587001ead/7fe16cf1-451f-5a9c-8a3c-d6c587001ead_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff5048bbd36634363981f806e68a339a5.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f5048bbd36634363981f806e68a339a5.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fe16cf1-451f-5a9c-8a3c-d6c587001ead
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fe16cf1-451f-5a9c-8a3c-d6c587001ead sending to next pipeline
2026-03-26 11:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d4362044b42f4a1a8af1bd073ea8041f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5 with identifier 202603200863579
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'GOOD CONDITION FORD FOCUS WITH UPGRADE WIRELESS PHONE '
                'CHARGER, HEAD UP DISPLAY, THE DRIVER ASSISTANCE PACK, '
                'COMFORTABLE HEATED FRONT SEATS AND THE SYNC3 TOUCHSCREEN '
                'MEDIA SYSTEM! THIS VEHICLE IS NICE TO DRIVE AND AVAILABLE NOW '
                'TO VIEW! CALL FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': '3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200863579',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 55800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5/3e6a47e3-60ad-53e4-9c1b-ae6ba7e6fda5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 11999,
 'price_includes_vat': True,
 'registration_date': '2019-04-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBlue ST-Line X Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2019}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200863579%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200863579: {'created_time': 1774523411.392633, 'last_price_update_time': 1774523411.392643}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200863579') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5476199e-c6b9-5562-8b44-e98e13438ea3 with identifier 202603160725361
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5476199e-c6b9-5562-8b44-e98e13438ea3
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GOOD CONDITION CITROEN C3 WITH AIR CONDITIONING, REAR PARKING '
                'SENSORS, DAB RADIO, BLUETOOTH, NAVIGATION SYSTEM AND '
                'SMARTPHONE INTEGRATION NOW AVAILABLE! THIS VEHICLE IS '
                'COMFORTABLE AND COMES WITH A NICE SET OF ALLOY WHEELS! CALL '
                'US FOR MORE INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'fuel_type': 'Petrol',
 'id': '5476199e-c6b9-5562-8b44-e98e13438ea3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160725361',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 41600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5476199e-c6b9-5562-8b44-e98e13438ea3/5476199e-c6b9-5562-8b44-e98e13438ea3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2019-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Origins Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Origins',
 'year': 2019}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725361%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160725361: {'created_time': 1774523411.437504, 'last_price_update_time': 1774523411.437515}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160725361') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: df3d89eb-b8e3-517b-96ea-d124942445de with identifier 202603250986290
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item df3d89eb-b8e3-517b-96ea-d124942445de
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'COMING SOON!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 187,
 'fuel_type': 'Petrol Hybrid',
 'id': 'df3d89eb-b8e3-517b-96ea-d124942445de',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250986290',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 51400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df3d89eb-b8e3-517b-96ea-d124942445de/df3d89eb-b8e3-517b-96ea-d124942445de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 17999,
 'price_includes_vat': True,
 'registration_date': '2022-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5h Duratec ST-Line X Edition CVT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'ST-Line X Edition',
 'year': 2022}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250986290%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250986290: {'created_time': 1774523411.483165, 'last_price_update_time': 1774523411.483174}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250986290') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6b735082-0502-5a26-8bec-626ffe185cfe with identifier 202603160725611
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6b735082-0502-5a26-8bec-626ffe185cfe
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fafc00b8038147c59388c5c68ce93e3f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 272,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'SUPERB AUDI R8 WITH THE HURRICAN 5.2 V10 ENGINE AND THE '
                'PERFORMANTE CARBON FIBRE KIT! THIS VEHICLE LOOKS AND SOUNDS '
                'STUNNING! THE WHEELS HAVE BEEN UPGRADED TO 20" AND THE '
                'VEHICLE HAS ALSO BEEN EQUIPPED WITH THE COMFORT AND SOUND '
                'PACKAGE FOR A MUCH MORE ENJOYABLE DRIVING EXPERIENCE AND '
                'OBVIOUSLY A LOT BETTER SOUND THROUGH THE BANG & OLUFSEN SOUND '
                'SYSTEM! BOOK YOURSELF AN APPOINTMENT TO COME AND VIEW NOW, '
                'YOU WILL NOT BE DISAPPOINTED!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '5.2L',
 'engine_horse_power': 533,
 'fuel_type': 'Petrol',
 'id': '6b735082-0502-5a26-8bec-626ffe185cfe',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160725611',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'R8',
 'odometer': 36600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b735082-0502-5a26-8bec-626ffe185cfe/6b735082-0502-5a26-8bec-626ffe185cfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273513,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fafc00b8038147c59388c5c68ce93e3f.jpg',
             'Width': 2048}],
 'price': 71999,
 'price_includes_vat': True,
 'registration_date': '2016-03-14',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Audi R8 5.2 FSI V10 S Tronic quattro Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'year': 2016}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725611%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160725611: {'created_time': 1774523411.527144, 'last_price_update_time': 1774523411.527154}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160725611') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 67a3966b-ee3e-5830-9cc4-f038f5dc7199 with identifier 202603250986176
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 67a3966b-ee3e-5830-9cc4-f038f5dc7199
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'COMING SOON!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '67a3966b-ee3e-5830-9cc4-f038f5dc7199',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250986176',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 22600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a3966b-ee3e-5830-9cc4-f038f5dc7199/67a3966b-ee3e-5830-9cc4-f038f5dc7199_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 19999,
 'price_includes_vat': True,
 'registration_date': '2023-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI EVO SEL DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SEL',
 'year': 2023}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250986176%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250986176: {'created_time': 1774523411.583667, 'last_price_update_time': 1774523411.58368}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250986176') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 497c1315-bd69-59da-82ed-1f00f85bafe9 with identifier 202603160725176
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 497c1315-bd69-59da-82ed-1f00f85bafe9
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'White',
 'currency': 'GBP',
 'description': 'EXCELLENT CONDITION VOLVO XC40 WITH BIG WHEELS, 1/2 LEATHER '
                'SEATS, POWER TAILGATE, KEYLESS ENTRY AND A TOUCHSCREEN MEDIA '
                'SYSTEM WITH DAB RADIO, BLUETOOTH AND NAVIGATION!\n'
                'CALL OUR SALES TEAM NOW FOR FURTHER INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Petrol',
 'id': '497c1315-bd69-59da-82ed-1f00f85bafe9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160725176',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 28800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_497c1315-bd69-59da-82ed-1f00f85bafe9/497c1315-bd69-59da-82ed-1f00f85bafe9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 21499,
 'price_includes_vat': True,
 'registration_date': '2019-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 R-Design Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2019}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725176%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160725176: {'created_time': 1774523411.631495, 'last_price_update_time': 1774523411.631506}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160725176') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0e96de71-2327-5192-a08d-b366ce42ad4b with identifier 202603160725310
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0e96de71-2327-5192-a08d-b366ce42ad4b
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'VW POLO WITH DAB RADIO, BLUETOOTH, APP-CONNECT, ALLOY WHEELS '
                'AND AIR CONDITIONING NOW AVAILABLE! THIS VEHICLE IS IN GOOD '
                'CONDITION AND AVAILABLE NOW TO VIEW! CALL FOR MORE DETAILS',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 94,
 'fuel_type': 'Petrol',
 'id': '0e96de71-2327-5192-a08d-b366ce42ad4b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160725310',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 46600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e96de71-2327-5192-a08d-b366ce42ad4b/0e96de71-2327-5192-a08d-b366ce42ad4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 10799,
 'price_includes_vat': True,
 'registration_date': '2018-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI SE Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2018}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160725310%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160725310: {'created_time': 1774523411.676441, 'last_price_update_time': 1774523411.67645}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160725310') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5017e434-a1bb-554b-9de1-f63c89dc0c57 with identifier 202603250986071
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5017e434-a1bb-554b-9de1-f63c89dc0c57
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'COMING SOON!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'fuel_type': 'Petrol',
 'id': '5017e434-a1bb-554b-9de1-f63c89dc0c57',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250986071',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5017e434-a1bb-554b-9de1-f63c89dc0c57/5017e434-a1bb-554b-9de1-f63c89dc0c57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 10799,
 'price_includes_vat': True,
 'registration_date': '2023-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech C-Series Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'C-Series Edition',
 'year': 2023}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250986071%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250986071: {'created_time': 1774523411.721313, 'last_price_update_time': 1774523411.721325}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250986071') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 99cf9689-b6b7-55ea-ab42-69a584479624 with identifier 202603250985791
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 99cf9689-b6b7-55ea-ab42-69a584479624
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'COMING SOON!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 161,
 'fuel_type': 'Petrol',
 'id': '99cf9689-b6b7-55ea-ab42-69a584479624',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250985791',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 34400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99cf9689-b6b7-55ea-ab42-69a584479624/99cf9689-b6b7-55ea-ab42-69a584479624_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 23499,
 'price_includes_vat': True,
 'registration_date': '2022-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T3 R-Design Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2022}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250985791%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250985791: {'created_time': 1774523411.768293, 'last_price_update_time': 1774523411.768302}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250985791') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7fe16cf1-451f-5a9c-8a3c-d6c587001ead with identifier 202603200863676
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7fe16cf1-451f-5a9c-8a3c-d6c587001ead
2026-03-26 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f5048bbd36634363981f806e68a339a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2015 Volkswagen Golf TDI Match presents an exceptional '
                'opportunity with its remarkably low mileage of just 83,500 '
                'miles for its age. This popular hatchback, featuring a 1.6 '
                'litre diesel engine, comes in the well appointed Match trim. '
                'It is equipped with front and rear parking sensors to aid '
                'manoeuvring, manual air conditioning for comfort, and '
                'Bluetooth telephone preparation for seamless connectivity. '
                'The convenience of automatic dusk sensing headlights further '
                'enhances the driving experience.\n'
                'Call us now for further information or come in to view!',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.6L',
 'engine_horse_power': 104,
 'fuel_type': 'Diesel',
 'id': '7fe16cf1-451f-5a9c-8a3c-d6c587001ead',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200863676',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 83500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe16cf1-451f-5a9c-8a3c-d6c587001ead/7fe16cf1-451f-5a9c-8a3c-d6c587001ead_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278743,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f5048bbd36634363981f806e68a339a5.jpg',
             'Width': 2048}],
 'price': 6799,
 'price_includes_vat': True,
 'registration_date': '2015-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.6 TDI BlueMotion Tech Match Euro 5 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2015}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200863676%27 HTTP/1.1" 200 None
2026-03-26 11:10:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200863676: {'created_time': 1774523411.81368, 'last_price_update_time': 1774523411.813687}
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200863676') HTTP/1.1" 204 0
2026-03-26 11:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0e23adb45f0d4e0488bb492dfd2907cd.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/75570657b8c046d99edfb0020ef72c89.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514231d0>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b79fb44f-c5f1-57f9-a887-393e3aec6d8a/b79fb44f-c5f1-57f9-a887-393e3aec6d8a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84d106e8d5f74778ad941ac7e889ccdc.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84d106e8d5f74778ad941ac7e889ccdc.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b79fb44f-c5f1-57f9-a887-393e3aec6d8a
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b79fb44f-c5f1-57f9-a887-393e3aec6d8a sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d36ad0>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44d217df-ab5c-5ea0-ac1e-f7cf19c3a530/44d217df-ab5c-5ea0-ac1e-f7cf19c3a530_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44d217df-ab5c-5ea0-ac1e-f7cf19c3a530
2026-03-26 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44d217df-ab5c-5ea0-ac1e-f7cf19c3a530 sending to next pipeline
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f42550>
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ca4fb4e-5b54-5fde-ab69-6422904b0b89/2ca4fb4e-5b54-5fde-ab69-6422904b0b89_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ca4fb4e-5b54-5fde-ab69-6422904b0b89
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ca4fb4e-5b54-5fde-ab69-6422904b0b89 sending to next pipeline
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f43450>
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfeb0687-3a44-5522-b12e-21c4e9e458a2/cfeb0687-3a44-5522-b12e-21c4e9e458a2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfeb0687-3a44-5522-b12e-21c4e9e458a2
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfeb0687-3a44-5522-b12e-21c4e9e458a2 sending to next pipeline
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f3d9d0>
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_681feff6-dad7-5959-9818-cc31a58f3c21/681feff6-dad7-5959-9818-cc31a58f3c21_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 681feff6-dad7-5959-9818-cc31a58f3c21
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 681feff6-dad7-5959-9818-cc31a58f3c21 sending to next pipeline
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Page: 3/16, total results: 304
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595659%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110595659: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595586%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110595586: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595472%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110595472: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595386%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110595386: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110594510%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110594510: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110594423%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110594423: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593994%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110593994: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593834%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110593834: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593769%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110593769: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593526%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110593526: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593351%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110593351: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593227%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110593227: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593077%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110593077: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090527878%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090527878: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090527700%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090527700: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060465081%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060465081: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060462812%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060462812: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060462636%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060462636: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060462541%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060462541: 1
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060461147%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060461147: 1
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e520788-964d-5385-8288-40283855f21e with identifier: 202603120647275
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e520788-964d-5385-8288-40283855f21e
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf4cd8ca63f7408dae6bf59f36ed2949.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df4cd8ca63f7408dae6bf59f36ed2949.jpg not downloaded yet
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 62edb34d-84af-554e-b409-f86931c46f1b with identifier: 202603120633285
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62edb34d-84af-554e-b409-f86931c46f1b
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51408910>
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a7211b2-2aa1-599a-ac3e-f77898ec552a/2a7211b2-2aa1-599a-ac3e-f77898ec552a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4362044b42f4a1a8af1bd073ea8041f.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4362044b42f4a1a8af1bd073ea8041f.jpg saved to cache
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a7211b2-2aa1-599a-ac3e-f77898ec552a
2026-03-26 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a7211b2-2aa1-599a-ac3e-f77898ec552a sending to next pipeline
2026-03-26 11:10:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b79fb44f-c5f1-57f9-a887-393e3aec6d8a with identifier 202603130683587
2026-03-26 11:10:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b79fb44f-c5f1-57f9-a887-393e3aec6d8a
2026-03-26 11:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/84d106e8d5f74778ad941ac7e889ccdc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'RS ETRON CARBON IN FANTASTIC CONDITION AND FEATURING HEATED, '
                'VENTILATED AND MASSAGE FRONT SEATS, HEATED REAR SEATS, '
                'VIRTUAL COCKPIT, PARK ASSIST, KEYLESS ENTRY, PARKING CAMERA, '
                'SMARTPHONE INTEGRATION, NAVIGATION SYSTEM, ALCANTARA STEERING '
                'WHEEL AND A LOT OF CARBON INSIDE AND OUT! THIS VEHICLE HAS '
                'BEEN WELL LOOKED AFTER AND IS AVAILABLE NOW TO VIEW! CALL US '
                'FOR MORE DETAILS!',
 'doors_number': 4,
 'engine_horse_power': 590,
 'fuel_type': 'Electric',
 'id': 'b79fb44f-c5f1-57f9-a887-393e3aec6d8a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130683587',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'RS e-tron GT',
 'odometer': 23700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b79fb44f-c5f1-57f9-a887-393e3aec6d8a/b79fb44f-c5f1-57f9-a887-393e3aec6d8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272018,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/84d106e8d5f74778ad941ac7e889ccdc.jpg',
             'Width': 2048}],
 'price': 52999,
 'price_includes_vat': True,
 'registration_date': '2022-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS e-tron GT 93.4kWh Carbon Vorsprung Auto quattro 4dr',
 'transmission': 'automatic',
 'trim': 'Carbon Vorsprung',
 'year': 2022}
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130683587%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130683587: {'created_time': 1774523412.606633, 'last_price_update_time': 1774523412.606643}
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130683587') HTTP/1.1" 204 0
2026-03-26 11:10:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 44d217df-ab5c-5ea0-ac1e-f7cf19c3a530 with identifier 202603250985914
2026-03-26 11:10:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 44d217df-ab5c-5ea0-ac1e-f7cf19c3a530
2026-03-26 11:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'COMING SOON!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 201,
 'fuel_type': 'Diesel',
 'id': '44d217df-ab5c-5ea0-ac1e-f7cf19c3a530',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250985914',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A6 Avant',
 'odometer': 32300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44d217df-ab5c-5ea0-ac1e-f7cf19c3a530/44d217df-ab5c-5ea0-ac1e-f7cf19c3a530_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 31799,
 'price_includes_vat': True,
 'registration_date': '2023-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 Avant 2.0 TDI 40 Black Edition S Tronic quattro Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2023}
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250985914%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250985914: {'created_time': 1774523412.89466, 'last_price_update_time': 1774523412.894669}
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250985914') HTTP/1.1" 204 0
2026-03-26 11:10:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2ca4fb4e-5b54-5fde-ab69-6422904b0b89 with identifier 202603230928515
2026-03-26 11:10:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2ca4fb4e-5b54-5fde-ab69-6422904b0b89
2026-03-26 11:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'CUPRA ATECA WITH TOP DOWN VIEW CAMERA, PARK ASSIST, SATELLITE '
                'NAVIGATION, DAB RADIO, WIRELESS PHONE CHARGER AND IN GREAT '
                'CONDITION NOW AVAILABLE! CALL US FOR MORE INFORMATION OR POP '
                'IN TO VIEW',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 296,
 'fuel_type': 'Petrol',
 'id': '2ca4fb4e-5b54-5fde-ab69-6422904b0b89',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230928515',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'SEAT',
 'model': 'CUPRA Ateca',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 2,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ca4fb4e-5b54-5fde-ab69-6422904b0b89/2ca4fb4e-5b54-5fde-ab69-6422904b0b89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 20499,
 'price_includes_vat': True,
 'registration_date': '2019-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT Cupra Ateca 2.0 TSI DSG 4Drive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'year': 2019}
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230928515%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230928515: {'created_time': 1774523412.94216, 'last_price_update_time': 1774523412.942167}
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230928515') HTTP/1.1" 204 0
2026-03-26 11:10:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cfeb0687-3a44-5522-b12e-21c4e9e458a2 with identifier 202603230928701
2026-03-26 11:10:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cfeb0687-3a44-5522-b12e-21c4e9e458a2
2026-03-26 11:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GREAT CONDITION FORD PUMA WITH THE ST PERFORMANCE PACK, '
                'DRIVERS ASSISTANCE PACK, THE SYNC3 NAVIGATION SYSTEM, PARKING '
                'CAMERA, KEYLESS ENTRY, PARK ASSIST, HEATED SEATS AND MUCH '
                'MORE! CALL OUR SALES TEAM TO LEARN MORE OR COME IN TO VIEW',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': 'cfeb0687-3a44-5522-b12e-21c4e9e458a2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230928701',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 43200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfeb0687-3a44-5522-b12e-21c4e9e458a2/cfeb0687-3a44-5522-b12e-21c4e9e458a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 15499,
 'price_includes_vat': True,
 'registration_date': '2021-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2021}
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230928701%27 HTTP/1.1" 200 None
2026-03-26 11:10:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230928701: {'created_time': 1774523412.994999, 'last_price_update_time': 1774523412.995009}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230928701') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 681feff6-dad7-5959-9818-cc31a58f3c21 with identifier 202603230929036
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 681feff6-dad7-5959-9818-cc31a58f3c21
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'GREAT CONDITION ABARTH JUST IN WITH UPGRADE 17”ALLOY WHEELS, '
                'YELLOW BRAKE CALIPERS AND A SCORPION ANTENNA! THIS VEHICLE '
                'HANDLES GREAT AND IS FUN TO DRIVE! IT FEATURES BLUETOOTH, DAV '
                'RADIO, AIR CONDITIONING AND COMFORTABLE SPORTS SEATS! CALL US '
                'NOW TO ARRANGE YOUR VIEWING',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 143,
 'fuel_type': 'Petrol',
 'id': '681feff6-dad7-5959-9818-cc31a58f3c21',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230929036',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Abarth',
 'model': '595',
 'odometer': 70000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681feff6-dad7-5959-9818-cc31a58f3c21/681feff6-dad7-5959-9818-cc31a58f3c21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 8799,
 'price_includes_vat': True,
 'registration_date': '2020-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 595 1.4 T-Jet 70th Euro 6 3dr',
 'transmission': 'manual',
 'trim': '70th',
 'year': 2020}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230929036%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230929036: {'created_time': 1774523413.058741, 'last_price_update_time': 1774523413.058748}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230929036') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 62edb34d-84af-554e-b409-f86931c46f1b with identifier 202603120633285
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 62edb34d-84af-554e-b409-f86931c46f1b
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2021 Volvo XC40 T3 R Design offers a refined driving '
                'experience with its Euro 6 compliant 1.5 litre petrol engine. '
                'As an R Design trim, it boasts a sporty aesthetic and comes '
                'equipped with a Climate Pack, ensuring comfort with heated '
                'seats and a heated steering wheel. Connectivity is seamless '
                'thanks to the Bluetooth Handsfree System, while the Rear Park '
                'Assist with rear sensors makes manoeuvring effortless. The '
                'automatic LED headlights with active high beam and '
                'distinctive day running lights provide excellent visibility, '
                'complemented by the 2 zone electronic climate control '
                'featuring a cooled glovebox and rear air vents for all '
                'occupants.\n'
                'Call now for further information or feel free to come in to '
                'view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 161,
 'fuel_type': 'Petrol',
 'id': '62edb34d-84af-554e-b409-f86931c46f1b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120633285',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681feff6-dad7-5959-9818-cc31a58f3c21/681feff6-dad7-5959-9818-cc31a58f3c21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 19499,
 'price_includes_vat': True,
 'registration_date': '2021-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T3 R-Design Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2021}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633285%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120633285: {'created_time': 1774523413.108379, 'last_price_update_time': 1774523413.10839}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120633285') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2a7211b2-2aa1-599a-ac3e-f77898ec552a with identifier 202603230928885
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2a7211b2-2aa1-599a-ac3e-f77898ec552a
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d4362044b42f4a1a8af1bd073ea8041f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': '2a7211b2-2aa1-599a-ac3e-f77898ec552a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230928885',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 77600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a7211b2-2aa1-599a-ac3e-f77898ec552a/2a7211b2-2aa1-599a-ac3e-f77898ec552a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275823,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d4362044b42f4a1a8af1bd073ea8041f.jpg',
             'Width': 2048}],
 'price': 9699,
 'price_includes_vat': True,
 'registration_date': '2017-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman 2.0 Cooper D ALL4 Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Cooper D',
 'year': 2017}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230928885%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230928885: {'created_time': 1774523413.160793, 'last_price_update_time': 1774523413.160801}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230928885') HTTP/1.1" 204 0
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9276f63f-e895-5691-8ee1-d6dfcaec095c with identifier: 202603120636029
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9276f63f-e895-5691-8ee1-d6dfcaec095c
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f63bb16-9872-5dcf-805f-e63f6be0f64e with identifier: 202603120633162
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2f63bb16-9872-5dcf-805f-e63f6be0f64e
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9276f63f-e895-5691-8ee1-d6dfcaec095c with identifier 202603120636029
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9276f63f-e895-5691-8ee1-d6dfcaec095c
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'White',
 'currency': 'GBP',
 'description': 'LOVELY CONDITION KIA SPORTAGE JUST ARRIVED WITH ALLOY WHEELS, '
                'AIR CONDITIONING, CRUISE CONTROL, NAVIGATION SYSTEM, DAB '
                'RADIO, SMARTPHONE INTEGRATION AND A REAR CAMERA! THIS VEHICLE '
                'IS AVAILABLE FOR VIEWING NOW, CALL FOR MORE INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'fuel_type': 'Petrol',
 'id': '9276f63f-e895-5691-8ee1-d6dfcaec095c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120636029',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 46700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 2,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681feff6-dad7-5959-9818-cc31a58f3c21/681feff6-dad7-5959-9818-cc31a58f3c21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2017-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage 1.6 GDi 2 Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': '2',
 'year': 2017}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120636029%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120636029: {'created_time': 1774523413.247409, 'last_price_update_time': 1774523413.247416}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120636029') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2f63bb16-9872-5dcf-805f-e63f6be0f64e with identifier 202603120633162
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2f63bb16-9872-5dcf-805f-e63f6be0f64e
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 Volvo XC40 T4 Inscription offers an exceptional '
                'blend of efficiency and luxury, boasting a 1.5 litre petrol '
                'plug in hybrid engine that meets Euro 6 emissions standards. '
                'This well appointed model features the desirable Inscription '
                "trim, enhancing its premium feel. You'll appreciate the "
                'convenience of the Climate Pack, which includes heated seats '
                'and a heated steering wheel for ultimate comfort in any '
                'weather. Parking is made simpler with Rear Park Assist, '
                'complete with rear parking sensors, and the Bluetooth '
                'Handsfree System ensures seamless connectivity on the go.\n'
                'Call us now to arrange your viewing.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 208,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '2f63bb16-9872-5dcf-805f-e63f6be0f64e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120633162',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681feff6-dad7-5959-9818-cc31a58f3c21/681feff6-dad7-5959-9818-cc31a58f3c21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 19299,
 'price_includes_vat': True,
 'registration_date': '2022-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5h T4 Recharge 10.7kWh Inscription Auto Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'Inscription',
 'year': 2022}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633162%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120633162: {'created_time': 1774523413.291688, 'last_price_update_time': 1774523413.291696}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120633162') HTTP/1.1" 204 0
2026-03-26 11:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51417bd0>
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcce212e-ccc7-5ab6-a738-9abbae28abbf/bcce212e-ccc7-5ab6-a738-9abbae28abbf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e23adb45f0d4e0488bb492dfd2907cd.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e23adb45f0d4e0488bb492dfd2907cd.jpg saved to cache
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcce212e-ccc7-5ab6-a738-9abbae28abbf
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcce212e-ccc7-5ab6-a738-9abbae28abbf sending to next pipeline
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f42e10>
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg saved to cache
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 27960c64-aa83-55ec-96a8-1e09c4757207
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 27960c64-aa83-55ec-96a8-1e09c4757207 sending to next pipeline
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f95050>
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16246141-a97b-5491-b4c8-7e899084a2a8/16246141-a97b-5491-b4c8-7e899084a2a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F75570657b8c046d99edfb0020ef72c89.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/75570657b8c046d99edfb0020ef72c89.jpg saved to cache
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16246141-a97b-5491-b4c8-7e899084a2a8
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16246141-a97b-5491-b4c8-7e899084a2a8 sending to next pipeline
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Getting next page: 4
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 4
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c8498a6d-7b31-5a0c-b0e9-372199f38832 with identifier: 202603120635689
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c8498a6d-7b31-5a0c-b0e9-372199f38832
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c0449dc-4697-53dd-9ea6-d44f79edf357 with identifier: 202603120632905
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c0449dc-4697-53dd-9ea6-d44f79edf357
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bcce212e-ccc7-5ab6-a738-9abbae28abbf with identifier 202603130663543
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bcce212e-ccc7-5ab6-a738-9abbae28abbf
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0e23adb45f0d4e0488bb492dfd2907cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'This 2023 23 plate Range Rover P400 HSE presents with '
                'exceptionally low mileage for its age, having covered just '
                '13,500 miles. This premium 3.0L petrol model boasts a '
                'sophisticated Four Wheel Drive system and meets Euro 6 '
                'emission standards. It is equipped with striking Digital LED '
                'Headlights featuring Signature Daytime Running Lights and '
                'impressive image projection capabilities, alongside a '
                'spacious Sliding Panoramic Roof for an open and airy cabin '
                'experience. For enhanced comfort and convenience, this HSE '
                'trim includes a Heated Steering Wheel and Adaptive Cruise '
                'Control with Steering Assist, while Bluetooth connectivity '
                'ensures seamless integration of your devices for streamed '
                'audio and telephone calls.\n'
                'This vehicle is available now, call us for more details!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 395,
 'fuel_type': 'Petrol',
 'id': 'bcce212e-ccc7-5ab6-a738-9abbae28abbf',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130663543',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 13500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcce212e-ccc7-5ab6-a738-9abbae28abbf/bcce212e-ccc7-5ab6-a738-9abbae28abbf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259676,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0e23adb45f0d4e0488bb492dfd2907cd.jpg',
             'Width': 2048}],
 'price': 84999,
 'price_includes_vat': True,
 'registration_date': '2023-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover 3.0 P400 MHEV HSE Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2023}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130663543%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130663543: {'created_time': 1774523413.601223, 'last_price_update_time': 1774523413.601231}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130663543') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 27960c64-aa83-55ec-96a8-1e09c4757207 with identifier 202603130663793
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 27960c64-aa83-55ec-96a8-1e09c4757207
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GOOD LOOKING SEAT ATECA WITH PARK ASSIST, KEYLESS ENTRY, '
                'PRIVACY GLASS, CLIMATE CONTROL, CRUISE CONTROL AND A '
                'TOUCHSCREEN MEDIA SYSTEM WITH DAB RADIO, SMARTPHONE '
                'INTEGRATION AND A PARKING CAMERA! CALL OUR SALES TEAM NOW TO '
                'LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '27960c64-aa83-55ec-96a8-1e09c4757207',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130663793',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'SEAT',
 'model': 'Ateca',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT Ateca 1.5 TSI EVO FR Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'FR Edition',
 'year': 2022}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130663793%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130663793: {'created_time': 1774523413.663571, 'last_price_update_time': 1774523413.663578}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130663793') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 16246141-a97b-5491-b4c8-7e899084a2a8 with identifier 202603200872986
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 16246141-a97b-5491-b4c8-7e899084a2a8
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/75570657b8c046d99edfb0020ef72c89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 232,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'BEAUTIFUL BMW M3 TOURING WITH THE ULTIMATE PACKAGE, M-CARBON '
                'EXTERIOR, CARBON BUCKET SEATS, MERINO LEATHER, PARKING '
                'ASSISTANCE PLUS, HEAD UP DISPLAY, DRIVE RECORDER AND MUCH '
                'MORE! THIS VEHICLE HAS ALSO HAD FULL PPF APPLIED BY TOPAZ ON '
                'TO PROTECT THE BODY WORK! CALL OUR SALES TEAM NOW FOR MORE '
                'DETAILS OR PLEASE POP IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 503,
 'fuel_type': 'Petrol',
 'id': '16246141-a97b-5491-b4c8-7e899084a2a8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200872986',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'M3',
 'odometer': 29100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 64,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16246141-a97b-5491-b4c8-7e899084a2a8/16246141-a97b-5491-b4c8-7e899084a2a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269487,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/75570657b8c046d99edfb0020ef72c89.jpg',
             'Width': 2048}],
 'price': 69499,
 'price_includes_vat': True,
 'registration_date': '2023-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW M3 3.0 BiTurbo Competition Touring Steptronic M xDrive Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2023}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200872986%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200872986: {'created_time': 1774523413.712781, 'last_price_update_time': 1774523413.712789}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200872986') HTTP/1.1" 204 0
2026-03-26 11:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c8498a6d-7b31-5a0c-b0e9-372199f38832 with identifier 202603120635689
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c8498a6d-7b31-5a0c-b0e9-372199f38832
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'The Audi Q3 TDI S line, a 2020 model, boasts a 2.0L Diesel '
                'Engine, meeting the stringent Euro 6 emission standards. This '
                'trim level is equipped with a range of advanced features, '
                'including Dual-Zone Electronic Climate Control, which allows '
                'for a comfortable temperature setting for both the driver and '
                'passenger. The vehicle also comes with Rear Parking Sensors '
                'and Parking Assistance, making navigating tight spaces a '
                'breeze. Additionally, Audi Side Assist and Blind Spot '
                'Assistance provide an extra layer of safety, while the '
                'Bluetooth Interface enables seamless connectivity. This S '
                'line variant is a well-equipped and feature-rich model.\n'
                'This Q3 is available now to view, please call our sales team '
                'for any more information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': 'c8498a6d-7b31-5a0c-b0e9-372199f38832',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120635689',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 57900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 19499,
 'price_includes_vat': True,
 'registration_date': '2020-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI 35 S line S Tronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635689%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120635689: {'created_time': 1774523413.756043, 'last_price_update_time': 1774523413.756049}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120635689') HTTP/1.1" 204 0
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2c0449dc-4697-53dd-9ea6-d44f79edf357 with identifier 202603120632905
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2c0449dc-4697-53dd-9ea6-d44f79edf357
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 78,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'GREAT CONDITION LANDROVER RANGE ROVER WITH 21”ALLOYS, POWER '
                'TAILGATE, PANORAMIC SUNROOF, FULL LEATHER UPHOLSTERY, HEATED '
                'AND COOLED FRONT SEATS AND MUCH MORE! THIS VEHICLE IS '
                'AVAILABLE NOW TO VIEW, CALL US FOR MORE DETAILS',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 398,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '2c0449dc-4697-53dd-9ea6-d44f79edf357',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120632905',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 54100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 32499,
 'price_includes_vat': True,
 'registration_date': '2020-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 2.0 P400e 13.1kWh Autobiography '
          'Dynamic Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2020}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120632905%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120632905: {'created_time': 1774523413.798691, 'last_price_update_time': 1774523413.798699}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120632905') HTTP/1.1" 204 0
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16 with identifier: 202603120635535
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe87292525cfb413a89002bdaa0d623ba.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e87292525cfb413a89002bdaa0d623ba.jpg not downloaded yet
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d547d1c9-7563-5831-b1b8-26c22cf5dc92 with identifier: 202603120632797
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d547d1c9-7563-5831-b1b8-26c22cf5dc92
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d547d1c9-7563-5831-b1b8-26c22cf5dc92 with identifier 202603120632797
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d547d1c9-7563-5831-b1b8-26c22cf5dc92
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'GOOD CONDITION MG ZS WITH LEATHER, NAVIGATION, HEATED SEATS, '
                '360 CAMERA, SMARTPHONE INTEGRATION AND MUCH MORE! THIS '
                'VEHICLE IS COMFORTABLE TO DRIVE AND IS AVAILABLE NOW! CALL US '
                'FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 109,
 'fuel_type': 'Petrol',
 'id': 'd547d1c9-7563-5831-b1b8-26c22cf5dc92',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120632797',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MG',
 'model': 'MG ZS',
 'odometer': 19500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 14499,
 'price_includes_vat': True,
 'registration_date': '2024-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG Zs 1.0 T-GDI Exclusive Auto Euro 6 5dr',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2024}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120632797%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120632797: {'created_time': 1774523413.908627, 'last_price_update_time': 1774523413.908636}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120632797') HTTP/1.1" 204 0
2026-03-26 11:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc133ad-1667-55d2-94f0-c9728003a4f5 with identifier: 202603120634663
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0cc133ad-1667-55d2-94f0-c9728003a4f5
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 85489818-ce74-5d71-9ca7-21acae78ef05 with identifier: 202603120632685
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 85489818-ce74-5d71-9ca7-21acae78ef05
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ef786f3f7b646eabcc52149a933e63f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ef786f3f7b646eabcc52149a933e63f.jpg not downloaded yet
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0cc133ad-1667-55d2-94f0-c9728003a4f5 with identifier 202603120634663
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0cc133ad-1667-55d2-94f0-c9728003a4f5
2026-03-26 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'GOOD CONDITION VAUXHALL ASTRA WITH AIR CONDITIONING, CRUISE '
                'CONTROL, PARKING SENSORS, NAVIGATION SYSTEM, DAB RADIO AND '
                'SMARTPHONE INTEGRATION! THIS VEHICLE IS AVAILABLE TO VIEW '
                'NOW, CALL US WITH ANY QUESTIONS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 108,
 'fuel_type': 'Diesel',
 'id': '0cc133ad-1667-55d2-94f0-c9728003a4f5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120634663',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Astra',
 'odometer': 57800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2019-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Astra 1.6 CDTi ecoTEC BlueInjection Tech Line Nav Sports '
          'Tourer Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Tech Line Nav',
 'year': 2019}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120634663%27 HTTP/1.1" 200 None
2026-03-26 11:10:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120634663: {'created_time': 1774523413.990665, 'last_price_update_time': 1774523413.990675}
2026-03-26 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120634663') HTTP/1.1" 204 0
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b934c997-513d-5624-8889-eff60af1f1ae with identifier: 202603120634222
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b934c997-513d-5624-8889-eff60af1f1ae
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f73f3e58-44f6-51d0-a179-443cf5733a44 with identifier: 202603120632549
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f73f3e58-44f6-51d0-a179-443cf5733a44
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b934c997-513d-5624-8889-eff60af1f1ae with identifier 202603120634222
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b934c997-513d-5624-8889-eff60af1f1ae
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'SUZUKI S-CROSS WITH AIR CONDITIONING, CRUISE CONTROL, REAR '
                'CAMERA, DAB RADIO AND IS IN GOOD CONDITION! CALL US NOW FOR '
                'MORE DETAILS OR POP IN TO VIEW',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 127,
 'fuel_type': 'Petrol Hybrid',
 'id': 'b934c997-513d-5624-8889-eff60af1f1ae',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120634222',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Suzuki',
 'model': 'S-Cross',
 'odometer': 26000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 12999,
 'price_includes_vat': True,
 'registration_date': '2023-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki S-Cross 1.4 Boosterjet MHEV Motion Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Motion',
 'year': 2023}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120634222%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120634222: {'created_time': 1774523414.12121, 'last_price_update_time': 1774523414.121218}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120634222') HTTP/1.1" 204 0
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f73f3e58-44f6-51d0-a179-443cf5733a44 with identifier 202603120632549
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f73f3e58-44f6-51d0-a179-443cf5733a44
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'LOW MILEAGE FORD KUGA WITH THE TECHNOLOGY PACKAGE NOW '
                'AVAILABLE AND IN GREAT CONDITION! THIS VEHICLE FEATURES A '
                'HEAD UP DISPLAY, 360 CAMERA, PANORAMIC  SUNROOF AND MUCH '
                'MORE! CALL US NOW TO ARRANGE YOUR VIEWING!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 240,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'f73f3e58-44f6-51d0-a179-443cf5733a44',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120632549',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 6500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 25799,
 'price_includes_vat': True,
 'registration_date': '2025-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Duratec 14.4kWh ST-Line X CVT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2025}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120632549%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120632549: {'created_time': 1774523414.167152, 'last_price_update_time': 1774523414.16716}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120632549') HTTP/1.1" 204 0
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 57563622-8046-50d8-b864-ed17980fc782 with identifier: 202603120634000
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 57563622-8046-50d8-b864-ed17980fc782
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 936b29dc-c060-5b73-8e3d-dfe5fc9b0727 with identifier: 202603110606407
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 936b29dc-c060-5b73-8e3d-dfe5fc9b0727
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F33c0ecfa70094e928a8ffb05faf5e752.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/33c0ecfa70094e928a8ffb05faf5e752.jpg not downloaded yet
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 57563622-8046-50d8-b864-ed17980fc782 with identifier 202603120634000
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 57563622-8046-50d8-b864-ed17980fc782
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'AUDI A3 WITH THE COMFORT AND SOUND PACKAGE, PARK ASSIST, REAR '
                'CAMERA, BANG & OLUFSEN SPEAKERS, HEATED FRONT SEATS, FULL '
                'LEATHER AND MUCH MORE! CALL OUR SALES TEAM  NOW FOR MORE '
                'INFORMATION',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '57563622-8046-50d8-b864-ed17980fc782',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120634000',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 24700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 21499,
 'price_includes_vat': True,
 'registration_date': '2021-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.5 TFSI 35 S line Sportback S Tronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120634000%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120634000: {'created_time': 1774523414.251714, 'last_price_update_time': 1774523414.251721}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120634000') HTTP/1.1" 204 0
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f708703-1dd5-541c-ab25-50517fd30933 with identifier: 202603120633728
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f708703-1dd5-541c-ab25-50517fd30933
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54662a513c444c768a57cdcd21ca6f94.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54662a513c444c768a57cdcd21ca6f94.jpg not downloaded yet
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e6b35112-d4cc-5f0a-9548-0cbe31054476 with identifier: 202603110595953
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6b35112-d4cc-5f0a-9548-0cbe31054476
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/df4cd8ca63f7408dae6bf59f36ed2949.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e6b35112-d4cc-5f0a-9548-0cbe31054476 with identifier 202603110595953
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e6b35112-d4cc-5f0a-9548-0cbe31054476
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'White',
 'currency': 'GBP',
 'description': 'SPORTY POLO GTI NOW AVAILABLE WITH PARKER ALLOY WHEELS, AIR '
                'CONDITIONING, DAB RADIO, APP-CONNECT AND MORE AND ITS '
                'AVAILABLE TO VIEW NOW! CALL US FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': 'e6b35112-d4cc-5f0a-9548-0cbe31054476',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110595953',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 35000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 15499,
 'price_includes_vat': True,
 'registration_date': '2019-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595953%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110595953: {'created_time': 1774523414.354144, 'last_price_update_time': 1774523414.354151}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110595953') HTTP/1.1" 204 0
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e96c6321-fc11-5994-9781-bf439fac2c44 with identifier: 202603120633548
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e96c6321-fc11-5994-9781-bf439fac2c44
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9436211e-af33-5646-8169-5f44f9400abb with identifier: 202603110595850
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9436211e-af33-5646-8169-5f44f9400abb
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e87292525cfb413a89002bdaa0d623ba.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e96c6321-fc11-5994-9781-bf439fac2c44 with identifier 202603120633548
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e96c6321-fc11-5994-9781-bf439fac2c44
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'White',
 'currency': 'GBP',
 'description': 'SPORTY FORD KUGA WITH 18”ALLOYS, 1/2 LEATHER, HEATED FRONT '
                'SEATS, NAVIGATION SYSTEM, SMARTPHONE INTEGRATION, KEYLESS '
                'ENTRY, POWER TAILGATE, PANORAMIC SUNROOF AND PRIVACY GLASS! '
                'THIS VEHICLE IS IN GOOD CONDITION AND IS AVAILABLE NOW TO '
                'VIEW',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': 'e96c6321-fc11-5994-9781-bf439fac2c44',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120633548',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 59900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 12499,
 'price_includes_vat': True,
 'registration_date': '2018-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line X Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2018}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633548%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120633548: {'created_time': 1774523414.445712, 'last_price_update_time': 1774523414.445719}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120633548') HTTP/1.1" 204 0
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9436211e-af33-5646-8169-5f44f9400abb with identifier 202603110595850
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9436211e-af33-5646-8169-5f44f9400abb
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2019 Volkswagen Golf R presents an exceptional '
                'opportunity with remarkably low mileage for its age, having '
                'covered just 33,700 miles. This Euro 6 compliant, four wheel '
                'drive model boasts a powerful 2.0 litre petrol engine, '
                'delivering exhilarating performance. It comes equipped with a '
                'suite of convenient features, including a rear view camera '
                'with parking assistance, a convenience pack with automatic '
                'headlights, and Car-Net App Connect for seamless integration '
                'with Android Auto and Apple CarPlay. The Composition Media '
                'System with Bluetooth connectivity and keyless entry further '
                'enhance the driving experience.\n'
                'Give us a call for more details or please come in to view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 296,
 'fuel_type': 'Petrol',
 'id': '9436211e-af33-5646-8169-5f44f9400abb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110595850',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 33700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 22999,
 'price_includes_vat': True,
 'registration_date': '2019-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 2.0 TSI R DSG 4Motion Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R',
 'year': 2019}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595850%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110595850: {'created_time': 1774523414.492662, 'last_price_update_time': 1774523414.492671}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110595850') HTTP/1.1" 204 0
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 64c0584a-4a60-5e29-89b3-cd108d24fb0e with identifier: 202603120633373
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 64c0584a-4a60-5e29-89b3-cd108d24fb0e
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4274f7ba12ce44e19073706481d6e09a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4274f7ba12ce44e19073706481d6e09a.jpg not downloaded yet
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 185025f4-c92f-5f6b-b53f-3076e3b19a63 with identifier: 202603110595746
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 185025f4-c92f-5f6b-b53f-3076e3b19a63
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 185025f4-c92f-5f6b-b53f-3076e3b19a63 with identifier 202603110595746
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 185025f4-c92f-5f6b-b53f-3076e3b19a63
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 240,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2020 Land Rover Range Rover Sport SD V6 HSE Dynamic is a '
                'superb example of this capable SUV. Featuring a powerful 3.0L '
                'Diesel engine and Four Wheel Drive, this Euro 6 compliant '
                'model offers impressive performance with a 0-60mph '
                'acceleration time of just 6.8 seconds. The HSE Dynamic trim '
                'level ensures a luxurious experience, enhanced by a Fixed '
                'Panoramic Roof with a powered blind, allowing you to enjoy '
                "the open sky. Inside, you'll find 16-way Memory Front Seats "
                'for ultimate comfort, Bluetooth connectivity for seamless '
                'device integration, and Automatic Headlights for convenience. '
                'The Meridian Sound System delivers 380W of premium audio, '
                'making every journey a pleasure.\n'
                'Available now for viewing, give us a call if you have any '
                'questions!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 302,
 'fuel_type': 'Diesel',
 'id': '185025f4-c92f-5f6b-b53f-3076e3b19a63',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110595746',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 65400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 29299,
 'price_includes_vat': True,
 'registration_date': '2020-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE Dynamic Auto 4WD Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2020}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595746%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110595746: {'created_time': 1774523414.682036, 'last_price_update_time': 1774523414.682047}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110595746') HTTP/1.1" 204 0
2026-03-26 11:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3ef786f3f7b646eabcc52149a933e63f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5147d210>
2026-03-26 11:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e520788-964d-5385-8288-40283855f21e/4e520788-964d-5385-8288-40283855f21e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf4cd8ca63f7408dae6bf59f36ed2949.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df4cd8ca63f7408dae6bf59f36ed2949.jpg saved to cache
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e520788-964d-5385-8288-40283855f21e
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e520788-964d-5385-8288-40283855f21e sending to next pipeline
2026-03-26 11:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121e010>
2026-03-26 11:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16/9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe87292525cfb413a89002bdaa0d623ba.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e87292525cfb413a89002bdaa0d623ba.jpg saved to cache
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16
2026-03-26 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16 sending to next pipeline
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4e520788-964d-5385-8288-40283855f21e with identifier 202603120647275
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4e520788-964d-5385-8288-40283855f21e
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/df4cd8ca63f7408dae6bf59f36ed2949.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Yellow',
 'currency': 'GBP',
 'description': 'BMW M135i WITH THE COMFORT PK, PANORAMIC ELECTRIC SUNROOF, '
                '19”ALLOY WHEEL UPGRADE, DAKOTA BLACK LEATHER SEATS, PRO '
                'PACK,  HEATED FRONT SEATS, HEATED STEERING WHEEL, HARMAN '
                'KARDON SPEAKERS, COMFORT ENTRY AND MUCH MORE! THIS VEHICLE IS '
                'IN EXCELLENT CONDITION AND IS FUN TO DRIVE! CALL OUR SALES '
                'TEAM NOW FOR MORE INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 302,
 'fuel_type': 'Petrol',
 'id': '4e520788-964d-5385-8288-40283855f21e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120647275',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 21700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e520788-964d-5385-8288-40283855f21e/4e520788-964d-5385-8288-40283855f21e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297557,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/df4cd8ca63f7408dae6bf59f36ed2949.jpg',
             'Width': 2048}],
 'price': 31799,
 'price_includes_vat': True,
 'registration_date': '2023-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 Series 2.0 M135i Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'year': 2023}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120647275%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120647275: {'created_time': 1774523414.954155, 'last_price_update_time': 1774523414.954164}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120647275') HTTP/1.1" 204 0
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16 with identifier 202603120635535
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16
2026-03-26 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e87292525cfb413a89002bdaa0d623ba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'White',
 'currency': 'GBP',
 'description': 'LOW MILEAGE TOYOTA GR WITH 18”BBS WHEELS, SMARTPHONE '
                'INTEGRATION, PARKING CAMERA, CLIMATE CONTROL, CRUISE CONTROL, '
                'DAB RADIO AND IN EXCELLENT CONDITION NOW AVAILABLE! CALL OUR '
                'SALES TEAM FOR FURTHER INFORMATION!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 257,
 'fuel_type': 'Petrol',
 'id': '9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120635535',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 26600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16/9d6cc0b8-53e3-5bf7-b54b-8d0e2005ad16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277685,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e87292525cfb413a89002bdaa0d623ba.jpg',
             'Width': 2048}],
 'price': 27999,
 'price_includes_vat': True,
 'registration_date': '2021-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.6T GR Circuit AWD Euro 6 3dr',
 'transmission': 'manual',
 'trim': 'GR Circuit',
 'year': 2021}
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120635535%27 HTTP/1.1" 200 None
2026-03-26 11:10:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120635535: {'created_time': 1774523414.99634, 'last_price_update_time': 1774523414.996349}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120635535') HTTP/1.1" 204 0
2026-03-26 11:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/33c0ecfa70094e928a8ffb05faf5e752.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/54662a513c444c768a57cdcd21ca6f94.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5126ad10>
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85489818-ce74-5d71-9ca7-21acae78ef05/85489818-ce74-5d71-9ca7-21acae78ef05_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ef786f3f7b646eabcc52149a933e63f.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ef786f3f7b646eabcc52149a933e63f.jpg saved to cache
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85489818-ce74-5d71-9ca7-21acae78ef05
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85489818-ce74-5d71-9ca7-21acae78ef05 sending to next pipeline
2026-03-26 11:10:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 85489818-ce74-5d71-9ca7-21acae78ef05 with identifier 202603120632685
2026-03-26 11:10:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 85489818-ce74-5d71-9ca7-21acae78ef05
2026-03-26 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3ef786f3f7b646eabcc52149a933e63f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'FEELS LIKE NEW FORD KUGA WITH ONLY 4800 MILES ON IT! IT COMES '
                'WITH A PANORAMIC SUNROOF, SYNC4 MEDIA SYSTEM, PARKING CAMERA '
                'WITH A 360 VIEW, HEAD UP DISPLAY, HEATED FRONT SEATS, HEATED '
                'STEERING WHEEL AND MUCH MORE! CALL NOW FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 240,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '85489818-ce74-5d71-9ca7-21acae78ef05',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120632685',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 4800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85489818-ce74-5d71-9ca7-21acae78ef05/85489818-ce74-5d71-9ca7-21acae78ef05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280309,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ef786f3f7b646eabcc52149a933e63f.jpg',
             'Width': 2048}],
 'price': 27999,
 'price_includes_vat': True,
 'registration_date': '2025-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Duratec 14.4kWh ST-Line X Black Package CVT Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'ST-Line X Black Package',
 'year': 2025}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120632685%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120632685: {'created_time': 1774523415.164093, 'last_price_update_time': 1774523415.164104}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120632685') HTTP/1.1" 204 0
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514cac50>
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_936b29dc-c060-5b73-8e3d-dfe5fc9b0727/936b29dc-c060-5b73-8e3d-dfe5fc9b0727_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F33c0ecfa70094e928a8ffb05faf5e752.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/33c0ecfa70094e928a8ffb05faf5e752.jpg saved to cache
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 936b29dc-c060-5b73-8e3d-dfe5fc9b0727
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 936b29dc-c060-5b73-8e3d-dfe5fc9b0727 sending to next pipeline
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514bd8d0>
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f708703-1dd5-541c-ab25-50517fd30933/1f708703-1dd5-541c-ab25-50517fd30933_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54662a513c444c768a57cdcd21ca6f94.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54662a513c444c768a57cdcd21ca6f94.jpg saved to cache
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f708703-1dd5-541c-ab25-50517fd30933
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f708703-1dd5-541c-ab25-50517fd30933 sending to next pipeline
2026-03-26 11:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4274f7ba12ce44e19073706481d6e09a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 936b29dc-c060-5b73-8e3d-dfe5fc9b0727 with identifier 202603110606407
2026-03-26 11:10:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 936b29dc-c060-5b73-8e3d-dfe5fc9b0727
2026-03-26 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/33c0ecfa70094e928a8ffb05faf5e752.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'EXCELLENT CONDITION CITROEN C5 WITH ALLOY WHEELS, 1/2 LEATHER '
                'SEATS, SMARTPHONE PROJECTION, POWER TAILGATE, KEYLESS ENTRY, '
                'REAR CAMERA, NAVIGATION SYSTEM, SMARTPHONE INTEGRATION AND SO '
                'MUCH MORE! CALL US FOR MORE DETAILS OR POP IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 178,
 'fuel_type': 'Petrol',
 'id': '936b29dc-c060-5b73-8e3d-dfe5fc9b0727',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110606407',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_936b29dc-c060-5b73-8e3d-dfe5fc9b0727/936b29dc-c060-5b73-8e3d-dfe5fc9b0727_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273200,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/33c0ecfa70094e928a8ffb05faf5e752.jpg',
             'Width': 2048}],
 'price': 13499,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Flair Plus EAT8 Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Flair Plus',
 'year': 2019}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110606407%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110606407: {'created_time': 1774523415.385197, 'last_price_update_time': 1774523415.385206}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110606407') HTTP/1.1" 204 0
2026-03-26 11:10:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1f708703-1dd5-541c-ab25-50517fd30933 with identifier 202603120633728
2026-03-26 11:10:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1f708703-1dd5-541c-ab25-50517fd30933
2026-03-26 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/54662a513c444c768a57cdcd21ca6f94.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'White',
 'currency': 'GBP',
 'description': 'VW GOLF WITH KEYLESS ENTRY, PARKING SENSORS, PRIVACY GLASS, '
                'CLIMATE CONTROL, ADAPTIVE CRUISE CONTROL, NAVIGATION SYSTEM, '
                'DAB RADIO, APP-CONNECT AND MUCH MORE NOW AVAILABLE! THIS '
                'VEHICLE IS IN GOOD CONDITION, CALL US WITH ANY QUESTIONS.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 197,
 'fuel_type': 'Diesel',
 'id': '1f708703-1dd5-541c-ab25-50517fd30933',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120633728',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 43000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f708703-1dd5-541c-ab25-50517fd30933/1f708703-1dd5-541c-ab25-50517fd30933_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272029,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/54662a513c444c768a57cdcd21ca6f94.jpg',
             'Width': 2048}],
 'price': 21999,
 'price_includes_vat': True,
 'registration_date': '2021-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 2.0 TDI GTD DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GTD',
 'year': 2021}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633728%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120633728: {'created_time': 1774523415.426576, 'last_price_update_time': 1774523415.426585}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120633728') HTTP/1.1" 204 0
2026-03-26 11:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e51350>
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c0584a-4a60-5e29-89b3-cd108d24fb0e/64c0584a-4a60-5e29-89b3-cd108d24fb0e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4274f7ba12ce44e19073706481d6e09a.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4274f7ba12ce44e19073706481d6e09a.jpg saved to cache
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64c0584a-4a60-5e29-89b3-cd108d24fb0e
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64c0584a-4a60-5e29-89b3-cd108d24fb0e sending to next pipeline
2026-03-26 11:10:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 64c0584a-4a60-5e29-89b3-cd108d24fb0e with identifier 202603120633373
2026-03-26 11:10:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 64c0584a-4a60-5e29-89b3-cd108d24fb0e
2026-03-26 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4274f7ba12ce44e19073706481d6e09a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2021 Volkswagen Polo TSI Match offers a superb blend of '
                'efficiency and practicality, making it an excellent choice '
                'for everyday driving. Powered by a 1.0 litre Euro 6 compliant '
                'petrol engine, this model is designed for economical '
                'journeys. It comes equipped with manual air conditioning to '
                'keep you comfortable, and front and rear parking sensors to '
                'assist with manoeuvring. The Composition Media System '
                'includes Bluetooth connectivity, while Car Net App Connect '
                'allows seamless integration with your smartphone via Android '
                'Auto and Apple CarPlay.\n'
                'Available now to view, call for any more details!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 94,
 'fuel_type': 'Petrol',
 'id': '64c0584a-4a60-5e29-89b3-cd108d24fb0e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120633373',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 51000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c0584a-4a60-5e29-89b3-cd108d24fb0e/64c0584a-4a60-5e29-89b3-cd108d24fb0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279759,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4274f7ba12ce44e19073706481d6e09a.jpg',
             'Width': 2048}],
 'price': 12299,
 'price_includes_vat': True,
 'registration_date': '2021-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Match Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2021}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120633373%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120633373: {'created_time': 1774523415.556195, 'last_price_update_time': 1774523415.556205}
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120633373') HTTP/1.1" 204 0
2026-03-26 11:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Page: 4/16, total results: 304
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060460854%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060460854: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060460792%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060460792: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060459596%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060459596: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060459328%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060459328: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050427405%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050427405: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050425143%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050425143: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040408940%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040408940: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040408615%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040408615: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040408348%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040408348: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040408182%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040408182: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040394114%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040394114: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040394041%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040394041: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393850%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040393850: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393756%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040393756: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393649%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040393649: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393537%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040393537: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393480%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040393480: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030356172%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030356172: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355966%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355966: 1
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355709%27 HTTP/1.1" 200 None
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355709: 1
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Getting next page: 5
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 5
2026-03-26 11:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:15 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:15 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5120c268-0c7e-5ba9-aa3d-74f63479e387 with identifier: 202603110595659
2026-03-26 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5120c268-0c7e-5ba9-aa3d-74f63479e387
2026-03-26 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5120c268-0c7e-5ba9-aa3d-74f63479e387 with identifier 202603110595659
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5120c268-0c7e-5ba9-aa3d-74f63479e387
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Audi A5 TFSI Black Edition offers a refined driving '
                'experience with its Euro 6 compliant 2.0 litre petrol engine. '
                'As a Black Edition model, it boasts a striking aesthetic and '
                'comes equipped with the desirable Comfort and Sound Package. '
                'This package includes keyless entry for effortless access, a '
                'luxury branded sound system to enhance your journeys, and '
                'advanced parking assistance with a 360 degree camera for '
                'complete peace of mind. Further enhancing comfort are heated '
                'front seats, and the convenience of a rear view camera is '
                'also included. Stay connected on the go with the Audi '
                'Smartphone Interface, offering seamless integration with '
                'Android Auto and Apple CarPlay, alongside a Bluetooth '
                'interface for hands free calls and audio streaming.\n'
                'Available now to view, call our sales team for further '
                'information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '5120c268-0c7e-5ba9-aa3d-74f63479e387',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110595659',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 28499,
 'price_includes_vat': True,
 'registration_date': '2023-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI 35 Black Edition Sportback S Tronic Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2023}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595659%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110595659: {'created_time': 1774523416.0309, 'last_price_update_time': 1774523416.030909}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110595659') HTTP/1.1" 204 0
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a68f72d-89eb-51c7-ae12-2c14f51d3688 with identifier: 202603110595586
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a68f72d-89eb-51c7-ae12-2c14f51d3688
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2a68f72d-89eb-51c7-ae12-2c14f51d3688 with identifier 202603110595586
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2a68f72d-89eb-51c7-ae12-2c14f51d3688
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Ford Fiesta ST-3 is a performance focused hatchback '
                'that offers an exhilarating driving experience. Powered by a '
                '1.5 litre petrol engine and meeting Euro 6 emissions '
                'standards, this model is equipped with the desirable Winter '
                'Pack, which includes heated seats and a heated steering wheel '
                'for added comfort. The cabin also benefits from Electronic '
                'Automatic Temperature Control air conditioning and the SYNC 3 '
                'system, complete with navigation, Android Auto, and Apple '
                'CarPlay for seamless connectivity. Further enhancing '
                'convenience and security, it features the Ford Key Free '
                'System for keyless entry and start, alongside a rear view '
                'camera for easier parking.\n'
                'Call us for more information or come in to view.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': '2a68f72d-89eb-51c7-ae12-2c14f51d3688',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110595586',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 21700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 18999,
 'price_includes_vat': True,
 'registration_date': '2023-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.5T EcoBoost ST-3 Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-3',
 'year': 2023}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595586%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110595586: {'created_time': 1774523416.456177, 'last_price_update_time': 1774523416.456187}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110595586') HTTP/1.1" 204 0
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 83716c89-c4f6-5c82-997d-e20b5c45abd1 with identifier: 202603110595472
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 83716c89-c4f6-5c82-997d-e20b5c45abd1
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffb81a163c8264554addb288accf0ad3e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fb81a163c8264554addb288accf0ad3e.jpg not downloaded yet
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ab69023f-42c4-5f12-a76b-777ff2df32a0 with identifier: 202603110593351
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab69023f-42c4-5f12-a76b-777ff2df32a0
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ab69023f-42c4-5f12-a76b-777ff2df32a0 with identifier 202603110593351
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ab69023f-42c4-5f12-a76b-777ff2df32a0
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2019 Skoda Octavia TSI vRS presents an exceptional '
                'opportunity with its remarkably low mileage of just 55,000 '
                'miles for its age. This Euro 6 compliant model boasts a '
                'powerful 2.0 litre petrol engine, delivering exhilarating '
                "performance. Inside, you'll find the convenience of SmartLink "
                'Plus, offering seamless integration with Android Auto and '
                'Apple CarPlay, alongside Bluetooth connectivity for '
                'effortless calls and media streaming. Comfort is assured with '
                'dual-zone air conditioning, complete with a humidity sensor '
                'and control, while the Light Assistant automatically manages '
                'the headlights. Parking is made simpler with acoustic rear '
                'parking sensors.\n'
                'This vehicle is available now to view, call us for any more '
                'details',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 242,
 'fuel_type': 'Petrol',
 'id': 'ab69023f-42c4-5f12-a76b-777ff2df32a0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110593351',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 6,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 17999,
 'price_includes_vat': True,
 'registration_date': '2019-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 2.0 TSI vRS DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'vRS',
 'year': 2019}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593351%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110593351: {'created_time': 1774523416.539385, 'last_price_update_time': 1774523416.539393}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110593351') HTTP/1.1" 204 0
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a246a42-e56a-5312-917e-8831841b1853 with identifier: 202603110595386
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5a246a42-e56a-5312-917e-8831841b1853
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 439a1d93-d868-5fe2-8662-66f8e22acfdc with identifier: 202603110593227
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 439a1d93-d868-5fe2-8662-66f8e22acfdc
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5a246a42-e56a-5312-917e-8831841b1853 with identifier 202603110595386
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5a246a42-e56a-5312-917e-8831841b1853
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Ford Mustang Mach-E Extended Range offers an '
                'impressive electric driving experience with a substantial new '
                'battery range of 335 miles. As a fully electric vehicle with '
                'four wheel drive, it combines efficiency with capable '
                'performance. This model is equipped with a generous 99 kWh '
                'battery, providing ample power for your journeys. Notable '
                'features include a convenient Wireless Device Charging Pad, '
                'BLIS Blind Spot Information System with Cross Traffic Alert '
                'for enhanced safety, and the E-Latch Keyless Entry System '
                "with B-Pillar Keypad Access for effortless entry. You'll also "
                'benefit from Adaptive Cruise Control with Stop and Go and '
                'Lane-Centering, along with Front and Rear Parking Sensors to '
                'assist with manoeuvring.\n'
                'Available now to view, call us now for more information!',
 'doors_number': 5,
 'engine_horse_power': 346,
 'fuel_type': 'Electric',
 'id': '5a246a42-e56a-5312-917e-8831841b1853',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110595386',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Mustang Mach-E',
 'odometer': 53400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 19999,
 'price_includes_vat': True,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mustang Mach-E Extended Range 91kWh AWD 5dr',
 'transmission': 'automatic',
 'year': 2021}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595386%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110595386: {'created_time': 1774523416.619208, 'last_price_update_time': 1774523416.61922}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110595386') HTTP/1.1" 204 0
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 439a1d93-d868-5fe2-8662-66f8e22acfdc with identifier 202603110593227
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 439a1d93-d868-5fe2-8662-66f8e22acfdc
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GREAT SPEC TOYOTA RAV 4 WITH BIG WHEELS, LEATHER UPHOLSTERY, '
                'HEATED FRONT SEATS, NAVIGATION SYSTEM, SMARTPHONE '
                'INTEGRATION, REAR CAMERA, CRUISE CONTROL AND A LOT MORE! CALL '
                'NOW FOR MORE DETAILS OR COME IN TO VIEW',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 215,
 'fuel_type': 'Petrol Hybrid',
 'id': '439a1d93-d868-5fe2-8662-66f8e22acfdc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110593227',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Toyota',
 'model': 'RAV4',
 'odometer': 43500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 25799,
 'price_includes_vat': True,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV4 2.5 VVT-h Black Edition CVT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2021}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593227%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110593227: {'created_time': 1774523416.677332, 'last_price_update_time': 1774523416.67734}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110593227') HTTP/1.1" 204 0
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 23033c26-2f64-5185-86e5-b447f120d653 with identifier: 202603110594510
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23033c26-2f64-5185-86e5-b447f120d653
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: faf6334d-0abf-51a1-99d4-59af19009a4a with identifier: 202603110593077
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item faf6334d-0abf-51a1-99d4-59af19009a4a
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 23033c26-2f64-5185-86e5-b447f120d653 with identifier 202603110594510
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 23033c26-2f64-5185-86e5-b447f120d653
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2017 BMW 2 Series 218i M Sport offers exceptional value '
                'with its remarkably low mileage of just 57,900 miles for its '
                'age. This Euro 6 compliant model boasts a 1.5 litre petrol '
                'engine and comes in the sporty M Sport trim, enhancing its '
                "appeal. You'll appreciate the convenience of Enhanced "
                'Bluetooth Telephone Preparation, complete with a USB audio '
                'interface and voice control, alongside a separate Bluetooth '
                'hands-free facility offering audio streaming. Driving is made '
                'easier with LED headlights for superior visibility and rear '
                'Park Distance Control to assist with parking. The rain sensor '
                "automatically activates the headlights, ensuring you're "
                'always prepared for changing conditions.\n'
                'Call us now to arrange your viewing!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '23033c26-2f64-5185-86e5-b447f120d653',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110594510',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '2 Series',
 'odometer': 57900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 12399,
 'price_includes_vat': True,
 'registration_date': '2017-11-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 2 Series 1.5 218i M Sport Auto Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110594510%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110594510: {'created_time': 1774523416.781425, 'last_price_update_time': 1774523416.781434}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110594510') HTTP/1.1" 204 0
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: faf6334d-0abf-51a1-99d4-59af19009a4a with identifier 202603110593077
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item faf6334d-0abf-51a1-99d4-59af19009a4a
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'GOOD CONDITION VAUXHALL CORSA WITH AIR CONDITIONING, HEATED '
                'FRONT SEATS, CRUISE CONTROL AND A MEDIA SYSTEM WITH DAB RADIO '
                'AND SMARTPHONE INTEGRATION! CALL US NOW TO LEARN MORE',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'faf6334d-0abf-51a1-99d4-59af19009a4a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110593077',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 20000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 13799,
 'price_includes_vat': True,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 Turbo SRi Premium Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SRi Premium',
 'year': 2021}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593077%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110593077: {'created_time': 1774523416.879398, 'last_price_update_time': 1774523416.879413}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110593077') HTTP/1.1" 204 0
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b193e1-d3eb-55ed-8ed4-30a2e03a7d69 with identifier: 202603110594423
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 51b193e1-d3eb-55ed-8ed4-30a2e03a7d69
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: afc900ec-d3b1-50ed-ae16-babb080416b7 with identifier: 202603090527878
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afc900ec-d3b1-50ed-ae16-babb080416b7
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 51b193e1-d3eb-55ed-8ed4-30a2e03a7d69 with identifier 202603110594423
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 51b193e1-d3eb-55ed-8ed4-30a2e03a7d69
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Discover this 2022 Citroen C3 C Series Edition, a stylish and '
                'practical hatchback that offers an excellent ownership '
                'proposition. Powered by an efficient 1.2 litre petrol engine, '
                'this Euro 6 compliant model is designed for everyday driving. '
                "Inside, you'll find a well equipped cabin featuring the "
                'Citroen Connect DAB radio with six speakers, offering '
                'seamless connectivity through Android Auto, Apple CarPlay, '
                'and Bluetooth. Comfort is assured with automatic air '
                'conditioning, while the LED headlights provide clear '
                'visibility. Parking is made simpler with rear parking sensors '
                'and a reversing camera, part of the comprehensive parking '
                'assistance system.\n'
                'Call us now to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'fuel_type': 'Petrol',
 'id': '51b193e1-d3eb-55ed-8ed4-30a2e03a7d69',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110594423',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 34800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech C-Series Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'C-Series Edition',
 'year': 2022}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110594423%27 HTTP/1.1" 200 None
2026-03-26 11:10:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110594423: {'created_time': 1774523416.96416, 'last_price_update_time': 1774523416.96417}
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110594423') HTTP/1.1" 204 0
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: afc900ec-d3b1-50ed-ae16-babb080416b7 with identifier 202603090527878
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item afc900ec-d3b1-50ed-ae16-babb080416b7
2026-03-26 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'LOW MILEAGE VW POLO WITH THE PARK AND CRUISE PACK, AIR '
                'CONDITIONING AND A TOUCHSCREEN MEDIA SYSTEM WITH DAB, '
                'BLUETOOTH AND APP-CONNECT! CALL US NOW TO ARRANGE YOUR '
                'VIEWING',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 59,
 'fuel_type': 'Petrol',
 'id': 'afc900ec-d3b1-50ed-ae16-babb080416b7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090527878',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 43500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 8999,
 'price_includes_vat': True,
 'registration_date': '2017-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 BlueMotion Tech Match Edition Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'Match Edition',
 'year': 2017}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090527878%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090527878: {'created_time': 1774523417.008777, 'last_price_update_time': 1774523417.008785}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090527878') HTTP/1.1" 204 0
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4190cbc4-3a33-5869-bada-f106363ed0fa with identifier: 202603110593994
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4190cbc4-3a33-5869-bada-f106363ed0fa
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a61529a1-0281-5966-ae4f-500a9b6067e7 with identifier: 202603090527700
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a61529a1-0281-5966-ae4f-500a9b6067e7
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7f1b214ad96f490caef8ddab32102ab3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7f1b214ad96f490caef8ddab32102ab3.jpg not downloaded yet
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4190cbc4-3a33-5869-bada-f106363ed0fa with identifier 202603110593994
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4190cbc4-3a33-5869-bada-f106363ed0fa
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Tesla Model Y offers an impressive electric driving '
                'experience with a maximum range of 283 miles when new. This '
                'electric vehicle is equipped with stylish 20 inch Induction '
                'Alloy Wheels and an expansive glass roof that provides '
                'ultraviolet and infrared protection, functioning as a fixed '
                'panoramic sunroof. For added comfort and safety, it features '
                'heated front and rear seats, along with blind spot monitoring '
                'and assistance. The Model Y also benefits from advanced LED '
                'headlights for enhanced visibility.\n'
                'Available now to view, please call us for more details!',
 'doors_number': 5,
 'engine_horse_power': 341,
 'fuel_type': 'Electric',
 'id': '4190cbc4-3a33-5869-bada-f106363ed0fa',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110593994',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 46400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 20999,
 'price_includes_vat': True,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y Auto RWD 5dr',
 'transmission': 'automatic',
 'year': 2023}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593994%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110593994: {'created_time': 1774523417.105066, 'last_price_update_time': 1774523417.105076}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110593994') HTTP/1.1" 204 0
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 69c34f63-e7ee-51ee-9556-64b711b88470 with identifier: 202603110593834
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69c34f63-e7ee-51ee-9556-64b711b88470
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 277cfd45-fc90-5201-9873-f033a874c127 with identifier: 202603060465081
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 277cfd45-fc90-5201-9873-f033a874c127
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fb81a163c8264554addb288accf0ad3e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 69c34f63-e7ee-51ee-9556-64b711b88470 with identifier 202603110593834
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 69c34f63-e7ee-51ee-9556-64b711b88470
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Volkswagen Tiguan TDI Elegance presents an '
                'exceptional opportunity with its remarkably low mileage of '
                'just 23,100 miles. As a Euro 6 compliant model, this diesel '
                'variant boasts a 2.0 litre engine and comes equipped with the '
                'desirable Elegance trim. Notable features include a '
                'comprehensive Winter Pack with heated outer rear seats, '
                'inductive smartphone charging for seamless connectivity, and '
                'a rear view camera to aid parking. For enhanced driving '
                'comfort and safety, it benefits from Adaptive Cruise Control '
                'with Predictive Cruise Control and an Assistance Pack that '
                'includes Blind Spot Assistance and rear parking sensors.\n'
                'Come and take a look now or call for further information.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': '69c34f63-e7ee-51ee-9556-64b711b88470',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110593834',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 23100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 24299,
 'price_includes_vat': True,
 'registration_date': '2021-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Elegance DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593834%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110593834: {'created_time': 1774523417.19897, 'last_price_update_time': 1774523417.198982}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110593834') HTTP/1.1" 204 0
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 277cfd45-fc90-5201-9873-f033a874c127 with identifier 202603060465081
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 277cfd45-fc90-5201-9873-f033a874c127
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'HIGH SPEC VOLVO V90 FITTED WITH THE XENIUM PACK INCLUDING A '
                'PANORAMIC SUNROOF! THIS VEHICLE FEATURES FULL LEATHER SEATS, '
                'HEATED AND VENTILATED FRONT SEATS, SMARTPHONE PROJECTION, 360 '
                'CAMERA, MEMORY FRONT SEATS, NAVIGATION SYSTEM, POWER '
                'TAILGATE, KEYLESS ENTRY AND SO MANY SAFETY FEATURES INCLUDING '
                'BLIND SPOT SENSORS! CALL OUR SALES TEAM NOW FOR MORE '
                'INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 232,
 'fuel_type': 'Diesel',
 'id': '277cfd45-fc90-5201-9873-f033a874c127',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060465081',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'V90 Cross Country',
 'odometer': 51300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 21499,
 'price_includes_vat': True,
 'registration_date': '2017-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V90 Cross Country 2.0 D5 PowerPulse Pro Auto AWD Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2017}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060465081%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060465081: {'created_time': 1774523417.243315, 'last_price_update_time': 1774523417.243325}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060465081') HTTP/1.1" 204 0
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e6a7d4f-96d2-5e1b-a612-70ab8f36e144 with identifier: 202603110593769
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6e6a7d4f-96d2-5e1b-a612-70ab8f36e144
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 98216382-6d45-533a-ba8f-ab27a69ecf05 with identifier: 202603060462812
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 98216382-6d45-533a-ba8f-ab27a69ecf05
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a96e58de6554f048c809a6bd94d7c15.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a96e58de6554f048c809a6bd94d7c15.jpg not downloaded yet
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6e6a7d4f-96d2-5e1b-a612-70ab8f36e144 with identifier 202603110593769
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6e6a7d4f-96d2-5e1b-a612-70ab8f36e144
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Audi A3 TFSI Technik offers a superb blend of '
                'efficiency and modern technology. Powered by a 1.0 litre Euro '
                '6 compliant petrol engine, this manual transmission model is '
                'designed for everyday driving. It comes equipped with '
                'essential features such as manual air conditioning to keep '
                'you comfortable, and a light and rain sensor system that '
                'automatically manages your headlights. Connectivity is also a '
                'breeze with the integrated Bluetooth interface, allowing for '
                'seamless phone integration.\n'
                'Call our sales team now for more information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '6e6a7d4f-96d2-5e1b-a612-70ab8f36e144',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110593769',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 31000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2023-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.0 TFSI 30 Technik Sportback Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Technik',
 'year': 2023}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593769%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110593769: {'created_time': 1774523417.329572, 'last_price_update_time': 1774523417.329581}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110593769') HTTP/1.1" 204 0
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d14c2c8-97ac-5906-bcc8-b2c89d467edd with identifier: 202603110593526
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d14c2c8-97ac-5906-bcc8-b2c89d467edd
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 219f72d7-4521-5722-a1cf-93f847e6ce72 with identifier: 202603060462636
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 219f72d7-4521-5722-a1cf-93f847e6ce72
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc108b8bb41ad4aa5a6fc0e7dfc77c834.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c108b8bb41ad4aa5a6fc0e7dfc77c834.jpg not downloaded yet
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7d14c2c8-97ac-5906-bcc8-b2c89d467edd with identifier 202603110593526
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7d14c2c8-97ac-5906-bcc8-b2c89d467edd
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 Nissan Qashqai DIG-T Tekna presents an exceptional '
                'opportunity with its remarkably low mileage of just 23,000 '
                'miles for its age. This Euro 6 compliant model is powered by '
                'an efficient 1.3 litre petrol hybrid engine, offering a '
                'refined driving experience. The Tekna trim level ensures a '
                'host of desirable features are included as standard, such as '
                'the convenient Intelligent Key with keyless entry, allowing '
                'you to unlock and start the car without fumbling for your '
                'keys. Stay comfortable on colder days with the heated '
                'steering wheel, heated seats and enjoy seamless connectivity '
                'through Bluetooth with audio streaming with smartphone '
                'integration via Apple car play and android auto. \n'
                'Call our sales team now for further details!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol Hybrid',
 'id': '7d14c2c8-97ac-5906-bcc8-b2c89d467edd',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110593526',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 23000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 16999,
 'price_includes_vat': True,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T MHEV Tekna Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2022}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110593526%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110593526: {'created_time': 1774523417.410829, 'last_price_update_time': 1774523417.410838}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110593526') HTTP/1.1" 204 0
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e53dd0>
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83716c89-c4f6-5c82-997d-e20b5c45abd1/83716c89-c4f6-5c82-997d-e20b5c45abd1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffb81a163c8264554addb288accf0ad3e.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fb81a163c8264554addb288accf0ad3e.jpg saved to cache
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83716c89-c4f6-5c82-997d-e20b5c45abd1
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83716c89-c4f6-5c82-997d-e20b5c45abd1 sending to next pipeline
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da96da8-6432-52cf-905f-e86e59c18afc with identifier: 202603060462541
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6da96da8-6432-52cf-905f-e86e59c18afc
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed145d429a194c3d968781a44687bc5b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed145d429a194c3d968781a44687bc5b.jpg not downloaded yet
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 83716c89-c4f6-5c82-997d-e20b5c45abd1 with identifier 202603110595472
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 83716c89-c4f6-5c82-997d-e20b5c45abd1
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fb81a163c8264554addb288accf0ad3e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'Experience the thrill of electric performance with this 2022 '
                'BMW i4 M50, a four wheel drive model offering an impressive '
                '318 miles of range from its 84 kWh battery. This electric '
                'vehicle is equipped with luxurious Vernasca Leather in Black '
                'with Blue Contrast Stitching, a Harman Kardon Surround Audio '
                'Sound System for an immersive listening experience, and the '
                'advanced BMW Live Cockpit Professional featuring a Head Up '
                'Display. Navigating tight spaces is made effortless thanks to '
                'the Reversing Assist Camera and the comprehensive Parking '
                'Assistant.\n'
                'Call now to arrange your viewing or any questions you may '
                'have!',
 'doors_number': 5,
 'engine_horse_power': 537,
 'fuel_type': 'Electric',
 'id': '83716c89-c4f6-5c82-997d-e20b5c45abd1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110595472',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'i4',
 'odometer': 34500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83716c89-c4f6-5c82-997d-e20b5c45abd1/83716c89-c4f6-5c82-997d-e20b5c45abd1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299799,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fb81a163c8264554addb288accf0ad3e.jpg',
             'Width': 2048}],
 'price': 29999,
 'price_includes_vat': True,
 'registration_date': '2022-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW i4 M50 83.9kWh Gran Coupe Auto 4WD 5dr',
 'transmission': 'automatic',
 'year': 2022}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110595472%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110595472: {'created_time': 1774523417.570892, 'last_price_update_time': 1774523417.570901}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110595472') HTTP/1.1" 204 0
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d8b4df-6573-5318-a18f-11b89c0605b0 with identifier: 202603060461147
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 95d8b4df-6573-5318-a18f-11b89c0605b0
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 95d8b4df-6573-5318-a18f-11b89c0605b0 with identifier 202603060461147
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 95d8b4df-6573-5318-a18f-11b89c0605b0
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'GOOD CONDITION FORD KUGA WITH ALLOY WHEELS, KEYLESS ENTRY, '
                'PARKING CAMERA, BANG & OLUFSEN CENTRE SPEAKER, SYNC3 '
                'NAVIGATION SYSTEM WITH DAB AND SMARTPHONE PROJECTION, NOW ON '
                'SITE AND AVAILABLE TO VIEW! CALL US WITH ANY QUESTIONS',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 118,
 'fuel_type': 'Diesel',
 'id': '95d8b4df-6573-5318-a18f-11b89c0605b0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060461147',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 22400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBlue Titanium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2022}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060461147%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060461147: {'created_time': 1774523417.64287, 'last_price_update_time': 1774523417.642879}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060461147') HTTP/1.1" 204 0
2026-03-26 11:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7f1b214ad96f490caef8ddab32102ab3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6a96e58de6554f048c809a6bd94d7c15.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5816f7d0>
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a61529a1-0281-5966-ae4f-500a9b6067e7/a61529a1-0281-5966-ae4f-500a9b6067e7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7f1b214ad96f490caef8ddab32102ab3.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7f1b214ad96f490caef8ddab32102ab3.jpg saved to cache
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a61529a1-0281-5966-ae4f-500a9b6067e7
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a61529a1-0281-5966-ae4f-500a9b6067e7 sending to next pipeline
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a61529a1-0281-5966-ae4f-500a9b6067e7 with identifier 202603090527700
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a61529a1-0281-5966-ae4f-500a9b6067e7
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7f1b214ad96f490caef8ddab32102ab3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'White',
 'currency': 'GBP',
 'description': 'NICE SPEC FORD FOCUS WITH THE WINTER PACK, 18”ALLOY WHEELS, '
                'KEYLESS ENTRY, PARKING SENSORS, NAVIGATION SYSTEM, DAB RADIO, '
                'POWER FOLDING MIRRORS, SMARTPHONE PROJECTION AND REALLY '
                'COMFORTABLE LEATHER SEATS JUST ARRIVED! THIS VEHICLE IS '
                'AVAILABLE TO VIEW, CALL US FOR MORE INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol Hybrid',
 'id': 'a61529a1-0281-5966-ae4f-500a9b6067e7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090527700',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 27800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a61529a1-0281-5966-ae4f-500a9b6067e7/a61529a1-0281-5966-ae4f-500a9b6067e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271967,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7f1b214ad96f490caef8ddab32102ab3.jpg',
             'Width': 2048}],
 'price': 16999,
 'price_includes_vat': True,
 'registration_date': '2024-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0T EcoBoost MHEV ST-Line X Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2024}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090527700%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090527700: {'created_time': 1774523417.880321, 'last_price_update_time': 1774523417.880335}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090527700') HTTP/1.1" 204 0
2026-03-26 11:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ed145d429a194c3d968781a44687bc5b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5816da50>
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98216382-6d45-533a-ba8f-ab27a69ecf05/98216382-6d45-533a-ba8f-ab27a69ecf05_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a96e58de6554f048c809a6bd94d7c15.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a96e58de6554f048c809a6bd94d7c15.jpg saved to cache
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98216382-6d45-533a-ba8f-ab27a69ecf05
2026-03-26 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98216382-6d45-533a-ba8f-ab27a69ecf05 sending to next pipeline
2026-03-26 11:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c108b8bb41ad4aa5a6fc0e7dfc77c834.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 98216382-6d45-533a-ba8f-ab27a69ecf05 with identifier 202603060462812
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:17 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 98216382-6d45-533a-ba8f-ab27a69ecf05
2026-03-26 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6a96e58de6554f048c809a6bd94d7c15.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'LOVELY SPEC MERCEDES GLA WITH HEATED 1/2 LEATHER ELECTRIC '
                'MEMORY SEATS, NAVIGATION SYSTEM, PANORAMIC SUNROOF, '
                'SMARTPHONE INTEGRATION, REAR CAMERA, POWER TAILGATE, KEYLESS '
                'ENTRY AND STILL MORE! CALL OUR SALES TEAM NOW FOR FULL '
                'DETAILS OR POP IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 175,
 'fuel_type': 'Diesel',
 'id': '98216382-6d45-533a-ba8f-ab27a69ecf05',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060462812',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'GLA',
 'odometer': 86500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98216382-6d45-533a-ba8f-ab27a69ecf05/98216382-6d45-533a-ba8f-ab27a69ecf05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283383,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6a96e58de6554f048c809a6bd94d7c15.jpg',
             'Width': 2048}],
 'price': 12999,
 'price_includes_vat': True,
 'registration_date': '2017-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA 2.1 GLA220d AMG Line (Premium Plus) 7G-DCT 4MATIC '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060462812%27 HTTP/1.1" 200 None
2026-03-26 11:10:17 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060462812: {'created_time': 1774523417.985695, 'last_price_update_time': 1774523417.985702}
2026-03-26 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060462812') HTTP/1.1" 204 0
2026-03-26 11:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5c4d2650>
2026-03-26 11:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6da96da8-6432-52cf-905f-e86e59c18afc/6da96da8-6432-52cf-905f-e86e59c18afc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed145d429a194c3d968781a44687bc5b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed145d429a194c3d968781a44687bc5b.jpg saved to cache
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6da96da8-6432-52cf-905f-e86e59c18afc
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6da96da8-6432-52cf-905f-e86e59c18afc sending to next pipeline
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6da96da8-6432-52cf-905f-e86e59c18afc with identifier 202603060462541
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6da96da8-6432-52cf-905f-e86e59c18afc
2026-03-26 11:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ed145d429a194c3d968781a44687bc5b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'PRETTY TOYOTA YARIS WITH ALLOY WHEELS, AIR CONDITIONING, '
                'CRUISE CONTROL AND A TOUCHSCREEN MEDIA SYSTEM WITH DAB RADIO, '
                'BLUETOOTH, PARKING CAMERA AND NAVIGATION! THIS VEHICLE IS IN '
                'GREAT CONDITION AND IS AVAILABLE NOW FOR VIEWING! CALL US '
                'FOR  FURTHER INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 109,
 'fuel_type': 'Petrol',
 'id': '6da96da8-6432-52cf-905f-e86e59c18afc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060462541',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 33400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da96da8-6432-52cf-905f-e86e59c18afc/6da96da8-6432-52cf-905f-e86e59c18afc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277612,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed145d429a194c3d968781a44687bc5b.jpg',
             'Width': 2048}],
 'price': 10799,
 'price_includes_vat': True,
 'registration_date': '2019-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 VVT-i Icon Tech Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'Icon Tech',
 'year': 2019}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060462541%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060462541: {'created_time': 1774523418.143309, 'last_price_update_time': 1774523418.143322}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060462541') HTTP/1.1" 204 0
2026-03-26 11:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514eaa90>
2026-03-26 11:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_219f72d7-4521-5722-a1cf-93f847e6ce72/219f72d7-4521-5722-a1cf-93f847e6ce72_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc108b8bb41ad4aa5a6fc0e7dfc77c834.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c108b8bb41ad4aa5a6fc0e7dfc77c834.jpg saved to cache
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 219f72d7-4521-5722-a1cf-93f847e6ce72
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 219f72d7-4521-5722-a1cf-93f847e6ce72 sending to next pipeline
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 219f72d7-4521-5722-a1cf-93f847e6ce72 with identifier 202603060462636
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 219f72d7-4521-5722-a1cf-93f847e6ce72
2026-03-26 11:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c108b8bb41ad4aa5a6fc0e7dfc77c834.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'White',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 134,
 'fuel_type': 'Diesel',
 'id': '219f72d7-4521-5722-a1cf-93f847e6ce72',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060462636',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 56300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_219f72d7-4521-5722-a1cf-93f847e6ce72/219f72d7-4521-5722-a1cf-93f847e6ce72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264457,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c108b8bb41ad4aa5a6fc0e7dfc77c834.jpg',
             'Width': 2048}],
 'price': 6299,
 'price_includes_vat': True,
 'registration_date': '2016-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Soul 1.6 CRDi Connect Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'Connect',
 'year': 2016}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060462636%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060462636: {'created_time': 1774523418.297839, 'last_price_update_time': 1774523418.297849}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060462636') HTTP/1.1" 204 0
2026-03-26 11:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f50c2ffd-e07a-5fba-ae69-7970936cfd3e with identifier: 202603060460854
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f50c2ffd-e07a-5fba-ae69-7970936cfd3e
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f50c2ffd-e07a-5fba-ae69-7970936cfd3e with identifier 202603060460854
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f50c2ffd-e07a-5fba-ae69-7970936cfd3e
2026-03-26 11:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2022 Nissan Qashqai DIG-T Acenta Premium is a superb '
                'example of a modern family car, boasting a fuel efficient '
                '1.3L Petrol Hybrid engine and meeting Euro 6 emission '
                'standards. This particular model comes with a rear view '
                'camera and rear parking sensors, enhancing parking '
                'assistance, alongside intelligent blind spot intervention for '
                'added safety on the road. Enjoy seamless connectivity with '
                'Android Auto and Apple CarPlay integration, and appreciate '
                'the convenience of automatic headlights thanks to the dusk '
                'sensor.\n'
                'Available now for viewing, any questions please call our '
                'sales team.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol Hybrid',
 'id': 'f50c2ffd-e07a-5fba-ae69-7970936cfd3e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060460854',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 35000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 13199,
 'price_includes_vat': True,
 'registration_date': '2022-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T MHEV Acenta Premium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Acenta Premium',
 'year': 2022}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060460854%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060460854: {'created_time': 1774523418.755106, 'last_price_update_time': 1774523418.755117}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060460854') HTTP/1.1" 204 0
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 822fb5b7-1912-5f1f-a014-125aa62b855e with identifier: 202603060460792
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 822fb5b7-1912-5f1f-a014-125aa62b855e
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 822fb5b7-1912-5f1f-a014-125aa62b855e with identifier 202603060460792
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 822fb5b7-1912-5f1f-a014-125aa62b855e
2026-03-26 11:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'GOOD CONDITION VW POLO WITH ALLOY WHEELS, AIR CONDITIONING, '
                'CRUISE CONTROL, APPLE CAR PLAY AND ANDROID AUTO! THIS VEHICLE '
                'HAS BEEN WELL LOOKED AFTER AND IS AVAILABLE NOW TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 79,
 'fuel_type': 'Petrol',
 'id': '822fb5b7-1912-5f1f-a014-125aa62b855e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060460792',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 14799,
 'price_includes_vat': True,
 'registration_date': '2023-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 EVO Life Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060460792%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060460792: {'created_time': 1774523418.829051, 'last_price_update_time': 1774523418.829061}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060460792') HTTP/1.1" 204 0
2026-03-26 11:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a80305-01dd-5a0a-9f5f-198f9c1bd24b with identifier: 202603060459596
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 87a80305-01dd-5a0a-9f5f-198f9c1bd24b
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdb8db2c97d6456c8b5ee8edee0aea66.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdb8db2c97d6456c8b5ee8edee0aea66.jpg not downloaded yet
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: faa9eac1-e3d1-50bc-9cab-3bb374e720f9 with identifier: 202603060459328
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item faa9eac1-e3d1-50bc-9cab-3bb374e720f9
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09f02def31354d1f9f2d2ef62a8d9d80.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09f02def31354d1f9f2d2ef62a8d9d80.jpg not downloaded yet
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fad73466-579f-5ac3-aa6e-402dfb1bb654 with identifier: 202603050427405
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fad73466-579f-5ac3-aa6e-402dfb1bb654
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb2ec22c014c4eb98f8c7a9217de9a6e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb2ec22c014c4eb98f8c7a9217de9a6e.jpg not downloaded yet
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 62835b1c-5efb-55cd-8075-9ef31490bb3c with identifier: 202603050425143
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62835b1c-5efb-55cd-8075-9ef31490bb3c
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 62835b1c-5efb-55cd-8075-9ef31490bb3c with identifier 202603050425143
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 62835b1c-5efb-55cd-8075-9ef31490bb3c
2026-03-26 11:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2022 Vauxhall Corsa Turbo SRi Edition boasts '
                'exceptionally low mileage for its age, having covered just '
                '17,600 miles. This Euro 6 compliant 1.2 litre petrol model, '
                'presented in the SRi Edition trim, offers a refined driving '
                "experience. Inside, you'll find a host of comfort and "
                'convenience features, including Electronic Climate Control to '
                'maintain your preferred cabin temperature, Heated Front Seats '
                'and a Heated Steering Wheel for those colder journeys, and '
                'Automatic Lighting Control for effortless visibility. For '
                'added peace of mind when parking, it is equipped with Rear '
                'Parking Distance Sensors.\n'
                'This vehicle is available now to view, please call our sales '
                'team with any questions!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '62835b1c-5efb-55cd-8075-9ef31490bb3c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050425143',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 17600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 11999,
 'price_includes_vat': True,
 'registration_date': '2022-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 Turbo SRi Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SRi Edition',
 'year': 2022}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050425143%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050425143: {'created_time': 1774523418.953701, 'last_price_update_time': 1774523418.953709}
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050425143') HTTP/1.1" 204 0
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ee938a-4fa4-5d7d-bc07-a971a9940835 with identifier: 202603040408940
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8ee938a-4fa4-5d7d-bc07-a971a9940835
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F47c164d595ba48899537ac10485e3796.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/47c164d595ba48899537ac10485e3796.jpg not downloaded yet
2026-03-26 11:10:18 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ae8c8493-de82-5374-a8c8-88d1a15e21c9 with identifier: 202603040408615
2026-03-26 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ae8c8493-de82-5374-a8c8-88d1a15e21c9
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd54b07f62f7c41aa989157a2e2545361.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d54b07f62f7c41aa989157a2e2545361.jpg not downloaded yet
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce8cbbd-c6b6-50f3-a03c-0a28fd22a933 with identifier: 202603040394114
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1ce8cbbd-c6b6-50f3-a03c-0a28fd22a933
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 765c6418-0d5d-5835-a3b6-eeb8dbdb432e with identifier: 202603040408348
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 765c6418-0d5d-5835-a3b6-eeb8dbdb432e
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07324b6cf5544580910df84bf86a446b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07324b6cf5544580910df84bf86a446b.jpg not downloaded yet
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1ce8cbbd-c6b6-50f3-a03c-0a28fd22a933 with identifier 202603040394114
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1ce8cbbd-c6b6-50f3-a03c-0a28fd22a933
2026-03-26 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'FORD FOCUS WITH THE SYNC4 UPGRADE MEDIA SYSTEM WITH SATELLITE '
                'NAVIGATION, DAB RADIO, SMARTPHONE PROJECTION AND ALOT MORE! '
                'IT ALSO FEATURES KEYLESS ENTRY, PRIVACY GLASS, PARKING '
                'SENSORS AND POWER FOLDING MIRRORS! COME AND TAKE A LOOK NOW '
                'OR CALL FOR FURTHER DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '1ce8cbbd-c6b6-50f3-a03c-0a28fd22a933',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040394114',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 53800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 33,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 11999,
 'price_includes_vat': True,
 'registration_date': '2022-11-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0T EcoBoost ST-Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040394114%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040394114: {'created_time': 1774523419.084093, 'last_price_update_time': 1774523419.084103}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040394114') HTTP/1.1" 204 0
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d3258da-8374-5ba1-bd61-f7a97372d279 with identifier: 202603040394041
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2d3258da-8374-5ba1-bd61-f7a97372d279
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60c6df146e60452caeb2e0e57a84e5d3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60c6df146e60452caeb2e0e57a84e5d3.jpg not downloaded yet
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b6e57449-9422-5f7b-bdc7-375ec7bf9422 with identifier: 202603040408182
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b6e57449-9422-5f7b-bdc7-375ec7bf9422
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cdb8db2c97d6456c8b5ee8edee0aea66.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/09f02def31354d1f9f2d2ef62a8d9d80.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b6e57449-9422-5f7b-bdc7-375ec7bf9422 with identifier 202603040408182
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b6e57449-9422-5f7b-bdc7-375ec7bf9422
2026-03-26 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'EXCELLENT CONDITION AUDI Q5 JUST IN WITH 19”ALLOY WHEELS, '
                'PARKING SENSORS, CLIMATE CONTROL, CRUISE CONTROL, HEATED '
                'FRONT SEATS, 1/2 LEATHER, AUDI’S VIRTUAL COCKPIT, SMARTPHONE '
                'INTEGRATION, REAR CAMERA AND MORE! THIS VEHICLE HAS BEEN WELL '
                'LOOKED AFTER AND IS CERY COMFORTABLE! CALL US NOW TO ARRANGE '
                'YOUR VIEWING',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 201,
 'fuel_type': 'Diesel',
 'id': 'b6e57449-9422-5f7b-bdc7-375ec7bf9422',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040408182',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 48100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 26999,
 'price_includes_vat': True,
 'registration_date': '2022-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI 40 S line S Tronic quattro Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040408182%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040408182: {'created_time': 1774523419.165508, 'last_price_update_time': 1774523419.165516}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040408182') HTTP/1.1" 204 0
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d2702cb9-9751-5964-abf9-e99fbb81c6a0 with identifier: 202603040393850
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d2702cb9-9751-5964-abf9-e99fbb81c6a0
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdada6d0149ad40d88c14b7a88f03371d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dada6d0149ad40d88c14b7a88f03371d.jpg not downloaded yet
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f17c5b2-e811-548b-956b-78a4bfa3ea5e with identifier: 202603040393756
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9f17c5b2-e811-548b-956b-78a4bfa3ea5e
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe721cb48d399493f9471dc45387d1003.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e721cb48d399493f9471dc45387d1003.jpg not downloaded yet
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cf87530-da11-54b5-86b0-4f84c4372206 with identifier: 202603040393649
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5cf87530-da11-54b5-86b0-4f84c4372206
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9549a5c8c9144a8d90a4860460550d03.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9549a5c8c9144a8d90a4860460550d03.jpg not downloaded yet
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bb2ec22c014c4eb98f8c7a9217de9a6e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/47c164d595ba48899537ac10485e3796.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a72caf4a-8156-521f-a0fe-7d09fa0ca0ce with identifier: 202603040393537
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a72caf4a-8156-521f-a0fe-7d09fa0ca0ce
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F834b5c28451b409cb4af89906ed128f9.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/834b5c28451b409cb4af89906ed128f9.jpg not downloaded yet
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e07bd0>
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a80305-01dd-5a0a-9f5f-198f9c1bd24b/87a80305-01dd-5a0a-9f5f-198f9c1bd24b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdb8db2c97d6456c8b5ee8edee0aea66.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdb8db2c97d6456c8b5ee8edee0aea66.jpg saved to cache
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87a80305-01dd-5a0a-9f5f-198f9c1bd24b
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87a80305-01dd-5a0a-9f5f-198f9c1bd24b sending to next pipeline
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51486f10>
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_faa9eac1-e3d1-50bc-9cab-3bb374e720f9/faa9eac1-e3d1-50bc-9cab-3bb374e720f9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F09f02def31354d1f9f2d2ef62a8d9d80.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/09f02def31354d1f9f2d2ef62a8d9d80.jpg saved to cache
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item faa9eac1-e3d1-50bc-9cab-3bb374e720f9
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item faa9eac1-e3d1-50bc-9cab-3bb374e720f9 sending to next pipeline
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d54b07f62f7c41aa989157a2e2545361.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d5f985-9f6e-5cf7-811e-0bab1a1e01d5 with identifier: 202603040393480
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 08d5f985-9f6e-5cf7-811e-0bab1a1e01d5
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2fe2ce8fabe54d33b023f483a1dce161.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2fe2ce8fabe54d33b023f483a1dce161.jpg not downloaded yet
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 87a80305-01dd-5a0a-9f5f-198f9c1bd24b with identifier 202603060459596
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 87a80305-01dd-5a0a-9f5f-198f9c1bd24b
2026-03-26 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cdb8db2c97d6456c8b5ee8edee0aea66.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GOOD LOOKING SPORTLINE KAROQ WITH 19”ALLOY WHEELS, PANORAMIC '
                'SLIDING ROOF, POWER TAILGATE, HEATED FRONT SEATS, PARKING '
                'CAMERA, NAVIGATION SYSTEM, DAB RADIO AND IN GREAT CONDITION '
                'NOW AVAILABLE! COME AND TAKE A LOOK OR GIVE US A CALL WITH '
                'ANY QUESTIONS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '87a80305-01dd-5a0a-9f5f-198f9c1bd24b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060459596',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 36900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a80305-01dd-5a0a-9f5f-198f9c1bd24b/87a80305-01dd-5a0a-9f5f-198f9c1bd24b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270954,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cdb8db2c97d6456c8b5ee8edee0aea66.jpg',
             'Width': 2048}],
 'price': 20999,
 'price_includes_vat': True,
 'registration_date': '2022-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Karoq 1.5 TSI ACT SportLine DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2022}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060459596%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060459596: {'created_time': 1774523419.462916, 'last_price_update_time': 1774523419.462925}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060459596') HTTP/1.1" 204 0
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: faa9eac1-e3d1-50bc-9cab-3bb374e720f9 with identifier 202603060459328
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item faa9eac1-e3d1-50bc-9cab-3bb374e720f9
2026-03-26 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/09f02def31354d1f9f2d2ef62a8d9d80.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'ANOTHER GREAT EXAMPLE OF A RANGE ROVER SPORT WITH UPGRADE 22” '
                '9 SPOKE BLACK GLOSS ALLOY WHEELS, POWER TAILGATE, KEYLESS '
                'ENTRY, PARKING SENSORS, REAR CAMERA, FULL LEATHER UPHOLSTERY, '
                'HEATED AND COOLED FRONT SEATS, NAVIGATION SYSTEM, SMARTPHONE '
                'PROJECTION AND SO MUCH MORE! THIS VEHICLE IS IN EXCELLENT '
                'CONDITION AND IS AVAILABLE NOW TO VIEW! CALL FOR MORE '
                'INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': 'faa9eac1-e3d1-50bc-9cab-3bb374e720f9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060459328',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_faa9eac1-e3d1-50bc-9cab-3bb374e720f9/faa9eac1-e3d1-50bc-9cab-3bb374e720f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268176,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/09f02def31354d1f9f2d2ef62a8d9d80.jpg',
             'Width': 2048}],
 'price': 37999,
 'price_includes_vat': True,
 'registration_date': '2021-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 D300 MHEV Autobiography Dynamic '
          'Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2021}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060459328%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060459328: {'created_time': 1774523419.509928, 'last_price_update_time': 1774523419.509938}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060459328') HTTP/1.1" 204 0
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 96579850-0cd5-523f-8975-de565fd6b2dc with identifier: 202603030356172
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 96579850-0cd5-523f-8975-de565fd6b2dc
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 96579850-0cd5-523f-8975-de565fd6b2dc with identifier 202603030356172
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 96579850-0cd5-523f-8975-de565fd6b2dc
2026-03-26 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'LOVELY VOLVO XC60 NOW AVAILABLE WITH HEATED FRONT SEATS, '
                'NAPPA LEATHER/TEXTILE CONTOUR SEATS, POWER TAILGATE, PARKING '
                'SENSORS, REAR CAMERA, NAVIGATION SYSTEM, DAB RADIO , WIRELESS '
                'CHARGER AND ITS AVAILABLE NOW TO VIEW! CALL US FOR MORE '
                'DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 194,
 'fuel_type': 'Diesel Hybrid',
 'id': '96579850-0cd5-523f-8975-de565fd6b2dc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030356172',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 47300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 24999,
 'price_includes_vat': True,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 MHEV R-Design Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2021}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030356172%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030356172: {'created_time': 1774523419.580317, 'last_price_update_time': 1774523419.580327}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030356172') HTTP/1.1" 204 0
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514caad0>
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fad73466-579f-5ac3-aa6e-402dfb1bb654/fad73466-579f-5ac3-aa6e-402dfb1bb654_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb2ec22c014c4eb98f8c7a9217de9a6e.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb2ec22c014c4eb98f8c7a9217de9a6e.jpg saved to cache
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fad73466-579f-5ac3-aa6e-402dfb1bb654
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fad73466-579f-5ac3-aa6e-402dfb1bb654 sending to next pipeline
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d45390>
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8ee938a-4fa4-5d7d-bc07-a971a9940835/b8ee938a-4fa4-5d7d-bc07-a971a9940835_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F47c164d595ba48899537ac10485e3796.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/47c164d595ba48899537ac10485e3796.jpg saved to cache
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8ee938a-4fa4-5d7d-bc07-a971a9940835
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8ee938a-4fa4-5d7d-bc07-a971a9940835 sending to next pipeline
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51265450>
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae8c8493-de82-5374-a8c8-88d1a15e21c9/ae8c8493-de82-5374-a8c8-88d1a15e21c9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd54b07f62f7c41aa989157a2e2545361.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d54b07f62f7c41aa989157a2e2545361.jpg saved to cache
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae8c8493-de82-5374-a8c8-88d1a15e21c9
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae8c8493-de82-5374-a8c8-88d1a15e21c9 sending to next pipeline
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/07324b6cf5544580910df84bf86a446b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7178dec3-3982-55fa-b746-356bab7cad1d with identifier: 202603030355966
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7178dec3-3982-55fa-b746-356bab7cad1d
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F101abe2ddcf5429da67f8459eeb996b3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/101abe2ddcf5429da67f8459eeb996b3.jpg not downloaded yet
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fad73466-579f-5ac3-aa6e-402dfb1bb654 with identifier 202603050427405
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fad73466-579f-5ac3-aa6e-402dfb1bb654
2026-03-26 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bb2ec22c014c4eb98f8c7a9217de9a6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'GOOD CONDITION MINI NOW AVAILABLE WITH ALLOY WHEELS, AIR '
                'CONDITIONING, DAB RADIO AND BLUETOOTH! THIS VEHICLE IS '
                'COMFORTABLE, LOW MILEAGE AND HAS BEEN LOOKED AFTER! CALL US '
                'NOW FOR MORE INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': 'fad73466-579f-5ac3-aa6e-402dfb1bb654',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050427405',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 35000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fad73466-579f-5ac3-aa6e-402dfb1bb654/fad73466-579f-5ac3-aa6e-402dfb1bb654_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285021,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb2ec22c014c4eb98f8c7a9217de9a6e.jpg',
             'Width': 2048}],
 'price': 12499,
 'price_includes_vat': True,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Hatch 1.5 Cooper Classic Hatchback 5dr Petrol Steptronic Euro '
          '6 (s/s) (136 ps)',
 'transmission': 'automatic',
 'trim': 'Cooper Classic',
 'year': 2019}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050427405%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050427405: {'created_time': 1774523419.861475, 'last_price_update_time': 1774523419.861483}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050427405') HTTP/1.1" 204 0
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b8ee938a-4fa4-5d7d-bc07-a971a9940835 with identifier 202603040408940
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b8ee938a-4fa4-5d7d-bc07-a971a9940835
2026-03-26 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/47c164d595ba48899537ac10485e3796.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GREAT CONDITION MERCEDES GLC WITH MEMORY FRONT SEATS, POWER '
                'TAILGATE, KEYLESS ENTRY, FULL LEATHER UPHOLSTERY, HEATED '
                'FRONT SEATS, NAVIGATION SYSTEM, REAR CAMERA, PANORAMIC '
                'SUNROOF AND MUCH MORE! THIS VEHICLE IS AVAILABLE NOW TO VIEW, '
                'PLEASE GIVE US A CALL FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 168,
 'fuel_type': 'Diesel',
 'id': 'b8ee938a-4fa4-5d7d-bc07-a971a9940835',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040408940',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'GLC',
 'odometer': 51400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ee938a-4fa4-5d7d-bc07-a971a9940835/b8ee938a-4fa4-5d7d-bc07-a971a9940835_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280950,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/47c164d595ba48899537ac10485e3796.jpg',
             'Width': 2048}],
 'price': 18299,
 'price_includes_vat': True,
 'registration_date': '2016-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC 2.1 GLC220d AMG Line (Premium) G-Tronic 4MATIC '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040408940%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040408940: {'created_time': 1774523419.906337, 'last_price_update_time': 1774523419.906345}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040408940') HTTP/1.1" 204 0
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ae8c8493-de82-5374-a8c8-88d1a15e21c9 with identifier 202603040408615
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ae8c8493-de82-5374-a8c8-88d1a15e21c9
2026-03-26 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d54b07f62f7c41aa989157a2e2545361.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'LOW MILEAGE TOYOTA AYGO WITH AIR CONDITIONING, ALLOY WHEELS, '
                'REAR SENSORS, PARKING CAMERA AND A TOUCHSCREEN MEDIA SYSTEM '
                'WITH NAVIGATION, DAB RADIO AND SMARTPHONE CONNECTION NOW '
                'AVAILABLE! CALL OUR SALES TEAM FOR MORE INFORMATION OR POP IN '
                'TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 70,
 'fuel_type': 'Petrol',
 'id': 'ae8c8493-de82-5374-a8c8-88d1a15e21c9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040408615',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Toyota',
 'model': 'AYGO',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae8c8493-de82-5374-a8c8-88d1a15e21c9/ae8c8493-de82-5374-a8c8-88d1a15e21c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285292,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d54b07f62f7c41aa989157a2e2545361.jpg',
             'Width': 2048}],
 'price': 8999,
 'price_includes_vat': True,
 'registration_date': '2018-12-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 VVT-i x-plore Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'x-plore',
 'year': 2018}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040408615%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040408615: {'created_time': 1774523419.948961, 'last_price_update_time': 1774523419.948973}
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040408615') HTTP/1.1" 204 0
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/60c6df146e60452caeb2e0e57a84e5d3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/dada6d0149ad40d88c14b7a88f03371d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e721cb48d399493f9471dc45387d1003.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 59135784-0ff9-57b3-9869-fb16c6d0dc90 with identifier: 202603030355709
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 59135784-0ff9-57b3-9869-fb16c6d0dc90
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 59135784-0ff9-57b3-9869-fb16c6d0dc90 with identifier 202603030355709
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 59135784-0ff9-57b3-9869-fb16c6d0dc90
2026-03-26 11:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 Tesla Model Y Long Range presents an exceptional '
                'opportunity with remarkably low mileage for its age, having '
                'covered just 26,100 miles. As a fully electric vehicle, it '
                'boasts a substantial 85 kWh battery, offering an impressive '
                'maximum range of 331 miles when new. This Four Wheel Drive '
                'model combines advanced technology with practicality, '
                'featuring desirable additions such as 20 inch Induction alloy '
                'wheels, keyless entry and driving, and a heated steering '
                'wheel for added comfort. The LED headlights ensure excellent '
                'visibility, while the heated front seats provide a pleasant '
                'experience in all conditions.\n'
                'For more details please contact our sales team or pop in to '
                'view!',
 'doors_number': 5,
 'engine_horse_power': 384,
 'fuel_type': 'Electric',
 'id': '59135784-0ff9-57b3-9869-fb16c6d0dc90',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355709',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 26100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 24999,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y (Dual Motor) Long Range Auto 4WDE 5dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2022}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355709%27 HTTP/1.1" 200 None
2026-03-26 11:10:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355709: {'created_time': 1774523420.023197, 'last_price_update_time': 1774523420.023205}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355709') HTTP/1.1" 204 0
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f0ae90>
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_765c6418-0d5d-5835-a3b6-eeb8dbdb432e/765c6418-0d5d-5835-a3b6-eeb8dbdb432e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07324b6cf5544580910df84bf86a446b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07324b6cf5544580910df84bf86a446b.jpg saved to cache
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 765c6418-0d5d-5835-a3b6-eeb8dbdb432e
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 765c6418-0d5d-5835-a3b6-eeb8dbdb432e sending to next pipeline
2026-03-26 11:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9549a5c8c9144a8d90a4860460550d03.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 765c6418-0d5d-5835-a3b6-eeb8dbdb432e with identifier 202603040408348
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 765c6418-0d5d-5835-a3b6-eeb8dbdb432e
2026-03-26 11:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/07324b6cf5544580910df84bf86a446b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'BRILLIANT SPEC MINI NOW AVAILABLE WITH 17”TENTACLE WHEELS, '
                'MINI YOURS LEATHER SEATS, HARMAN KARDON SPEAKERS, THE CHILI '
                'PACK, NAVIGATION SYSTEM, REAR CAMERA AND MUCH MORE, CALL OUR '
                'SALES TEAM NOW FOR FULL DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 189,
 'fuel_type': 'Petrol',
 'id': '765c6418-0d5d-5835-a3b6-eeb8dbdb432e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040408348',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 75000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_765c6418-0d5d-5835-a3b6-eeb8dbdb432e/765c6418-0d5d-5835-a3b6-eeb8dbdb432e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 283913,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/07324b6cf5544580910df84bf86a446b.jpg',
             'Width': 2048}],
 'price': 9799,
 'price_includes_vat': True,
 'registration_date': '2018-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 Cooper S Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Cooper S',
 'year': 2018}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040408348%27 HTTP/1.1" 200 None
2026-03-26 11:10:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040408348: {'created_time': 1774523420.166125, 'last_price_update_time': 1774523420.166133}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040408348') HTTP/1.1" 204 0
2026-03-26 11:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/834b5c28451b409cb4af89906ed128f9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2fe2ce8fabe54d33b023f483a1dce161.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58181990>
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d3258da-8374-5ba1-bd61-f7a97372d279/2d3258da-8374-5ba1-bd61-f7a97372d279_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60c6df146e60452caeb2e0e57a84e5d3.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60c6df146e60452caeb2e0e57a84e5d3.jpg saved to cache
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d3258da-8374-5ba1-bd61-f7a97372d279
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d3258da-8374-5ba1-bd61-f7a97372d279 sending to next pipeline
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d99410>
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2702cb9-9751-5964-abf9-e99fbb81c6a0/d2702cb9-9751-5964-abf9-e99fbb81c6a0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdada6d0149ad40d88c14b7a88f03371d.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dada6d0149ad40d88c14b7a88f03371d.jpg saved to cache
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2702cb9-9751-5964-abf9-e99fbb81c6a0
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2702cb9-9751-5964-abf9-e99fbb81c6a0 sending to next pipeline
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d8a890>
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f17c5b2-e811-548b-956b-78a4bfa3ea5e/9f17c5b2-e811-548b-956b-78a4bfa3ea5e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe721cb48d399493f9471dc45387d1003.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e721cb48d399493f9471dc45387d1003.jpg saved to cache
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f17c5b2-e811-548b-956b-78a4bfa3ea5e
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f17c5b2-e811-548b-956b-78a4bfa3ea5e sending to next pipeline
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2d3258da-8374-5ba1-bd61-f7a97372d279 with identifier 202603040394041
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2d3258da-8374-5ba1-bd61-f7a97372d279
2026-03-26 11:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/60c6df146e60452caeb2e0e57a84e5d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'THIS FORD MUSTANG HAS LOTS OF EQUIPMENT, FULL LEATHER '
                'UPHOLSTERY, HEATED FRONT SEATS AND A HEATED STEERING WHEEL! '
                'IT IS IN EXCELLENT CONDITION AND IS AVAILABLE NOW TO VIEW, '
                'CALL US FOR MORE DETAILS!',
 'doors_number': 5,
 'engine_horse_power': 346,
 'fuel_type': 'Electric',
 'id': '2d3258da-8374-5ba1-bd61-f7a97372d279',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040394041',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Mustang Mach-E',
 'odometer': 36700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d3258da-8374-5ba1-bd61-f7a97372d279/2d3258da-8374-5ba1-bd61-f7a97372d279_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289625,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/60c6df146e60452caeb2e0e57a84e5d3.jpg',
             'Width': 2048}],
 'price': 21499,
 'price_includes_vat': True,
 'registration_date': '2021-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mustang Mach-E Extended Range 91kWh AWD 5dr',
 'transmission': 'automatic',
 'year': 2021}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040394041%27 HTTP/1.1" 200 None
2026-03-26 11:10:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040394041: {'created_time': 1774523420.462304, 'last_price_update_time': 1774523420.462314}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040394041') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d2702cb9-9751-5964-abf9-e99fbb81c6a0 with identifier 202603040393850
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d2702cb9-9751-5964-abf9-e99fbb81c6a0
2026-03-26 11:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/dada6d0149ad40d88c14b7a88f03371d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'GOOD CONDITION MAZDA CX30 WITH KEYLESS ENTRY, HEATED SEATS, '
                'REAR CAMERA, SATELLITE NAVIGATION, DAB, SMARTPHONE PROJECTION '
                'AND MUCH MORE! COME AND TAKE A LOOK NOW OR GIVE US A CALL FOR '
                'MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 120,
 'fuel_type': 'Petrol',
 'id': 'd2702cb9-9751-5964-abf9-e99fbb81c6a0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040393850',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 48000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2702cb9-9751-5964-abf9-e99fbb81c6a0/d2702cb9-9751-5964-abf9-e99fbb81c6a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275103,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dada6d0149ad40d88c14b7a88f03371d.jpg',
             'Width': 2048}],
 'price': 13199,
 'price_includes_vat': True,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 e-SKYACTIV G MHEV SE-L Lux Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE-L Lux',
 'year': 2021}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393850%27 HTTP/1.1" 200 None
2026-03-26 11:10:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040393850: {'created_time': 1774523420.512035, 'last_price_update_time': 1774523420.512043}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040393850') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9f17c5b2-e811-548b-956b-78a4bfa3ea5e with identifier 202603040393756
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9f17c5b2-e811-548b-956b-78a4bfa3ea5e
2026-03-26 11:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e721cb48d399493f9471dc45387d1003.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 MG HS T-GDI Exclusive offers exceptional value with '
                'its remarkably low mileage of just 24,600 miles for its age. '
                'This Euro 6 compliant plug in hybrid model combines a 1.5 '
                'litre petrol engine with electric power, providing an '
                'efficient and responsive driving experience. Keyless entry '
                'with push button engine start adds convenience, while the 360 '
                'degree parking camera, complete with parking assistance, '
                'makes manoeuvring effortless. Stay connected and entertained '
                'with seamless integration of Apple CarPlay and Android Auto, '
                'and enjoy the convenience of auto headlights that adjust to '
                'changing light conditions.\n'
                'Available now to view, call us with any questions or feel '
                'free to come in and chat with us!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 254,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '9f17c5b2-e811-548b-956b-78a4bfa3ea5e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040393756',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MG',
 'model': 'MG HS',
 'odometer': 24600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f17c5b2-e811-548b-956b-78a4bfa3ea5e/9f17c5b2-e811-548b-956b-78a4bfa3ea5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270838,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e721cb48d399493f9471dc45387d1003.jpg',
             'Width': 2048}],
 'price': 15999,
 'price_includes_vat': True,
 'registration_date': '2023-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG Hs 1.5 T-GDI 16.6kWh Exclusive Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2023}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393756%27 HTTP/1.1" 200 None
2026-03-26 11:10:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040393756: {'created_time': 1774523420.558946, 'last_price_update_time': 1774523420.558953}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040393756') HTTP/1.1" 204 0
2026-03-26 11:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/101abe2ddcf5429da67f8459eeb996b3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58daa910>
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cf87530-da11-54b5-86b0-4f84c4372206/5cf87530-da11-54b5-86b0-4f84c4372206_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9549a5c8c9144a8d90a4860460550d03.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9549a5c8c9144a8d90a4860460550d03.jpg saved to cache
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cf87530-da11-54b5-86b0-4f84c4372206
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cf87530-da11-54b5-86b0-4f84c4372206 sending to next pipeline
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d9bad0>
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a72caf4a-8156-521f-a0fe-7d09fa0ca0ce/a72caf4a-8156-521f-a0fe-7d09fa0ca0ce_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F834b5c28451b409cb4af89906ed128f9.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/834b5c28451b409cb4af89906ed128f9.jpg saved to cache
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a72caf4a-8156-521f-a0fe-7d09fa0ca0ce
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a72caf4a-8156-521f-a0fe-7d09fa0ca0ce sending to next pipeline
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d9f090>
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08d5f985-9f6e-5cf7-811e-0bab1a1e01d5/08d5f985-9f6e-5cf7-811e-0bab1a1e01d5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2fe2ce8fabe54d33b023f483a1dce161.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2fe2ce8fabe54d33b023f483a1dce161.jpg saved to cache
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08d5f985-9f6e-5cf7-811e-0bab1a1e01d5
2026-03-26 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08d5f985-9f6e-5cf7-811e-0bab1a1e01d5 sending to next pipeline
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5cf87530-da11-54b5-86b0-4f84c4372206 with identifier 202603040393649
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5cf87530-da11-54b5-86b0-4f84c4372206
2026-03-26 11:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9549a5c8c9144a8d90a4860460550d03.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'GREAT CONDITION M235i WITH THE PRO PACK, 19”ALLOY WHEEL '
                'UPGRADE, HARMAN KARDON SPEAKERS, NAVIGATION SYSTEM, HEATED '
                'FRONT SEATS AND DAKOTA BLACK LEATHER SEATS! THIS VEHICLE IS '
                'GREAT TO DRIVE AND ALSO SOUNDS AMAZING! CALL US NOW TO LEARN '
                'MORE!',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 302,
 'fuel_type': 'Petrol',
 'id': '5cf87530-da11-54b5-86b0-4f84c4372206',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040393649',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '2 Series Gran Coupe',
 'odometer': 40000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cf87530-da11-54b5-86b0-4f84c4372206/5cf87530-da11-54b5-86b0-4f84c4372206_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281462,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9549a5c8c9144a8d90a4860460550d03.jpg',
             'Width': 2048}],
 'price': 22999,
 'price_includes_vat': True,
 'registration_date': '2020-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2 Series Gran Coupe 2.0 M235i Auto xDrive Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'year': 2020}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393649%27 HTTP/1.1" 200 None
2026-03-26 11:10:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040393649: {'created_time': 1774523420.872037, 'last_price_update_time': 1774523420.872047}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040393649') HTTP/1.1" 204 0
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a72caf4a-8156-521f-a0fe-7d09fa0ca0ce with identifier 202603040393537
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a72caf4a-8156-521f-a0fe-7d09fa0ca0ce
2026-03-26 11:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/834b5c28451b409cb4af89906ed128f9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 228,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'EXCELLENT SPEC AND CONDITION JAGUAR F-PACE WITH 22”ALLOY '
                'WHEELS, PANORAMIC ROOF, HEATED AND VENTILATED ELECTRIC MEMORY '
                'FRONT SEATS, POWER TAILGATE, SMARTPHONE PROJECTION, HEAD UP '
                'DISPLAY, WIRELESS PHONE CHARGER AND PLENTY MORE! CALL US FOR '
                'MORE DETAILS OR COME IN TO VIEW NOW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 394,
 'fuel_type': 'Petrol',
 'id': 'a72caf4a-8156-521f-a0fe-7d09fa0ca0ce',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040393537',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Jaguar',
 'model': 'F-PACE',
 'odometer': 21000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a72caf4a-8156-521f-a0fe-7d09fa0ca0ce/a72caf4a-8156-521f-a0fe-7d09fa0ca0ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279470,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/834b5c28451b409cb4af89906ed128f9.jpg',
             'Width': 2048}],
 'price': 40799,
 'price_includes_vat': True,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 3.0 P400 MHEV R-Dynamic HSE Auto AWD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE',
 'year': 2021}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393537%27 HTTP/1.1" 200 None
2026-03-26 11:10:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040393537: {'created_time': 1774523420.930385, 'last_price_update_time': 1774523420.930392}
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040393537') HTTP/1.1" 204 0
2026-03-26 11:10:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 08d5f985-9f6e-5cf7-811e-0bab1a1e01d5 with identifier 202603040393480
2026-03-26 11:10:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 08d5f985-9f6e-5cf7-811e-0bab1a1e01d5
2026-03-26 11:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2fe2ce8fabe54d33b023f483a1dce161.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'White',
 'currency': 'GBP',
 'description': 'EXCELLENT CONDITION VW ARTEON JUST ARRIVED WITH FULL BLACK '
                'LEATHER, HEATED FRONT SEATS, UPGRADE 20”ALLOYS, ELECTRIC '
                'SUNROOF, NAVIGATION SYSTEM, SMARTPHONE PROJECTION AND A '
                'DIGITAL DISPLAY! CALL OUR SALES TEAM NOW TO MAKE YOUR '
                'APPOINTMENT',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Petrol',
 'id': '08d5f985-9f6e-5cf7-811e-0bab1a1e01d5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040393480',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 48800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08d5f985-9f6e-5cf7-811e-0bab1a1e01d5/08d5f985-9f6e-5cf7-811e-0bab1a1e01d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270150,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2fe2ce8fabe54d33b023f483a1dce161.jpg',
             'Width': 2048}],
 'price': 17999,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI R-Line Fastback DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2019}
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393480%27 HTTP/1.1" 200 None
2026-03-26 11:10:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040393480: {'created_time': 1774523421.044585, 'last_price_update_time': 1774523421.044593}
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040393480') HTTP/1.1" 204 0
2026-03-26 11:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514d83d0>
2026-03-26 11:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7178dec3-3982-55fa-b746-356bab7cad1d/7178dec3-3982-55fa-b746-356bab7cad1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F101abe2ddcf5429da67f8459eeb996b3.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/101abe2ddcf5429da67f8459eeb996b3.jpg saved to cache
2026-03-26 11:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7178dec3-3982-55fa-b746-356bab7cad1d
2026-03-26 11:10:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7178dec3-3982-55fa-b746-356bab7cad1d sending to next pipeline
2026-03-26 11:10:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7178dec3-3982-55fa-b746-356bab7cad1d with identifier 202603030355966
2026-03-26 11:10:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7178dec3-3982-55fa-b746-356bab7cad1d
2026-03-26 11:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/101abe2ddcf5429da67f8459eeb996b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 83,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GOOD LOOKING RANGE ROVER SPORT WITH 21”ALLOY WHEELS, '
                'PANORAMIC ROOF, FULL LEATHER UPHOLSTERY, HEATED FRONT AND '
                'REAR OUTER SEATS, HEATED STEERING WHEEL, NAVIGATION SYSTEM, '
                'REAR CAMERA, KEYLESS ENTRY, POWER TAILGATE AND MUCH MORE! '
                'THIS VEHICLE IS IN SUPER CONDITION AND IS AVAILABLE NOW TO '
                'VIEW! CALL US FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 398,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '7178dec3-3982-55fa-b746-356bab7cad1d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355966',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 29600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7178dec3-3982-55fa-b746-356bab7cad1d/7178dec3-3982-55fa-b746-356bab7cad1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261299,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/101abe2ddcf5429da67f8459eeb996b3.jpg',
             'Width': 2048}],
 'price': 38999,
 'price_includes_vat': True,
 'registration_date': '2021-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 2.0 P400e 13.1kWh HSE Dynamic Black '
          'Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic Black',
 'year': 2021}
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355966%27 HTTP/1.1" 200 None
2026-03-26 11:10:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355966: {'created_time': 1774523421.211824, 'last_price_update_time': 1774523421.211832}
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355966') HTTP/1.1" 204 0
2026-03-26 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] INFO: Page: 5/16, total results: 304
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355603%27 HTTP/1.1" 200 None
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355603: 1
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355545%27 HTTP/1.1" 200 None
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355545: 1
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355460%27 HTTP/1.1" 200 None
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355460: 1
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355408%27 HTTP/1.1" 200 None
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355408: 1
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355313%27 HTTP/1.1" 200 None
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030355313: 1
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020326166%27 HTTP/1.1" 200 None
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020326166: 1
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321469%27 HTTP/1.1" 200 None
2026-03-26 11:10:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020321469: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321339%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020321339: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321218%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020321218: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321160%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020321160: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321115%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020321115: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232952%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232952: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232874%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232874: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232841%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232841: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232779%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232779: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232712%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232712: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232468%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232468: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232228%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232228: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232105%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232105: 1
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232012%27 HTTP/1.1" 200 None
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260232012: 1
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Getting next page: 6
2026-03-26 11:10:30 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 6
2026-03-26 11:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 75859075-70cb-51df-b65f-b7fbadafa744 with identifier: 202603020321115
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 75859075-70cb-51df-b65f-b7fbadafa744
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe66a5d88789445a8ab72de4ac9e5acff.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e66a5d88789445a8ab72de4ac9e5acff.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f078114-b840-5303-945a-51ba963e49fc with identifier: 202602260232952
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2f078114-b840-5303-945a-51ba963e49fc
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3705b64a552496ca1ff8adb2747d7bb.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3705b64a552496ca1ff8adb2747d7bb.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f8dba1e5-167a-583f-aa9a-3cb866ce42e1 with identifier: 202602260232874
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f8dba1e5-167a-583f-aa9a-3cb866ce42e1
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2700f2bdaebc40b496f4b41aacb7cede.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2700f2bdaebc40b496f4b41aacb7cede.jpg not downloaded yet
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8 with identifier: 202602260232841
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e23348e146c4b0e9616c3b374e8b2df.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e23348e146c4b0e9616c3b374e8b2df.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 13b0a005-ee68-5354-a5c7-de4a46b61c29 with identifier: 202602260232779
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 13b0a005-ee68-5354-a5c7-de4a46b61c29
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa43c97c060ac41308325281bec04c21b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a43c97c060ac41308325281bec04c21b.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ea2cd4ca-53ef-5f96-b156-50bed375c923 with identifier: 202602260232712
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ea2cd4ca-53ef-5f96-b156-50bed375c923
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e7d5f3412ad4b09bea2122983ad5834.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e7d5f3412ad4b09bea2122983ad5834.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486 with identifier: 202602260232468
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe96163ce38ec44e2953ea02cb8373666.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e96163ce38ec44e2953ea02cb8373666.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0205c877-3f97-55a4-aff6-114be3599e96 with identifier: 202602260232228
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0205c877-3f97-55a4-aff6-114be3599e96
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ab718c3ca7446d8b113995737fe42a3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ab718c3ca7446d8b113995737fe42a3.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f91b7cb-8b10-5bc9-802b-c46b33395514 with identifier: 202602260232105
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f91b7cb-8b10-5bc9-802b-c46b33395514
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71b49cfec2584b8caa8a3e8c6b525832.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71b49cfec2584b8caa8a3e8c6b525832.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd9e94b-391e-59ed-b946-90cca1d81d92 with identifier: 202602260232012
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5fd9e94b-391e-59ed-b946-90cca1d81d92
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24df216144d5465d9035046dacc2fed9.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24df216144d5465d9035046dacc2fed9.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 107b30da-46fa-542d-80e3-736cc6d0f101 with identifier: 202603030355603
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 107b30da-46fa-542d-80e3-736cc6d0f101
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F121a8a170bd54aafbe888a89db99e16e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/121a8a170bd54aafbe888a89db99e16e.jpg not downloaded yet
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c3705b64a552496ca1ff8adb2747d7bb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce with identifier: 202603030355545
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44a5ce315f8d4b7e8bd756c1ef3f95a9.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44a5ce315f8d4b7e8bd756c1ef3f95a9.jpg not downloaded yet
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2700f2bdaebc40b496f4b41aacb7cede.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 840e3510-0ec8-5e9d-b1a1-f099a89abd91 with identifier: 202603030355460
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 840e3510-0ec8-5e9d-b1a1-f099a89abd91
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdea0744da8334a3188f14a057c657a99.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dea0744da8334a3188f14a057c657a99.jpg not downloaded yet
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f448661a-cca1-54d0-8f61-c6f168644fc8 with identifier: 202603030355408
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f448661a-cca1-54d0-8f61-c6f168644fc8
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9cc5e2c868142eb817afb41238bc614.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9cc5e2c868142eb817afb41238bc614.jpg not downloaded yet
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9e7d5f3412ad4b09bea2122983ad5834.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8e23348e146c4b0e9616c3b374e8b2df.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 81223b49-c6ff-5f84-abf1-6a554d11c7f9 with identifier: 202603030355313
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 81223b49-c6ff-5f84-abf1-6a554d11c7f9
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b3577cd4e1c4e4a9fce986082bb3cf0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b3577cd4e1c4e4a9fce986082bb3cf0.jpg not downloaded yet
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e96163ce38ec44e2953ea02cb8373666.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ed9046-267a-5108-977d-e9546aa43095 with identifier: 202603020326166
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d7ed9046-267a-5108-977d-e9546aa43095
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc79cc834bcc349359e5378432c6e94dc.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c79cc834bcc349359e5378432c6e94dc.jpg not downloaded yet
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0ab718c3ca7446d8b113995737fe42a3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fc0ca20f-8310-5371-bc5d-e467c0eaa6b9 with identifier: 202603020321469
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc0ca20f-8310-5371-bc5d-e467c0eaa6b9
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4cd32c1917a24778ade8f993b64b9133.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4cd32c1917a24778ade8f993b64b9133.jpg not downloaded yet
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e66a5d88789445a8ab72de4ac9e5acff.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c581c0950>
2026-03-26 11:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f078114-b840-5303-945a-51ba963e49fc/2f078114-b840-5303-945a-51ba963e49fc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3705b64a552496ca1ff8adb2747d7bb.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3705b64a552496ca1ff8adb2747d7bb.jpg saved to cache
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f078114-b840-5303-945a-51ba963e49fc
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f078114-b840-5303-945a-51ba963e49fc sending to next pipeline
2026-03-26 11:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/121a8a170bd54aafbe888a89db99e16e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b8b26dcd-4a11-512c-a3dc-a5d4ad0f12a2 with identifier: 202603020321339
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b8b26dcd-4a11-512c-a3dc-a5d4ad0f12a2
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2f078114-b840-5303-945a-51ba963e49fc with identifier 202602260232952
2026-03-26 11:10:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2f078114-b840-5303-945a-51ba963e49fc
2026-03-26 11:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c3705b64a552496ca1ff8adb2747d7bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2023 Skoda Karoq TSI SportLine offers a blend of style '
                'and practicality, making it an excellent choice for those '
                'seeking a capable and well equipped compact SUV. Powered by a '
                '1.5 litre petrol engine and meeting Euro 6 emissions '
                'standards, this SportLine trim model comes with the desirable '
                'Amundsen Package Plus, which includes convenient wireless '
                'phone charging, and the Winter Pack, featuring heated seats '
                "for added comfort. You'll also find DAB digital radio and "
                'Bluetooth connectivity, dual zone climate control for '
                'personalised comfort, and a comprehensive Parking Package. '
                'This package includes front and rear parking sensors along '
                'with a rear camera, simplifying manoeuvring in tight spaces.\n'
                '\n'
                'Available now for viewing, any questions please give us a '
                'call!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '2f078114-b840-5303-945a-51ba963e49fc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232952',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 20000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f078114-b840-5303-945a-51ba963e49fc/2f078114-b840-5303-945a-51ba963e49fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270857,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c3705b64a552496ca1ff8adb2747d7bb.jpg',
             'Width': 2048}],
 'price': 23999,
 'price_includes_vat': True,
 'registration_date': '2023-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Karoq 1.5 TSI ACT SportLine DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2023}
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232952%27 HTTP/1.1" 200 None
2026-03-26 11:10:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232952: {'created_time': 1774523432.504632, 'last_price_update_time': 1774523432.50464}
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232952') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b8b26dcd-4a11-512c-a3dc-a5d4ad0f12a2 with identifier 202603020321339
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b8b26dcd-4a11-512c-a3dc-a5d4ad0f12a2
2026-03-26 11:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'GREAT CONDITION PEUGEOT 2008 WITH CLIMATE CONTROL, CRUISE '
                'CONTROL, DAB RADIO, SMARTPHONE PROJECTION, PARKING SENSORS '
                'AND COMFORTABLE SEATS! CALL OUR SALES TEAM NOW TI LEARN MORE '
                'OR POP IN TO VIEW',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 100,
 'fuel_type': 'Petrol',
 'id': 'b8b26dcd-4a11-512c-a3dc-a5d4ad0f12a2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020321339',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 10999,
 'price_includes_vat': True,
 'registration_date': '2020-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Premium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Allure Premium',
 'year': 2020}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321339%27 HTTP/1.1" 200 None
2026-03-26 11:10:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020321339: {'created_time': 1774523433.126276, 'last_price_update_time': 1774523433.126285}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020321339') HTTP/1.1" 204 0
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5a57d4d0>
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8dba1e5-167a-583f-aa9a-3cb866ce42e1/f8dba1e5-167a-583f-aa9a-3cb866ce42e1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2700f2bdaebc40b496f4b41aacb7cede.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2700f2bdaebc40b496f4b41aacb7cede.jpg saved to cache
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8dba1e5-167a-583f-aa9a-3cb866ce42e1
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8dba1e5-167a-583f-aa9a-3cb866ce42e1 sending to next pipeline
2026-03-26 11:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/71b49cfec2584b8caa8a3e8c6b525832.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 24d55009-f0c2-5d35-b87e-6483d4ed591c with identifier: 202603020321218
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 24d55009-f0c2-5d35-b87e-6483d4ed591c
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52e7dcafcc324c1d85c8349e8d38f1db.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52e7dcafcc324c1d85c8349e8d38f1db.jpg not downloaded yet
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f8dba1e5-167a-583f-aa9a-3cb866ce42e1 with identifier 202602260232874
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f8dba1e5-167a-583f-aa9a-3cb866ce42e1
2026-03-26 11:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2700f2bdaebc40b496f4b41aacb7cede.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GREAT CONDITION VOLVO XC40 WITH FULL LEATHER SEATS, KEYLESS '
                'ENTRY, HEATED FRONT AND REAR SEATS, NAVIGATION SYSTEM, REAR '
                'CAMERA, HEATED STEERING WHEEL AND PLENTY MORE! CALL OUR SALES '
                'TEAM NOW TO LEARN MORE',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 208,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'f8dba1e5-167a-583f-aa9a-3cb866ce42e1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232874',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 26900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8dba1e5-167a-583f-aa9a-3cb866ce42e1/f8dba1e5-167a-583f-aa9a-3cb866ce42e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274522,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2700f2bdaebc40b496f4b41aacb7cede.jpg',
             'Width': 2048}],
 'price': 22799,
 'price_includes_vat': True,
 'registration_date': '2022-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5h T4 Recharge 10.7kWh Inscription Auto Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'Inscription',
 'year': 2022}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232874%27 HTTP/1.1" 200 None
2026-03-26 11:10:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232874: {'created_time': 1774523433.300315, 'last_price_update_time': 1774523433.300322}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232874') HTTP/1.1" 204 0
2026-03-26 11:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58daac90>
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea2cd4ca-53ef-5f96-b156-50bed375c923/ea2cd4ca-53ef-5f96-b156-50bed375c923_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e7d5f3412ad4b09bea2122983ad5834.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e7d5f3412ad4b09bea2122983ad5834.jpg saved to cache
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea2cd4ca-53ef-5f96-b156-50bed375c923
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea2cd4ca-53ef-5f96-b156-50bed375c923 sending to next pipeline
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c581c97d0>
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8/15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8e23348e146c4b0e9616c3b374e8b2df.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8e23348e146c4b0e9616c3b374e8b2df.jpg saved to cache
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8 sending to next pipeline
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c581ca850>
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486/d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe96163ce38ec44e2953ea02cb8373666.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e96163ce38ec44e2953ea02cb8373666.jpg saved to cache
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486 sending to next pipeline
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51299950>
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0205c877-3f97-55a4-aff6-114be3599e96/0205c877-3f97-55a4-aff6-114be3599e96_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ab718c3ca7446d8b113995737fe42a3.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ab718c3ca7446d8b113995737fe42a3.jpg saved to cache
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0205c877-3f97-55a4-aff6-114be3599e96
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0205c877-3f97-55a4-aff6-114be3599e96 sending to next pipeline
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5129a890>
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75859075-70cb-51df-b65f-b7fbadafa744/75859075-70cb-51df-b65f-b7fbadafa744_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe66a5d88789445a8ab72de4ac9e5acff.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e66a5d88789445a8ab72de4ac9e5acff.jpg saved to cache
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75859075-70cb-51df-b65f-b7fbadafa744
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75859075-70cb-51df-b65f-b7fbadafa744 sending to next pipeline
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51422550>
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_107b30da-46fa-542d-80e3-736cc6d0f101/107b30da-46fa-542d-80e3-736cc6d0f101_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F121a8a170bd54aafbe888a89db99e16e.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/121a8a170bd54aafbe888a89db99e16e.jpg saved to cache
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 107b30da-46fa-542d-80e3-736cc6d0f101
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 107b30da-46fa-542d-80e3-736cc6d0f101 sending to next pipeline
2026-03-26 11:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a43c97c060ac41308325281bec04c21b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bb471b8e-3f41-5037-b22c-326fce319eba with identifier: 202603020321160
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb471b8e-3f41-5037-b22c-326fce319eba
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e4f0c113cb944558acc7b4dbdce2a9d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e4f0c113cb944558acc7b4dbdce2a9d.jpg not downloaded yet
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ea2cd4ca-53ef-5f96-b156-50bed375c923 with identifier 202602260232712
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ea2cd4ca-53ef-5f96-b156-50bed375c923
2026-03-26 11:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9e7d5f3412ad4b09bea2122983ad5834.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'Discover this 2021 Vauxhall Corsa Electric SRi Premium, a '
                'smart choice for modern driving. This electric model boasts a '
                '50 kWh battery, offering a maximum range of 222 miles when '
                'new, perfect for both daily commutes and longer journeys. '
                'Charging is convenient, with a full charge achievable at home '
                'in approximately 7 hours and 30 minutes using a 7kW charger. '
                'For quicker top ups, the fastest public charging time from '
                'empty to 80% is just 55 minutes.\n'
                '\n'
                'The SRi Premium trim level comes equipped with a host of '
                'desirable features designed to enhance your driving '
                'experience. Enjoy the comfort of Electronic Climate Control '
                'and the convenience of Automatic Lighting Control, ensuring '
                'your headlights are always on when needed. Parking is made '
                'easier with Rear Parking Distance Sensors, and the Multimedia '
                'Navi System keeps you connected and entertained with Android '
                'Auto, Apple CarPlay, and Bluetooth functionality. '
                'Furthermore, the LED Headlights with High Beam Assist provide '
                'excellent visibility, making this Corsa Electric a well '
                'appointed and capable vehicle.\n'
                '\n'
                'Call us now to arrange your viewing!',
 'doors_number': 5,
 'engine_horse_power': 134,
 'fuel_type': 'Electric',
 'id': 'ea2cd4ca-53ef-5f96-b156-50bed375c923',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232712',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Corsa Electric',
 'odometer': 29900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea2cd4ca-53ef-5f96-b156-50bed375c923/ea2cd4ca-53ef-5f96-b156-50bed375c923_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289704,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e7d5f3412ad4b09bea2122983ad5834.jpg',
             'Width': 2048}],
 'price': 10299,
 'price_includes_vat': True,
 'registration_date': '2021-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa Electric 50kWh SRi Premium Auto 5dr',
 'transmission': 'automatic',
 'trim': 'SRi Premium',
 'year': 2021}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232712%27 HTTP/1.1" 200 None
2026-03-26 11:10:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232712: {'created_time': 1774523433.894732, 'last_price_update_time': 1774523433.894742}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232712') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8 with identifier 202602260232841
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8
2026-03-26 11:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8e23348e146c4b0e9616c3b374e8b2df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Vauxhall Corsa Turbo Design is a fantastic example '
                'of a modern, efficient hatchback. Featuring a 1.2 litre '
                'petrol engine and meeting Euro 6 emission standards, this '
                'Design trim model offers a blend of performance and economy. '
                "Inside, you'll find a comprehensive Multimedia Infotainment "
                'System, complete with Android Auto and Apple CarPlay '
                'integration, plus Bluetooth connectivity, ensuring you stay '
                'connected and entertained on every journey.\n'
                'Call our sales team now with any questions or feel free to '
                'pop in and see us!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232841',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 23700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8/15a940cb-d9a6-5dd5-b37a-0af4cc04e8c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266219,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8e23348e146c4b0e9616c3b374e8b2df.jpg',
             'Width': 2048}],
 'price': 10799,
 'price_includes_vat': True,
 'registration_date': '2023-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 Turbo Design Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2023}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232841%27 HTTP/1.1" 200 None
2026-03-26 11:10:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232841: {'created_time': 1774523433.935472, 'last_price_update_time': 1774523433.93548}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232841') HTTP/1.1" 204 0
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486 with identifier 202602260232468
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486
2026-03-26 11:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e96163ce38ec44e2953ea02cb8373666.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2020 Nissan Qashqai DIG-T Acenta Premium is a well '
                'maintained example, offering a blend of practicality and '
                'modern technology. Powered by an efficient 1.3 litre petrol '
                'engine, this Euro 6 compliant vehicle is designed for '
                "everyday use. Inside, you'll find the Nissan Connect 7in "
                'touchscreen system, complete with Android Auto and Apple '
                'CarPlay for seamless smartphone integration. For added '
                'convenience, it features Bluetooth with audio streaming, '
                'intelligent auto headlights that switch on automatically, and '
                'both front and rear parking sensors to assist with '
                'manoeuvring.\n'
                'Call us now to learn more or pop in to view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': 'd8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232468',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 51600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486/d8b7c4be-f0cf-59b8-bbdd-f1f87ee7f486_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267937,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e96163ce38ec44e2953ea02cb8373666.jpg',
             'Width': 2048}],
 'price': 10999,
 'price_includes_vat': True,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Acenta Premium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Acenta Premium',
 'year': 2020}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232468%27 HTTP/1.1" 200 None
2026-03-26 11:10:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232468: {'created_time': 1774523433.985376, 'last_price_update_time': 1774523433.985385}
2026-03-26 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232468') HTTP/1.1" 204 0
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0205c877-3f97-55a4-aff6-114be3599e96 with identifier 202602260232228
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0205c877-3f97-55a4-aff6-114be3599e96
2026-03-26 11:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0ab718c3ca7446d8b113995737fe42a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2022 Nissan Qashqai DIG-T N-Connecta presents an '
                'exceptional opportunity with its remarkably low mileage of '
                'just 18,800 miles for its age. This Euro 6 compliant, 1.3L '
                'Petrol Hybrid model combines efficiency with modern '
                'technology, featuring automatic dual zone climate control '
                'with a pollen filter, LED headlights, and a dusk sensor for '
                'automatic headlight activation. Enjoy seamless connectivity '
                'with wireless Apple CarPlay, and experience enhanced driving '
                'comfort and safety with intelligent cruise control.\n'
                '\n'
                'Available now to view, call us with any questions or pop in '
                'and see us!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol Hybrid',
 'id': '0205c877-3f97-55a4-aff6-114be3599e96',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232228',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 18800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0205c877-3f97-55a4-aff6-114be3599e96/0205c877-3f97-55a4-aff6-114be3599e96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271878,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0ab718c3ca7446d8b113995737fe42a3.jpg',
             'Width': 2048}],
 'price': 15499,
 'price_includes_vat': True,
 'registration_date': '2022-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T MHEV N-Connecta Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2022}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232228%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232228: {'created_time': 1774523434.028794, 'last_price_update_time': 1774523434.028805}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232228') HTTP/1.1" 204 0
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 75859075-70cb-51df-b65f-b7fbadafa744 with identifier 202603020321115
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 75859075-70cb-51df-b65f-b7fbadafa744
2026-03-26 11:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e66a5d88789445a8ab72de4ac9e5acff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'EXCELLENT CONDITION AUDI TT WITH HEATED FRONT SEATS, BANG & '
                'OLUFSEN SPEAKERS, PARKING CAMERA, AIR CONDITIONING, CRUISE '
                'CONTROL, 20”BLACK Y SPOKE ALLOYS AND A BLACK STYLING PACK! '
                'THIS VEHICLE LOOKS GREAT AND DRIVES EXCELLENT! CALL OUR SALES '
                'TEAM NOW FOR MORE INFORMATION!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 242,
 'fuel_type': 'Petrol',
 'id': '75859075-70cb-51df-b65f-b7fbadafa744',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020321115',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 63700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75859075-70cb-51df-b65f-b7fbadafa744/75859075-70cb-51df-b65f-b7fbadafa744_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274777,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e66a5d88789445a8ab72de4ac9e5acff.jpg',
             'Width': 2048}],
 'price': 22499,
 'price_includes_vat': True,
 'registration_date': '2020-09-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI 45 Black Edition S Tronic quattro Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2020}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321115%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020321115: {'created_time': 1774523434.07515, 'last_price_update_time': 1774523434.075161}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020321115') HTTP/1.1" 204 0
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 107b30da-46fa-542d-80e3-736cc6d0f101 with identifier 202603030355603
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 107b30da-46fa-542d-80e3-736cc6d0f101
2026-03-26 11:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/121a8a170bd54aafbe888a89db99e16e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2022 Tesla Model 3 Standard Range Plus presents an '
                'exceptional opportunity with its remarkably low mileage of '
                'just 14,200 miles for its age. As an electric vehicle, it '
                'offers a substantial new battery range of up to 278 miles '
                'from its 53 kWh capacity. Charging is convenient, taking '
                'approximately 7 hours and 10 minutes at home using a 7kW '
                'charger, while rapid public charging can replenish the '
                'battery from empty to 80% in as little as 29 minutes. This '
                'Model 3 also boasts a fixed panoramic glass roof, a generous '
                'boot space, and a 2 zone climate control system for enhanced '
                'comfort.\n'
                'Call us now for further information or please come in to '
                'view!',
 'doors_number': 4,
 'engine_horse_power': 241,
 'fuel_type': 'Electric',
 'id': '107b30da-46fa-542d-80e3-736cc6d0f101',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355603',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 14200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_107b30da-46fa-542d-80e3-736cc6d0f101/107b30da-46fa-542d-80e3-736cc6d0f101_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265884,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/121a8a170bd54aafbe888a89db99e16e.jpg',
             'Width': 2048}],
 'price': 19299,
 'price_includes_vat': True,
 'registration_date': '2022-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus Auto RWD 4dr',
 'transmission': 'automatic',
 'trim': 'Standard Range Plus',
 'year': 2022}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355603%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355603: {'created_time': 1774523434.121422, 'last_price_update_time': 1774523434.121429}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355603') HTTP/1.1" 204 0
2026-03-26 11:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/dea0744da8334a3188f14a057c657a99.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/24df216144d5465d9035046dacc2fed9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/44a5ce315f8d4b7e8bd756c1ef3f95a9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7b3577cd4e1c4e4a9fce986082bb3cf0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b9cc5e2c868142eb817afb41238bc614.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52fc5f90>
2026-03-26 11:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f91b7cb-8b10-5bc9-802b-c46b33395514/1f91b7cb-8b10-5bc9-802b-c46b33395514_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71b49cfec2584b8caa8a3e8c6b525832.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71b49cfec2584b8caa8a3e8c6b525832.jpg saved to cache
2026-03-26 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f91b7cb-8b10-5bc9-802b-c46b33395514
2026-03-26 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f91b7cb-8b10-5bc9-802b-c46b33395514 sending to next pipeline
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Page: 6/16, total results: 304
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231877%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260231877: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231678%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260231678: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231375%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260231375: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240181243%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240181243: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230137660%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230137660: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230137446%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230137446: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230137398%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230137398: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230135132%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230135132: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230135031%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230135031: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134971%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230134971: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134861%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230134861: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134774%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230134774: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134636%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230134636: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134579%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230134579: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230132434%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230132434: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230132381%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230132381: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200085212%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200085212: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200085083%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200085083: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190049548%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190049548: 1
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190049128%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190049128: 1
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514ea650>
2026-03-26 11:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13b0a005-ee68-5354-a5c7-de4a46b61c29/13b0a005-ee68-5354-a5c7-de4a46b61c29_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa43c97c060ac41308325281bec04c21b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a43c97c060ac41308325281bec04c21b.jpg saved to cache
2026-03-26 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13b0a005-ee68-5354-a5c7-de4a46b61c29
2026-03-26 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13b0a005-ee68-5354-a5c7-de4a46b61c29 sending to next pipeline
2026-03-26 11:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c79cc834bcc349359e5378432c6e94dc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1f91b7cb-8b10-5bc9-802b-c46b33395514 with identifier 202602260232105
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1f91b7cb-8b10-5bc9-802b-c46b33395514
2026-03-26 11:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/71b49cfec2584b8caa8a3e8c6b525832.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'VW TIGUAN WITH HEATED FRONT SEATS, CLIMATE CONTROL, CRUISE '
                'CONTROL, PARK ASSIST, NAVIGATION SYSTEM, APP-CONNECT, KEYLESS '
                'ENTRY, DAB RADIO DIGITAL DASH AND MUCH MORE! THIS VEHICLE IS '
                'IN EXCELLENT CONDITION AND IS AVAILABLE TO VIEW NOW! CALL FOR '
                'MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '1f91b7cb-8b10-5bc9-802b-c46b33395514',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232105',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 31200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f91b7cb-8b10-5bc9-802b-c46b33395514/1f91b7cb-8b10-5bc9-802b-c46b33395514_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289138,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/71b49cfec2584b8caa8a3e8c6b525832.jpg',
             'Width': 2048}],
 'price': 24999,
 'price_includes_vat': True,
 'registration_date': '2023-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI R-Line DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232105%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232105: {'created_time': 1774523434.710875, 'last_price_update_time': 1774523434.710884}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232105') HTTP/1.1" 204 0
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 13b0a005-ee68-5354-a5c7-de4a46b61c29 with identifier 202602260232779
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 13b0a005-ee68-5354-a5c7-de4a46b61c29
2026-03-26 11:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a43c97c060ac41308325281bec04c21b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GREAT CONDITION VAUXHALL MOKKA WITH HEATED MASSAGE DRIVERS '
                'SEAT, NAVIGATION SYSTEM, SMARTPHONE PROJECTION, REAR CAMERA '
                'AND ITS AVAILABLE TO VIEW NOW! GIVE OUR SALES TEAM A CALL '
                'WITH ANY QUESTIONS OR COME IN TO VIEW!',
 'doors_number': 5,
 'engine_horse_power': 134,
 'fuel_type': 'Electric',
 'id': '13b0a005-ee68-5354-a5c7-de4a46b61c29',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232779',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Mokka Electric',
 'odometer': 63400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13b0a005-ee68-5354-a5c7-de4a46b61c29/13b0a005-ee68-5354-a5c7-de4a46b61c29_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275328,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a43c97c060ac41308325281bec04c21b.jpg',
             'Width': 2048}],
 'price': 10999,
 'price_includes_vat': True,
 'registration_date': '2022-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka Electric 50kWh Ultimate Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2022}
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232779%27 HTTP/1.1" 200 None
2026-03-26 11:10:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232779: {'created_time': 1774523434.997478, 'last_price_update_time': 1774523434.997486}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232779') HTTP/1.1" 204 0
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4cd32c1917a24778ade8f993b64b9133.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f42250>
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_840e3510-0ec8-5e9d-b1a1-f099a89abd91/840e3510-0ec8-5e9d-b1a1-f099a89abd91_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdea0744da8334a3188f14a057c657a99.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dea0744da8334a3188f14a057c657a99.jpg saved to cache
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 840e3510-0ec8-5e9d-b1a1-f099a89abd91
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 840e3510-0ec8-5e9d-b1a1-f099a89abd91 sending to next pipeline
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e4b610>
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fd9e94b-391e-59ed-b946-90cca1d81d92/5fd9e94b-391e-59ed-b946-90cca1d81d92_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24df216144d5465d9035046dacc2fed9.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24df216144d5465d9035046dacc2fed9.jpg saved to cache
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fd9e94b-391e-59ed-b946-90cca1d81d92
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fd9e94b-391e-59ed-b946-90cca1d81d92 sending to next pipeline
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d14890>
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce/d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44a5ce315f8d4b7e8bd756c1ef3f95a9.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44a5ce315f8d4b7e8bd756c1ef3f95a9.jpg saved to cache
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce sending to next pipeline
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514949d0>
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81223b49-c6ff-5f84-abf1-6a554d11c7f9/81223b49-c6ff-5f84-abf1-6a554d11c7f9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7b3577cd4e1c4e4a9fce986082bb3cf0.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7b3577cd4e1c4e4a9fce986082bb3cf0.jpg saved to cache
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81223b49-c6ff-5f84-abf1-6a554d11c7f9
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81223b49-c6ff-5f84-abf1-6a554d11c7f9 sending to next pipeline
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51496010>
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f448661a-cca1-54d0-8f61-c6f168644fc8/f448661a-cca1-54d0-8f61-c6f168644fc8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9cc5e2c868142eb817afb41238bc614.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9cc5e2c868142eb817afb41238bc614.jpg saved to cache
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f448661a-cca1-54d0-8f61-c6f168644fc8
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f448661a-cca1-54d0-8f61-c6f168644fc8 sending to next pipeline
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Getting next page: 7
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 7
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 840e3510-0ec8-5e9d-b1a1-f099a89abd91 with identifier 202603030355460
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 840e3510-0ec8-5e9d-b1a1-f099a89abd91
2026-03-26 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/dea0744da8334a3188f14a057c657a99.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'FORD KUGA WITH BANG & OLUFSEN CENTRE SPEAKER, CLIMATE '
                'CONTROL, CRUISE CONTROL, PARKING CAMERA AND THE SYNC3 '
                'NAVIGATION SYSTEM WITH DAB RADIO AND SMARTPHONE PROJECTION '
                'NOW AVAILABLE!\n'
                'THIS VEHICLE IS AVAILABLE TO VIEW, CALL US NOW WITH ANY '
                'QUESTIONS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 118,
 'fuel_type': 'Diesel',
 'id': '840e3510-0ec8-5e9d-b1a1-f099a89abd91',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355460',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 40000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_840e3510-0ec8-5e9d-b1a1-f099a89abd91/840e3510-0ec8-5e9d-b1a1-f099a89abd91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268720,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dea0744da8334a3188f14a057c657a99.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2021-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBlue ST-Line Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line Edition',
 'year': 2021}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355460%27 HTTP/1.1" 200 None
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355460: {'created_time': 1774523435.455285, 'last_price_update_time': 1774523435.455293}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355460') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5fd9e94b-391e-59ed-b946-90cca1d81d92 with identifier 202602260232012
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5fd9e94b-391e-59ed-b946-90cca1d81d92
2026-03-26 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/24df216144d5465d9035046dacc2fed9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2020 Nissan X-Trail dCi N-Connecta stands out with its '
                'remarkably low mileage of just 39,500 miles for its age, '
                'indicating careful ownership. This Euro 6 compliant model '
                'features a robust 1.7 litre diesel engine and comes in the '
                "well appointed N-Connecta trim. You'll appreciate the "
                'convenience of front and rear parking sensors, complete with '
                'parking assistance, making manoeuvring a breeze. Enjoy the '
                'open air with the panoramic sunroof, which includes a fixed '
                'panel and a one touch shade. The X-Trail also benefits from '
                'automatic headlights that activate with a dusk sensor, and an '
                'intelligent key system for keyless entry. Inside, dual zone '
                'automatic air conditioning with a pollen filter ensures a '
                'comfortable cabin environment for all occupants.\n'
                'Call our sales team now to learn more.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.7L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': '5fd9e94b-391e-59ed-b946-90cca1d81d92',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260232012',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 39500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fd9e94b-391e-59ed-b946-90cca1d81d92/5fd9e94b-391e-59ed-b946-90cca1d81d92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274734,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/24df216144d5465d9035046dacc2fed9.jpg',
             'Width': 2048}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2020-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.7 dCi N-Connecta CVT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2020}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260232012%27 HTTP/1.1" 200 None
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260232012: {'created_time': 1774523435.504038, 'last_price_update_time': 1774523435.504047}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260232012') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce with identifier 202603030355545
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce
2026-03-26 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/44a5ce315f8d4b7e8bd756c1ef3f95a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'SPORTY VW POLO GTI WITH PARKER ALLOY WHEELS, PARKING SENSORS, '
                'AIR CONDITIONING AND A MEDIA SYSTEM WITH DAB RADIO AND '
                'APP-CONNECT FOR YOUR MEDIA NEEDS! CALL US NOW FOR MORE '
                'DETAILS OR POP IN TO VIEW',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': 'd9a9a4ef-8b43-55d4-b58b-19dbb428b0ce',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355545',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce/d9a9a4ef-8b43-55d4-b58b-19dbb428b0ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299768,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/44a5ce315f8d4b7e8bd756c1ef3f95a9.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2019-12-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355545%27 HTTP/1.1" 200 None
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355545: {'created_time': 1774523435.548778, 'last_price_update_time': 1774523435.548788}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355545') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 81223b49-c6ff-5f84-abf1-6a554d11c7f9 with identifier 202603030355313
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 81223b49-c6ff-5f84-abf1-6a554d11c7f9
2026-03-26 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7b3577cd4e1c4e4a9fce986082bb3cf0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GREAT CONDITION MERCEDES EQB WITH HEATED FRONT SEATS, '
                'NAVIGATION SYSTEM, SMARTPHONE PROJECTION, CLIMATE CONTROL, '
                'CRUISE CONTROL AND A REAR PARKING CAMERA! THIS VEHICLE IS '
                'COMFORTABLE TO DROVE AND HAS PLENTY OF SPACE! CALL US NOW FOR '
                'MORE DETAILS.',
 'doors_number': 5,
 'engine_horse_power': 288,
 'fuel_type': 'Electric',
 'id': '81223b49-c6ff-5f84-abf1-6a554d11c7f9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355313',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'EQB',
 'odometer': 48500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81223b49-c6ff-5f84-abf1-6a554d11c7f9/81223b49-c6ff-5f84-abf1-6a554d11c7f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275217,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7b3577cd4e1c4e4a9fce986082bb3cf0.jpg',
             'Width': 2048}],
 'price': 21999,
 'price_includes_vat': True,
 'registration_date': '2022-05-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz EQB 350 66.5kWh AMG Line Auto 4MATIC 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355313%27 HTTP/1.1" 200 None
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355313: {'created_time': 1774523435.591804, 'last_price_update_time': 1774523435.591813}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355313') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f448661a-cca1-54d0-8f61-c6f168644fc8 with identifier 202603030355408
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f448661a-cca1-54d0-8f61-c6f168644fc8
2026-03-26 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b9cc5e2c868142eb817afb41238bc614.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'KIA SPORTAGE IN SUPERB CONDITION AND FINISHED IN A NICE GREEN '
                'METALLIC NOW AVAILABLE! THIS VEHICLE COMES WITH HEATED FRONT '
                'AND REAR SEATS, HEATED STEERING WHEEL, NAVIGATION SYSTEM, '
                'REAR CAMERA, SMARTPHONE PROJECTION AND MUCH MORE! CALL OUR '
                'SALES TEAM NOW TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 226,
 'fuel_type': 'Petrol Hybrid',
 'id': 'f448661a-cca1-54d0-8f61-c6f168644fc8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030355408',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f448661a-cca1-54d0-8f61-c6f168644fc8/f448661a-cca1-54d0-8f61-c6f168644fc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279886,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9cc5e2c868142eb817afb41238bc614.jpg',
             'Width': 2048}],
 'price': 23999,
 'price_includes_vat': True,
 'registration_date': '2023-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage 1.6 h T-GDi 3 Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': '3',
 'year': 2023}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030355408%27 HTTP/1.1" 200 None
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030355408: {'created_time': 1774523435.633723, 'last_price_update_time': 1774523435.633733}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030355408') HTTP/1.1" 204 0
2026-03-26 11:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514b5390>
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ed9046-267a-5108-977d-e9546aa43095/d7ed9046-267a-5108-977d-e9546aa43095_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc79cc834bcc349359e5378432c6e94dc.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c79cc834bcc349359e5378432c6e94dc.jpg saved to cache
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7ed9046-267a-5108-977d-e9546aa43095
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7ed9046-267a-5108-977d-e9546aa43095 sending to next pipeline
2026-03-26 11:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/52e7dcafcc324c1d85c8349e8d38f1db.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d7ed9046-267a-5108-977d-e9546aa43095 with identifier 202603020326166
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d7ed9046-267a-5108-977d-e9546aa43095
2026-03-26 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c79cc834bcc349359e5378432c6e94dc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GREAT CONDITION BMW 1 SERIES WITH HEATED FRONT SEATS, 1/2 '
                'LEATHER UPHOLSTERY, NAVIGATION SYSTEM, SMARTPHONE PROJECTION, '
                'PARKING SENSORS AND ITS REALLY NICE TO DRIVE! ANY QUESTIONS '
                'PLEASE GIVE US A CALL OR POP IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 261,
 'fuel_type': 'Petrol',
 'id': 'd7ed9046-267a-5108-977d-e9546aa43095',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020326166',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 21000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7ed9046-267a-5108-977d-e9546aa43095/d7ed9046-267a-5108-977d-e9546aa43095_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277379,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c79cc834bcc349359e5378432c6e94dc.jpg',
             'Width': 2048}],
 'price': 23799,
 'price_includes_vat': True,
 'registration_date': '2023-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 Series 2.0 128ti (LCP) Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'year': 2023}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020326166%27 HTTP/1.1" 200 None
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020326166: {'created_time': 1774523435.747421, 'last_price_update_time': 1774523435.747431}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020326166') HTTP/1.1" 204 0
2026-03-26 11:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5816e750>
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc0ca20f-8310-5371-bc5d-e467c0eaa6b9/fc0ca20f-8310-5371-bc5d-e467c0eaa6b9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4cd32c1917a24778ade8f993b64b9133.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4cd32c1917a24778ade8f993b64b9133.jpg saved to cache
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc0ca20f-8310-5371-bc5d-e467c0eaa6b9
2026-03-26 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc0ca20f-8310-5371-bc5d-e467c0eaa6b9 sending to next pipeline
2026-03-26 11:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0e4f0c113cb944558acc7b4dbdce2a9d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fc0ca20f-8310-5371-bc5d-e467c0eaa6b9 with identifier 202603020321469
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fc0ca20f-8310-5371-bc5d-e467c0eaa6b9
2026-03-26 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4cd32c1917a24778ade8f993b64b9133.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GREAT SPEC MG ZS WITH HEATED LEATHER FRONT SEATS, ELECTRIC '
                'DRIVERS SEAT AND A MEDIA SYSTEM WITH NAVIGATION, SMARTPHONE '
                'PROJECTION, DAB RADIO AND A 360 CAMERA! CALL US NOW TO '
                'ARRANGE YOUR VIEWING!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 109,
 'fuel_type': 'Petrol',
 'id': 'fc0ca20f-8310-5371-bc5d-e467c0eaa6b9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020321469',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MG',
 'model': 'MG ZS',
 'odometer': 22100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc0ca20f-8310-5371-bc5d-e467c0eaa6b9/fc0ca20f-8310-5371-bc5d-e467c0eaa6b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286935,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4cd32c1917a24778ade8f993b64b9133.jpg',
             'Width': 2048}],
 'price': 12999,
 'price_includes_vat': True,
 'registration_date': '2022-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG Zs 1.0 T-GDI Exclusive Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2022}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321469%27 HTTP/1.1" 200 None
2026-03-26 11:10:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020321469: {'created_time': 1774523435.904092, 'last_price_update_time': 1774523435.904103}
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020321469') HTTP/1.1" 204 0
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5816d290>
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24d55009-f0c2-5d35-b87e-6483d4ed591c/24d55009-f0c2-5d35-b87e-6483d4ed591c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52e7dcafcc324c1d85c8349e8d38f1db.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52e7dcafcc324c1d85c8349e8d38f1db.jpg saved to cache
2026-03-26 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24d55009-f0c2-5d35-b87e-6483d4ed591c
2026-03-26 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24d55009-f0c2-5d35-b87e-6483d4ed591c sending to next pipeline
2026-03-26 11:10:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 24d55009-f0c2-5d35-b87e-6483d4ed591c with identifier 202603020321218
2026-03-26 11:10:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 24d55009-f0c2-5d35-b87e-6483d4ed591c
2026-03-26 11:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/52e7dcafcc324c1d85c8349e8d38f1db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'MUSTANG MACH-E WITH GLASS ROOF, FULL LEATHER UPHOLSTERY, '
                'HEATED FRONT SEATS, NAVIGATION SYSTEM, SMARTPHONE PROJECTION, '
                'REAR CAMERA, HEATED STEERING WHEEL AN MUCH MORE! CALL US NOW '
                'FOR FURTHER DETAILS!',
 'doors_number': 5,
 'engine_horse_power': 346,
 'fuel_type': 'Electric',
 'id': '24d55009-f0c2-5d35-b87e-6483d4ed591c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020321218',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Mustang Mach-E',
 'odometer': 29000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24d55009-f0c2-5d35-b87e-6483d4ed591c/24d55009-f0c2-5d35-b87e-6483d4ed591c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271245,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/52e7dcafcc324c1d85c8349e8d38f1db.jpg',
             'Width': 2048}],
 'price': 22499,
 'price_includes_vat': True,
 'registration_date': '2021-09-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mustang Mach-E Extended Range 91kWh AWD 5dr',
 'transmission': 'automatic',
 'year': 2021}
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321218%27 HTTP/1.1" 200 None
2026-03-26 11:10:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020321218: {'created_time': 1774523436.035348, 'last_price_update_time': 1774523436.035361}
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020321218') HTTP/1.1" 204 0
2026-03-26 11:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c68789650>
2026-03-26 11:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb471b8e-3f41-5037-b22c-326fce319eba/bb471b8e-3f41-5037-b22c-326fce319eba_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e4f0c113cb944558acc7b4dbdce2a9d.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e4f0c113cb944558acc7b4dbdce2a9d.jpg saved to cache
2026-03-26 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb471b8e-3f41-5037-b22c-326fce319eba
2026-03-26 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb471b8e-3f41-5037-b22c-326fce319eba sending to next pipeline
2026-03-26 11:10:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bb471b8e-3f41-5037-b22c-326fce319eba with identifier 202603020321160
2026-03-26 11:10:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bb471b8e-3f41-5037-b22c-326fce319eba
2026-03-26 11:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0e4f0c113cb944558acc7b4dbdce2a9d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 26,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Discover this 2022 Ford Kuga ST-Line X Edition, a petrol '
                'plug-in hybrid that offers an efficient and refined driving '
                'experience. This Euro 6 compliant model boasts a 2.5 litre '
                'engine, providing a smooth yet responsive performance. '
                "Inside, you'll find a host of convenient features designed "
                'for comfort and ease, including wireless charging for your '
                'devices, the Ford Keyfree system for effortless keyless entry '
                'and starting, and heated front & rear seats for passengers. '
                'The automatic headlights with auto high-low beam adapt to '
                'changing light conditions, enhancing visibility and safety.\n'
                'Call our sales team for more information.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 222,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'bb471b8e-3f41-5037-b22c-326fce319eba',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020321160',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 40000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb471b8e-3f41-5037-b22c-326fce319eba/bb471b8e-3f41-5037-b22c-326fce319eba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270419,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0e4f0c113cb944558acc7b4dbdce2a9d.jpg',
             'Width': 2048}],
 'price': 17999,
 'price_includes_vat': True,
 'registration_date': '2022-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Duratec 14.4kWh ST-Line X Edition CVT Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'ST-Line X Edition',
 'year': 2022}
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020321160%27 HTTP/1.1" 200 None
2026-03-26 11:10:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020321160: {'created_time': 1774523436.150989, 'last_price_update_time': 1774523436.151001}
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020321160') HTTP/1.1" 204 0
2026-03-26 11:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:36 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:36 [auto_selling_autotrader.co.uk] INFO: Page: 7/16, total results: 304
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190048825%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190048825: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190048426%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190048426: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179995328%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179995328: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179995193%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179995193: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179995062%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179995062: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179994934%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179994934: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169957081%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169957081: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169956982%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169956982: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169956773%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169956773: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169954217%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169954217: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169953357%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169953357: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109807796%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109807796: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109807535%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109807535: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099782023%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602099782023: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099776077%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602099776077: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099776056%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602099776056: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099776020%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602099776020: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602069738915%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602069738915: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602069738813%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602069738813: 1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059697004%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059697004: 1
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Getting next page: 8
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 8
2026-03-26 11:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f6b6412-1c71-5113-a9d7-1caec8fb8c96 with identifier: 202602230134861
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8f6b6412-1c71-5113-a9d7-1caec8fb8c96
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F009719ce0247421087ee52afb083109a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/009719ce0247421087ee52afb083109a.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 382c6436-d94c-523a-a9de-736cf8971cd0 with identifier: 202602230134774
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 382c6436-d94c-523a-a9de-736cf8971cd0
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24eaa916e5b842f7915a6b8c83984708.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24eaa916e5b842f7915a6b8c83984708.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 29ba4797-6928-5cf1-bfee-1d1fca1881c1 with identifier: 202602230134636
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29ba4797-6928-5cf1-bfee-1d1fca1881c1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7bd4133d046c46d1aefd52bb4ae7f59b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7bd4133d046c46d1aefd52bb4ae7f59b.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d27e72fa-83e0-5c15-bb06-726f42943f11 with identifier: 202602260231877
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d27e72fa-83e0-5c15-bb06-726f42943f11
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa92221780e2c461ba9c5f1e620ea84d8.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a92221780e2c461ba9c5f1e620ea84d8.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f10e2b-5377-5cd0-b45d-ec2b5a5158a5 with identifier: 202602230134579
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 90f10e2b-5377-5cd0-b45d-ec2b5a5158a5
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb7c0946239d405680000161cf0cce80.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb7c0946239d405680000161cf0cce80.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c79583d-61c9-5c56-ad43-a1b64b09fc1d with identifier: 202602260231678
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2c79583d-61c9-5c56-ad43-a1b64b09fc1d
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa964be7c99ac41b695e64077eb5082ab.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a964be7c99ac41b695e64077eb5082ab.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1 with identifier: 202602230132434
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0f6160a5c754c719d0f287e701ae3da.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0f6160a5c754c719d0f287e701ae3da.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ebdd11ab-18dc-5321-b4e4-ace1523d05bd with identifier: 202602260231375
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ebdd11ab-18dc-5321-b4e4-ace1523d05bd
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2dd78fcba54d435ab9550ce4f6644a5f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2dd78fcba54d435ab9550ce4f6644a5f.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ad6640c-f3a3-5b84-a5f8-d411c24d1457 with identifier: 202602230132381
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ad6640c-f3a3-5b84-a5f8-d411c24d1457
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90d503ddd301479f9a5d0d4222e9a4ba.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90d503ddd301479f9a5d0d4222e9a4ba.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f20eb9-43b8-57f8-a4ac-831c7754b88a with identifier: 202602240181243
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d4f20eb9-43b8-57f8-a4ac-831c7754b88a
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3644c9f961e444b4a20ae03b8fe32cdf.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3644c9f961e444b4a20ae03b8fe32cdf.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e with identifier: 202602200085212
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e957d8d43f847398bfe6b19f6cb61bb.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e957d8d43f847398bfe6b19f6cb61bb.jpg not downloaded yet
2026-03-26 11:10:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b0ce20a-0abf-5eb0-9ff9-e758630dc3b9 with identifier: 202602230137660
2026-03-26 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2b0ce20a-0abf-5eb0-9ff9-e758630dc3b9
2026-03-26 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a62560f-fba1-5d52-889b-c2b9d9a4e70d with identifier: 202602200085083
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9a62560f-fba1-5d52-889b-c2b9d9a4e70d
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6afc44dc6eb94008b075db05b1cf57b4.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6afc44dc6eb94008b075db05b1cf57b4.jpg not downloaded yet
2026-03-26 11:10:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2b0ce20a-0abf-5eb0-9ff9-e758630dc3b9 with identifier 202602230137660
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2b0ce20a-0abf-5eb0-9ff9-e758630dc3b9
2026-03-26 11:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GOOD CONDITION VW POLO WITH AIR CONDITIONING, ALLOY WHEELS, '
                'PARKING SENSORS, PRIVACY GLASS AND A TOUCHSCREEN MEDIA SYSTEM '
                'WITH DAB RADIO, BLUETOOTH AND APP-CONNECT! CALL US FOR MORE '
                'DETAILS OR POP IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': '2b0ce20a-0abf-5eb0-9ff9-e758630dc3b9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230137660',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 76000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 10799,
 'price_includes_vat': True,
 'registration_date': '2018-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI R-Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2018}
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230137660%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230137660: {'created_time': 1774523438.052892, 'last_price_update_time': 1774523438.05292}
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230137660') HTTP/1.1" 204 0
2026-03-26 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/009719ce0247421087ee52afb083109a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a833b65-6944-5cdd-8349-34611ffeb0eb with identifier: 202602230137446
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a833b65-6944-5cdd-8349-34611ffeb0eb
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F716e52aa9bf44304a9c189c238c92fc7.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/716e52aa9bf44304a9c189c238c92fc7.jpg not downloaded yet
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d7f6602-7aaf-5b8b-bf0e-d572c1f7dec5 with identifier: 202602190049548
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2d7f6602-7aaf-5b8b-bf0e-d572c1f7dec5
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2d7f6602-7aaf-5b8b-bf0e-d572c1f7dec5 with identifier 202602190049548
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2d7f6602-7aaf-5b8b-bf0e-d572c1f7dec5
2026-03-26 11:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Volvo XC60 B5 Inscription Pro offers a '
                'sophisticated blend of performance and comfort. As a Euro 6 '
                'compliant model, it features a 2.0 litre diesel hybrid engine '
                'paired with Four Wheel Drive, ensuring capable handling in '
                'various conditions. The Inscription Pro trim level comes '
                'equipped with a comprehensive suite of features designed for '
                'convenience and safety. These include a 360 degree surround '
                'view parking camera system with parking assistance, a Climate '
                'Pack with heated seats, and a Lounge Pack that adds climate '
                'control and an electric sunroof. For enhanced driving '
                'confidence, the Driver Assist package incorporates Blind Spot '
                'Assistance and Adaptive Cruise Control. Smartphone '
                'integration is seamless with Apple CarPlay and Android Auto '
                'compatibility.\n'
                '\n'
                'The XC60 B5 Inscription Pro excels with its impressive '
                'acceleration, reaching 0-60mph in just 6.7 seconds, '
                'demonstrating its dynamic performance. This capability, '
                'combined with a substantial towing weight of 2400 kg, makes '
                'it a versatile choice for various needs. The generous boot '
                'space further adds to its practicality, offering ample room '
                'for luggage or equipment. These highlights collectively '
                'position this Volvo XC60 as a superior option within its '
                'class, providing a refined and capable driving experience.\n'
                '\n'
                'Available now for viewing, please call our sales team to '
                'learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 232,
 'fuel_type': 'Diesel Hybrid',
 'id': '2d7f6602-7aaf-5b8b-bf0e-d572c1f7dec5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190049548',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 44300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 29299,
 'price_includes_vat': True,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B5 MHEV Inscription Pro Auto AWD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Inscription Pro',
 'year': 2021}
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190049548%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190049548: {'created_time': 1774523438.371068, 'last_price_update_time': 1774523438.371079}
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190049548') HTTP/1.1" 204 0
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b32cd1-9582-50f9-a8a1-91ce85c9a47d with identifier: 202602230137398
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 40b32cd1-9582-50f9-a8a1-91ce85c9a47d
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F410476d2c2da458e9508b9bfe198aab6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg already downloaded
2026-03-26 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/24eaa916e5b842f7915a6b8c83984708.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7bd4133d046c46d1aefd52bb4ae7f59b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 33b8d1f1-1b88-506c-8253-907bcb3e3e04 with identifier: 202602190049128
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33b8d1f1-1b88-506c-8253-907bcb3e3e04
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78c051e487024246a5367ced268bd240.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78c051e487024246a5367ced268bd240.jpg not downloaded yet
2026-03-26 11:10:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 40b32cd1-9582-50f9-a8a1-91ce85c9a47d with identifier 202602230137398
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 40b32cd1-9582-50f9-a8a1-91ce85c9a47d
2026-03-26 11:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'LOW MILEAGE AND GREAT CONDITION MG ZS WITH ALLOY WHEELS, '
                'CLIMATE CONTROL, CRUISE CONTROL, FULL LEATHER HEATED FRONT '
                'SEATS AND A TOUCHSCREEN MEDIA SYSTEM WITH NAVIGATION, DAB '
                'RADIO, REAR CAMERA AND SMARTPHONE PROJECTION! CALL US NOW FOR '
                'MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'fuel_type': 'Petrol',
 'id': '40b32cd1-9582-50f9-a8a1-91ce85c9a47d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230137398',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MG',
 'model': 'MG ZS',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photo_urls': ['https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27960c64-aa83-55ec-96a8-1e09c4757207/27960c64-aa83-55ec-96a8-1e09c4757207_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24702,
             'Height': 600,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/410476d2c2da458e9508b9bfe198aab6.jpg',
             'Width': 800}],
 'price': 12299,
 'price_includes_vat': True,
 'registration_date': '2022-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG MG Zs 1.5 VTi-TECH Exclusive Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2022}
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230137398%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230137398: {'created_time': 1774523438.454518, 'last_price_update_time': 1774523438.454528}
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230137398') HTTP/1.1" 204 0
2026-03-26 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a92221780e2c461ba9c5f1e620ea84d8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d0f6160a5c754c719d0f287e701ae3da.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bb7c0946239d405680000161cf0cce80.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d4e29f0a-2818-5df0-a93d-92ffa965e865 with identifier: 202602230135132
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d4e29f0a-2818-5df0-a93d-92ffa965e865
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F76191ed7f2d44a27917e422c42563a7d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/76191ed7f2d44a27917e422c42563a7d.jpg not downloaded yet
2026-03-26 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a964be7c99ac41b695e64077eb5082ab.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2dd78fcba54d435ab9550ce4f6644a5f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52fd8910>
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6b6412-1c71-5113-a9d7-1caec8fb8c96/8f6b6412-1c71-5113-a9d7-1caec8fb8c96_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F009719ce0247421087ee52afb083109a.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/009719ce0247421087ee52afb083109a.jpg saved to cache
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f6b6412-1c71-5113-a9d7-1caec8fb8c96
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f6b6412-1c71-5113-a9d7-1caec8fb8c96 sending to next pipeline
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e14e1b4-63ed-527b-a62c-90ac4a9edfea with identifier: 202602230135031
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e14e1b4-63ed-527b-a62c-90ac4a9edfea
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0252b3e7c3a45809f8a1297978ad997.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0252b3e7c3a45809f8a1297978ad997.jpg not downloaded yet
2026-03-26 11:10:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8f6b6412-1c71-5113-a9d7-1caec8fb8c96 with identifier 202602230134861
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8f6b6412-1c71-5113-a9d7-1caec8fb8c96
2026-03-26 11:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/009719ce0247421087ee52afb083109a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'White',
 'currency': 'GBP',
 'description': 'LOW MILEAGE VAUXHALL CORSA WITH CLIMATE CONTROL, CRUISE '
                'CONTROL AND A MEDIA SYSTEM WITH DAB RADIO, BLUETOOTH, APPLE '
                'CAR PLAY AND ANDROID AUTO! THIS VEHICLE IS AVAILABLE NOW TO '
                'VIEW, CALL US FOR FURTHER INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 74,
 'fuel_type': 'Petrol',
 'id': '8f6b6412-1c71-5113-a9d7-1caec8fb8c96',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230134861',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 16000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f6b6412-1c71-5113-a9d7-1caec8fb8c96/8f6b6412-1c71-5113-a9d7-1caec8fb8c96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274605,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/009719ce0247421087ee52afb083109a.jpg',
             'Width': 2048}],
 'price': 11999,
 'price_includes_vat': True,
 'registration_date': '2023-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 GS Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2023}
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134861%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230134861: {'created_time': 1774523438.666284, 'last_price_update_time': 1774523438.666297}
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230134861') HTTP/1.1" 204 0
2026-03-26 11:10:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e48e08-ab0f-577a-884b-99ef7ab35ff0 with identifier: 202602230134971
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68e48e08-ab0f-577a-884b-99ef7ab35ff0
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d0b0e07c71741eba8012ad39cbf0905.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d0b0e07c71741eba8012ad39cbf0905.jpg not downloaded yet
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d8c250>
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_382c6436-d94c-523a-a9de-736cf8971cd0/382c6436-d94c-523a-a9de-736cf8971cd0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24eaa916e5b842f7915a6b8c83984708.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24eaa916e5b842f7915a6b8c83984708.jpg saved to cache
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 382c6436-d94c-523a-a9de-736cf8971cd0
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 382c6436-d94c-523a-a9de-736cf8971cd0 sending to next pipeline
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51edb210>
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ba4797-6928-5cf1-bfee-1d1fca1881c1/29ba4797-6928-5cf1-bfee-1d1fca1881c1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7bd4133d046c46d1aefd52bb4ae7f59b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7bd4133d046c46d1aefd52bb4ae7f59b.jpg saved to cache
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29ba4797-6928-5cf1-bfee-1d1fca1881c1
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29ba4797-6928-5cf1-bfee-1d1fca1881c1 sending to next pipeline
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514ccfd0>
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d27e72fa-83e0-5c15-bb06-726f42943f11/d27e72fa-83e0-5c15-bb06-726f42943f11_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa92221780e2c461ba9c5f1e620ea84d8.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a92221780e2c461ba9c5f1e620ea84d8.jpg saved to cache
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d27e72fa-83e0-5c15-bb06-726f42943f11
2026-03-26 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d27e72fa-83e0-5c15-bb06-726f42943f11 sending to next pipeline
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51df4390>
2026-03-26 11:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1/0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0f6160a5c754c719d0f287e701ae3da.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0f6160a5c754c719d0f287e701ae3da.jpg saved to cache
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1 sending to next pipeline
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d78ad0>
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f10e2b-5377-5cd0-b45d-ec2b5a5158a5/90f10e2b-5377-5cd0-b45d-ec2b5a5158a5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbb7c0946239d405680000161cf0cce80.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bb7c0946239d405680000161cf0cce80.jpg saved to cache
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90f10e2b-5377-5cd0-b45d-ec2b5a5158a5
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90f10e2b-5377-5cd0-b45d-ec2b5a5158a5 sending to next pipeline
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e14990>
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c79583d-61c9-5c56-ad43-a1b64b09fc1d/2c79583d-61c9-5c56-ad43-a1b64b09fc1d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa964be7c99ac41b695e64077eb5082ab.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a964be7c99ac41b695e64077eb5082ab.jpg saved to cache
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c79583d-61c9-5c56-ad43-a1b64b09fc1d
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c79583d-61c9-5c56-ad43-a1b64b09fc1d sending to next pipeline
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51ed8890>
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdd11ab-18dc-5321-b4e4-ace1523d05bd/ebdd11ab-18dc-5321-b4e4-ace1523d05bd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2dd78fcba54d435ab9550ce4f6644a5f.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2dd78fcba54d435ab9550ce4f6644a5f.jpg saved to cache
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebdd11ab-18dc-5321-b4e4-ace1523d05bd
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebdd11ab-18dc-5321-b4e4-ace1523d05bd sending to next pipeline
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/90d503ddd301479f9a5d0d4222e9a4ba.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 382c6436-d94c-523a-a9de-736cf8971cd0 with identifier 202602230134774
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 382c6436-d94c-523a-a9de-736cf8971cd0
2026-03-26 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/24eaa916e5b842f7915a6b8c83984708.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'GOOD LOOKING RANGE ROVER SPORT WITH 22”BLACK 9 SPOKE GLOSS '
                'ALLOYS, BLACK EXTERIOR DETAILING, FULL BLACK LEATHER '
                'UPHOLSTERY, HEATED FRONT AND REAR SEATS, NAVIGATION SYSTEM, '
                'PANORAMIC SLIDING ROOF, POWER TAILGATE AND MUCH MORE! THIS IS '
                'A GREAT LOOKING VEHICLE WHICH IS AVAILABLE NOW! CALL US FOR '
                'MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 395,
 'fuel_type': 'Petrol',
 'id': '382c6436-d94c-523a-a9de-736cf8971cd0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230134774',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_382c6436-d94c-523a-a9de-736cf8971cd0/382c6436-d94c-523a-a9de-736cf8971cd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280433,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/24eaa916e5b842f7915a6b8c83984708.jpg',
             'Width': 2048}],
 'price': 36999,
 'price_includes_vat': True,
 'registration_date': '2020-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 P400 MHEV HSE Dynamic Auto 4WD '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2020}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134774%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230134774: {'created_time': 1774523439.375183, 'last_price_update_time': 1774523439.375195}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230134774') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 29ba4797-6928-5cf1-bfee-1d1fca1881c1 with identifier 202602230134636
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 29ba4797-6928-5cf1-bfee-1d1fca1881c1
2026-03-26 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7bd4133d046c46d1aefd52bb4ae7f59b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 74,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GOOD LOOKING AND VERY COMFORTABLE LANDROVER RANGE ROVER WITH '
                'ESPRESSO LEATHER INTERIOR, HEATED FRONT AND REAR SEATS, '
                'KEYLESS ENTRY, POWER TAILGATE, NAVIGATION SYSTEM, SMARTPHONE '
                'PROJECTION AND A REAR CAMERA! COME AND TAKE A LOOK NOW OR '
                'CALL TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 398,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '29ba4797-6928-5cf1-bfee-1d1fca1881c1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230134636',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ba4797-6928-5cf1-bfee-1d1fca1881c1/29ba4797-6928-5cf1-bfee-1d1fca1881c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257600,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7bd4133d046c46d1aefd52bb4ae7f59b.jpg',
             'Width': 2048}],
 'price': 31799,
 'price_includes_vat': True,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 2.0 P400e 13.1kWh HSE Auto 4WD Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2020}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134636%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230134636: {'created_time': 1774523439.425196, 'last_price_update_time': 1774523439.425208}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230134636') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d27e72fa-83e0-5c15-bb06-726f42943f11 with identifier 202602260231877
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d27e72fa-83e0-5c15-bb06-726f42943f11
2026-03-26 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a92221780e2c461ba9c5f1e620ea84d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'LOVELY PORSCHE TAYCAN JUST ARRIVED WITH UPGRADE 21” ALLOY '
                'WHEELS, PANORAMIC ROOF AND PARK ASSIST, FEATURING A REAR '
                'CAMERA AND TOP DOWN VIEW! THIS VEHICLE IS IN SUPERB CONDITION '
                'AND COMES WITH FULL LEATHER UPHOLSTERY, HEATED FRONT SEATS, '
                'NAVIGATION AND SMARTPHONE PROJECTION! CALL US NOW TO LEARN '
                'MORE!',
 'doors_number': 5,
 'engine_horse_power': 563,
 'fuel_type': 'Electric',
 'id': 'd27e72fa-83e0-5c15-bb06-726f42943f11',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260231877',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Porsche',
 'model': 'Taycan',
 'odometer': 46200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d27e72fa-83e0-5c15-bb06-726f42943f11/d27e72fa-83e0-5c15-bb06-726f42943f11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269404,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a92221780e2c461ba9c5f1e620ea84d8.jpg',
             'Width': 2048}],
 'price': 44999,
 'price_includes_vat': True,
 'registration_date': '2022-06-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche Taycan Performance Plus 93.4kWh 4S Cross Turismo Auto 4WD '
          '5dr (11kW Charger)',
 'transmission': 'automatic',
 'trim': '4S',
 'year': 2022}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231877%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260231877: {'created_time': 1774523439.472165, 'last_price_update_time': 1774523439.472175}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260231877') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1 with identifier 202602230132434
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1
2026-03-26 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d0f6160a5c754c719d0f287e701ae3da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'AWESOME AUDIO RS5, WITH 20”ALLOY WHEELS, PANORAMIC SUNROOF, '
                'THE COMFORT AND SOUND PACKAGE AND NAPPA LEATHER SUPER SPORT '
                'SEATS! THIS VEHICLE IS IN EXCELLENT CONDITION AND HAS SOME '
                'GREAT UPGRADES! CALL OUR SALES TEAM NOW TO LEARN MORE!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2.9L',
 'engine_horse_power': 444,
 'fuel_type': 'Petrol',
 'id': '0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230132434',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'RS5',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1/0ebcc3c2-d589-56ac-a8cb-d8d65d3964c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277507,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0f6160a5c754c719d0f287e701ae3da.jpg',
             'Width': 2048}],
 'price': 29999,
 'price_includes_vat': True,
 'registration_date': '2017-08-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi RS5 2.9 TFSI V6 Tiptronic quattro Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'year': 2017}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230132434%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230132434: {'created_time': 1774523439.520648, 'last_price_update_time': 1774523439.520656}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230132434') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 90f10e2b-5377-5cd0-b45d-ec2b5a5158a5 with identifier 202602230134579
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 90f10e2b-5377-5cd0-b45d-ec2b5a5158a5
2026-03-26 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bb7c0946239d405680000161cf0cce80.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'engine_horse_power': 341,
 'fuel_type': 'Electric',
 'id': '90f10e2b-5377-5cd0-b45d-ec2b5a5158a5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230134579',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 24400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f10e2b-5377-5cd0-b45d-ec2b5a5158a5/90f10e2b-5377-5cd0-b45d-ec2b5a5158a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250337,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bb7c0946239d405680000161cf0cce80.jpg',
             'Width': 2048}],
 'price': 22999,
 'price_includes_vat': True,
 'registration_date': '2023-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y Auto RWD 5dr',
 'transmission': 'automatic',
 'year': 2023}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134579%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230134579: {'created_time': 1774523439.583858, 'last_price_update_time': 1774523439.583866}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230134579') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2c79583d-61c9-5c56-ad43-a1b64b09fc1d with identifier 202602260231678
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2c79583d-61c9-5c56-ad43-a1b64b09fc1d
2026-03-26 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a964be7c99ac41b695e64077eb5082ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'BMW IX3 WITH VERNASCA LEATHER, POWER TAILGATE, PARKING '
                'SENSORS, HEATED FRONT. SEATS, HEATED STEERING WHEEL, '
                'SMARTPHONE PROJECTION AND A REAR CAMERA! THIS VEHICLE IS IN '
                'GREAT CONDITION AND IS AVAILABLE NOW TO VIEW! CALL FOR MORE '
                'INFORMATION!',
 'doors_number': 5,
 'engine_horse_power': 282,
 'fuel_type': 'Electric',
 'id': '2c79583d-61c9-5c56-ad43-a1b64b09fc1d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260231678',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'iX3',
 'odometer': 33200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c79583d-61c9-5c56-ad43-a1b64b09fc1d/2c79583d-61c9-5c56-ad43-a1b64b09fc1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263698,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a964be7c99ac41b695e64077eb5082ab.jpg',
             'Width': 2048}],
 'price': 26499,
 'price_includes_vat': True,
 'registration_date': '2023-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW iX3 80kWh M Sport Auto 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231678%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260231678: {'created_time': 1774523439.631239, 'last_price_update_time': 1774523439.631251}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260231678') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ebdd11ab-18dc-5321-b4e4-ace1523d05bd with identifier 202602260231375
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ebdd11ab-18dc-5321-b4e4-ace1523d05bd
2026-03-26 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2dd78fcba54d435ab9550ce4f6644a5f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Beige',
 'currency': 'GBP',
 'description': 'This 2022 Citroen C3 Sense is a fantastic example with '
                'exceptionally low mileage for its age, having covered just '
                '19,400 miles. Powered by an efficient 1.2 litre Euro 6 petrol '
                'engine, this model offers a smooth and economical driving '
                "experience. Inside, you'll find comfort and convenience with "
                'automatic air conditioning, including climate control, '
                'ensuring a pleasant cabin temperature in all conditions. '
                'Entertainment and connectivity are well catered for with the '
                'Citroen Connect DAB radio, featuring six speakers and '
                'seamless integration for Android Auto and Apple CarPlay, '
                'alongside Bluetooth for hands free calls and music '
                'streaming.\n'
                'Come and take a look now or give us a call to learn more.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'fuel_type': 'Petrol',
 'id': 'ebdd11ab-18dc-5321-b4e4-ace1523d05bd',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260231375',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 19400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdd11ab-18dc-5321-b4e4-ace1523d05bd/ebdd11ab-18dc-5321-b4e4-ace1523d05bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289951,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2dd78fcba54d435ab9550ce4f6644a5f.jpg',
             'Width': 2048}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2022-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Sense Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Sense',
 'year': 2022}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231375%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260231375: {'created_time': 1774523439.674515, 'last_price_update_time': 1774523439.674523}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260231375') HTTP/1.1" 204 0
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3644c9f961e444b4a20ae03b8fe32cdf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3e957d8d43f847398bfe6b19f6cb61bb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/716e52aa9bf44304a9c189c238c92fc7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6afc44dc6eb94008b075db05b1cf57b4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/76191ed7f2d44a27917e422c42563a7d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/78c051e487024246a5367ced268bd240.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d42f10>
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ad6640c-f3a3-5b84-a5f8-d411c24d1457/5ad6640c-f3a3-5b84-a5f8-d411c24d1457_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90d503ddd301479f9a5d0d4222e9a4ba.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90d503ddd301479f9a5d0d4222e9a4ba.jpg saved to cache
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ad6640c-f3a3-5b84-a5f8-d411c24d1457
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ad6640c-f3a3-5b84-a5f8-d411c24d1457 sending to next pipeline
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5ad6640c-f3a3-5b84-a5f8-d411c24d1457 with identifier 202602230132381
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5ad6640c-f3a3-5b84-a5f8-d411c24d1457
2026-03-26 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/90d503ddd301479f9a5d0d4222e9a4ba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 262,
 'color': 'Grey',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 503,
 'fuel_type': 'Petrol',
 'id': '5ad6640c-f3a3-5b84-a5f8-d411c24d1457',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230132381',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'X3 M',
 'odometer': 19400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ad6640c-f3a3-5b84-a5f8-d411c24d1457/5ad6640c-f3a3-5b84-a5f8-d411c24d1457_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270065,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/90d503ddd301479f9a5d0d4222e9a4ba.jpg',
             'Width': 2048}],
 'price': 48499,
 'price_includes_vat': True,
 'registration_date': '2020-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 M 3.0i Competition Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2020}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230132381%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230132381: {'created_time': 1774523439.832612, 'last_price_update_time': 1774523439.832621}
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230132381') HTTP/1.1" 204 0
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d43f50>
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4f20eb9-43b8-57f8-a4ac-831c7754b88a/d4f20eb9-43b8-57f8-a4ac-831c7754b88a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3644c9f961e444b4a20ae03b8fe32cdf.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3644c9f961e444b4a20ae03b8fe32cdf.jpg saved to cache
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4f20eb9-43b8-57f8-a4ac-831c7754b88a
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4f20eb9-43b8-57f8-a4ac-831c7754b88a sending to next pipeline
2026-03-26 11:10:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ce18391c-5172-5635-bd16-18ff63343edc with identifier: 202602169953357
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ce18391c-5172-5635-bd16-18ff63343edc
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fccc7f5a837884fe89e981e79d4c61db5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ccc7f5a837884fe89e981e79d4c61db5.jpg not downloaded yet
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51421b50>
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e/7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e957d8d43f847398bfe6b19f6cb61bb.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e957d8d43f847398bfe6b19f6cb61bb.jpg saved to cache
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e sending to next pipeline
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Page: 8/16, total results: 304
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059696236%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059696236: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059696099%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059696099: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059695742%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059695742: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059695056%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059695056: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049667248%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049667248: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049667034%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049667034: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049666962%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049666962: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049666744%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049666744: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049666564%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049666564: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049665279%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049665279: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049665000%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049665000: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049664917%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049664917: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049664821%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602049664821: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039628599%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602039628599: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602029605388%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602029605388: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309542216%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601309542216: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309541878%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601309541878: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480958%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289480958: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480863%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289480863: 1
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480436%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601289480436: 1
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51276b10>
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a833b65-6944-5cdd-8349-34611ffeb0eb/0a833b65-6944-5cdd-8349-34611ffeb0eb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F716e52aa9bf44304a9c189c238c92fc7.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/716e52aa9bf44304a9c189c238c92fc7.jpg saved to cache
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a833b65-6944-5cdd-8349-34611ffeb0eb
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a833b65-6944-5cdd-8349-34611ffeb0eb sending to next pipeline
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5126e390>
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a62560f-fba1-5d52-889b-c2b9d9a4e70d/9a62560f-fba1-5d52-889b-c2b9d9a4e70d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6afc44dc6eb94008b075db05b1cf57b4.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6afc44dc6eb94008b075db05b1cf57b4.jpg saved to cache
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a62560f-fba1-5d52-889b-c2b9d9a4e70d
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a62560f-fba1-5d52-889b-c2b9d9a4e70d sending to next pipeline
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d85b10>
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4e29f0a-2818-5df0-a93d-92ffa965e865/d4e29f0a-2818-5df0-a93d-92ffa965e865_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F76191ed7f2d44a27917e422c42563a7d.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/76191ed7f2d44a27917e422c42563a7d.jpg saved to cache
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4e29f0a-2818-5df0-a93d-92ffa965e865
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4e29f0a-2818-5df0-a93d-92ffa965e865 sending to next pipeline
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e16610>
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33b8d1f1-1b88-506c-8253-907bcb3e3e04/33b8d1f1-1b88-506c-8253-907bcb3e3e04_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F78c051e487024246a5367ced268bd240.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/78c051e487024246a5367ced268bd240.jpg saved to cache
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33b8d1f1-1b88-506c-8253-907bcb3e3e04
2026-03-26 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33b8d1f1-1b88-506c-8253-907bcb3e3e04 sending to next pipeline
2026-03-26 11:10:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d4f20eb9-43b8-57f8-a4ac-831c7754b88a with identifier 202602240181243
2026-03-26 11:10:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d4f20eb9-43b8-57f8-a4ac-831c7754b88a
2026-03-26 11:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3644c9f961e444b4a20ae03b8fe32cdf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'LOVELY AUDI RS3 JUST ARRIVED WITH THE COMFORT AND SOUND '
                'PACKAGE, FEATURING PARKING SENSORS, REAR CAMERA, KEYLESS '
                'ENTRY, BANG & OLUFSEN SOUND SYSTEM AND AUDI’S PHONE BOX! THIS '
                'VEHICLE IS IN EXCELLENT CONDITION AND HAS HEATED FRONT SEATS, '
                'PANORAMIC SUNROOF, FULL LEATHER, NAVIGATION SYSTEM AND '
                'SMARTPHONE PROJECTION! CALL US FOR MORE DETAILS OR COME IN TO '
                'VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 395,
 'fuel_type': 'Petrol',
 'id': 'd4f20eb9-43b8-57f8-a4ac-831c7754b88a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240181243',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'RS3',
 'odometer': 49800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4f20eb9-43b8-57f8-a4ac-831c7754b88a/d4f20eb9-43b8-57f8-a4ac-831c7754b88a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271699,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3644c9f961e444b4a20ae03b8fe32cdf.jpg',
             'Width': 2048}],
 'price': 34499,
 'price_includes_vat': True,
 'registration_date': '2019-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS3 2.5 TFSI Audi Sport Edition Sportback S Tronic quattro '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Audi Sport Edition',
 'year': 2019}
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240181243%27 HTTP/1.1" 200 None
2026-03-26 11:10:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240181243: {'created_time': 1774523440.728686, 'last_price_update_time': 1774523440.728696}
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240181243') HTTP/1.1" 204 0
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e with identifier 202602200085212
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e
2026-03-26 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3e957d8d43f847398bfe6b19f6cb61bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2023 Audi A3 TFSI S line comes with Audi Smartphone '
                'Interface, Bluetooth, Dual Zone Electronic Climate Control, '
                'Rear parking sensors, cruise control and Audi drive select.\n'
                '\n'
                'Contact us for more information.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200085212',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 24100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e/7c8e09d3-5b19-52ea-8a7b-cc0d1aaac14e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284594,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e957d8d43f847398bfe6b19f6cb61bb.jpg',
             'Width': 2048}],
 'price': 21999,
 'price_includes_vat': True,
 'registration_date': '2023-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.0 TFSI 30 S line Sportback S Tronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200085212%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200085212: {'created_time': 1774523441.032348, 'last_price_update_time': 1774523441.032356}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200085212') HTTP/1.1" 204 0
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0a833b65-6944-5cdd-8349-34611ffeb0eb with identifier 202602230137446
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0a833b65-6944-5cdd-8349-34611ffeb0eb
2026-03-26 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/716e52aa9bf44304a9c189c238c92fc7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'GOOD LOOKING BMW 420 IN A LOVELY BLUE METALLIC FINISH WITH '
                'BIG WHEELS, TINTED WINDOWS AND PARKING SENSORS! INSIDE IT '
                'COMES WITH AIR CONDITIONING, CRUISE CONTROL, FULL BLACK '
                'DAKOTA LEATHER, HEATED FRONT SEATS AND A MEDIA STSTEM WITH '
                'DAB RADIO AND A NAVIGATION SYSTEM! CALL NOW TO LEARN MORE',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 181,
 'fuel_type': 'Petrol',
 'id': '0a833b65-6944-5cdd-8349-34611ffeb0eb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230137446',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '4 Series',
 'odometer': 51400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a833b65-6944-5cdd-8349-34611ffeb0eb/0a833b65-6944-5cdd-8349-34611ffeb0eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284204,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/716e52aa9bf44304a9c189c238c92fc7.jpg',
             'Width': 2048}],
 'price': 15799,
 'price_includes_vat': True,
 'registration_date': '2019-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4 Series 2.0 420i GPF M Sport Auto Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230137446%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230137446: {'created_time': 1774523441.082338, 'last_price_update_time': 1774523441.082345}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230137446') HTTP/1.1" 204 0
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9a62560f-fba1-5d52-889b-c2b9d9a4e70d with identifier 202602200085083
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9a62560f-fba1-5d52-889b-c2b9d9a4e70d
2026-03-26 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6afc44dc6eb94008b075db05b1cf57b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'LOVELY CONDITION VW GOLF GTI WITH 18”ALLOYS, PARKING SENSORS, '
                'PRIVACY GLASS, HEATED FRONT SEATS, NAVIGATION SYSTEM, '
                'APP-CONNECT, CLIMATE CONTROL AND ADAPTIVE CRUISE CONTROL NOW '
                'AVAILABLE! GIVE OUR SALES TEAM A CALL WITH ANY QUESTIONS OR '
                'COME IN NOW TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 227,
 'fuel_type': 'Petrol',
 'id': '9a62560f-fba1-5d52-889b-c2b9d9a4e70d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200085083',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 47100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a62560f-fba1-5d52-889b-c2b9d9a4e70d/9a62560f-fba1-5d52-889b-c2b9d9a4e70d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279207,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6afc44dc6eb94008b075db05b1cf57b4.jpg',
             'Width': 2048}],
 'price': 17799,
 'price_includes_vat': True,
 'registration_date': '2018-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 2.0 TSI GTI Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'GTI',
 'year': 2018}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200085083%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200085083: {'created_time': 1774523441.127308, 'last_price_update_time': 1774523441.127321}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200085083') HTTP/1.1" 204 0
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d4e29f0a-2818-5df0-a93d-92ffa965e865 with identifier 202602230135132
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d4e29f0a-2818-5df0-a93d-92ffa965e865
2026-03-26 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/76191ed7f2d44a27917e422c42563a7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'SPORTY FORD FOCUS ST WITH BIG WHEELS, PARKING SENSORS, '
                'KEYLESS ENTRY AND PRIVACY GLASS! THIS VEHICLE LOOKS GOOD AND '
                'DRIVES GREAT! INSIDE YOU GET BANG & OLUFSEN SPEAKERS, '
                'NAVIGATION SYSTEM, PARKING CAMERA, HEAED FRONT SEATS AND A '
                'HEATED STEERING WHEEL! CALL US NOW TO ARRANGE YOUR VIEWING!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': 'd4e29f0a-2818-5df0-a93d-92ffa965e865',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230135132',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 32000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4e29f0a-2818-5df0-a93d-92ffa965e865/d4e29f0a-2818-5df0-a93d-92ffa965e865_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270986,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/76191ed7f2d44a27917e422c42563a7d.jpg',
             'Width': 2048}],
 'price': 17999,
 'price_includes_vat': True,
 'registration_date': '2020-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBlue ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2020}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230135132%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230135132: {'created_time': 1774523441.210794, 'last_price_update_time': 1774523441.210802}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230135132') HTTP/1.1" 204 0
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 33b8d1f1-1b88-506c-8253-907bcb3e3e04 with identifier 202602190049128
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 33b8d1f1-1b88-506c-8253-907bcb3e3e04
2026-03-26 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/78c051e487024246a5367ced268bd240.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'GREAT CONDITION MINI COOPER WITH KEYLESS ENTRY, REAR PARKING '
                'SENSORS, AUTOMATIC AIR CONDITIONING, CRUISE CONTROL AND A '
                'TOUCHSCREEN MEDIA SYSTEM WITH DAB RADIO, APPLE CAR PLAY AND '
                'MORE! CALL US FOR MORE INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '33b8d1f1-1b88-506c-8253-907bcb3e3e04',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190049128',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 29500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33b8d1f1-1b88-506c-8253-907bcb3e3e04/33b8d1f1-1b88-506c-8253-907bcb3e3e04_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291863,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/78c051e487024246a5367ced268bd240.jpg',
             'Width': 2048}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Hatch 1.5 Cooper Classic Steptronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Cooper Classic',
 'year': 2022}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190049128%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190049128: {'created_time': 1774523441.262689, 'last_price_update_time': 1774523441.262698}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190049128') HTTP/1.1" 204 0
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: feb1df50-dbdb-552c-b6ba-fdadc3ad16b3 with identifier: 202602109807796
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item feb1df50-dbdb-552c-b6ba-fdadc3ad16b3
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44525c2fa984465689c85cd6d150655b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44525c2fa984465689c85cd6d150655b.jpg not downloaded yet
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d0252b3e7c3a45809f8a1297978ad997.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 52dd0466-04e5-5a23-b0b9-9027d73fcacc with identifier: 202602109807535
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 52dd0466-04e5-5a23-b0b9-9027d73fcacc
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc793ae3e704b441a9487b1e4ee77a6cc.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c793ae3e704b441a9487b1e4ee77a6cc.jpg not downloaded yet
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Getting next page: 9
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 9
2026-03-26 11:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9d0b0e07c71741eba8012ad39cbf0905.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2519bc5f-abea-5e54-9795-cd5398128e2d with identifier: 202602099782023
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2519bc5f-abea-5e54-9795-cd5398128e2d
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3bdbd34861274fe48c54ab650504b0c0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3bdbd34861274fe48c54ab650504b0c0.jpg not downloaded yet
2026-03-26 11:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81 with identifier: 202602099776077
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68c76010f5b04419b5e94b70cbbb2569.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68c76010f5b04419b5e94b70cbbb2569.jpg not downloaded yet
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 810198c4-fb0b-5295-8cc1-87f314cea7cd with identifier: 202602099776056
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 810198c4-fb0b-5295-8cc1-87f314cea7cd
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F548336aae55747dfbda1c42daf1038ab.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/548336aae55747dfbda1c42daf1038ab.jpg not downloaded yet
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1329deec-5d3b-5ae2-b367-a68b4bbb0abe with identifier: 202602099776020
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1329deec-5d3b-5ae2-b367-a68b4bbb0abe
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F413627b1f8904088a138b83727d26c83.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/413627b1f8904088a138b83727d26c83.jpg not downloaded yet
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fb1a6028-2643-55b7-a944-fa6627e72bec with identifier: 202602069738915
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fb1a6028-2643-55b7-a944-fa6627e72bec
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0863193b6c446b89f259b3c793bdba8.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0863193b6c446b89f259b3c793bdba8.jpg not downloaded yet
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c581599d0>
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e14e1b4-63ed-527b-a62c-90ac4a9edfea/2e14e1b4-63ed-527b-a62c-90ac4a9edfea_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0252b3e7c3a45809f8a1297978ad997.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0252b3e7c3a45809f8a1297978ad997.jpg saved to cache
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e14e1b4-63ed-527b-a62c-90ac4a9edfea
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e14e1b4-63ed-527b-a62c-90ac4a9edfea sending to next pipeline
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e7089bf6-b5ac-52ae-8455-831f450bf1f0 with identifier: 202602069738813
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e7089bf6-b5ac-52ae-8455-831f450bf1f0
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ccd089d39c643199bf7b0a74469f7d4.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ccd089d39c643199bf7b0a74469f7d4.jpg not downloaded yet
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2e14e1b4-63ed-527b-a62c-90ac4a9edfea with identifier 202602230135031
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2e14e1b4-63ed-527b-a62c-90ac4a9edfea
2026-03-26 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d0252b3e7c3a45809f8a1297978ad997.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2022 Volkswagen ID.4 Pro Performance Life is an electric '
                'vehicle offering an impressive maximum range of 320 miles '
                'when new, making it an excellent choice for both daily '
                'commutes and longer journeys. This model features a '
                'substantial 82 kWh battery, ensuring ample power for your '
                "travels. Inside, you'll find comfortable heated front seats, "
                'perfect for those colder mornings. The Life trim also '
                'includes smart adaptive cruise control and a rain sensor, '
                'enhancing your driving experience by automatically adjusting '
                'to conditions.\n'
                '\n'
                'Further enhancing convenience and safety, this ID.4 is '
                'equipped with LED headlights and tail lights for clear '
                'visibility, alongside a driver assistance pack that includes '
                'front and rear parking sensors to aid manoeuvring. Keyless '
                'entry and start systems mean you can access and drive the '
                'vehicle with ease. When it comes to charging, a full charge '
                'at home using a 7kW charger takes approximately 12 hours and '
                '40 minutes, while rapid public charging can take you from '
                'empty to 80% in just 40 minutes. This vehicle also boasts a '
                'large boot space, providing plenty of room for luggage or '
                'shopping, setting it apart from many other similar electric '
                'cars on the market.\n'
                '\n'
                'Call our sales team now to learn more!',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': '2e14e1b4-63ed-527b-a62c-90ac4a9edfea',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230135031',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 43900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e14e1b4-63ed-527b-a62c-90ac4a9edfea/2e14e1b4-63ed-527b-a62c-90ac4a9edfea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274937,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0252b3e7c3a45809f8a1297978ad997.jpg',
             'Width': 2048}],
 'price': 15799,
 'price_includes_vat': True,
 'registration_date': '2022-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.4 Pro Performance 77kWh Life Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230135031%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230135031: {'created_time': 1774523441.597668, 'last_price_update_time': 1774523441.597678}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230135031') HTTP/1.1" 204 0
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51238250>
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e48e08-ab0f-577a-884b-99ef7ab35ff0/68e48e08-ab0f-577a-884b-99ef7ab35ff0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9d0b0e07c71741eba8012ad39cbf0905.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9d0b0e07c71741eba8012ad39cbf0905.jpg saved to cache
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68e48e08-ab0f-577a-884b-99ef7ab35ff0
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68e48e08-ab0f-577a-884b-99ef7ab35ff0 sending to next pipeline
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ccc7f5a837884fe89e981e79d4c61db5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c1f12528-6ef1-5b73-ad0a-6f3766092b15 with identifier: 202602059697004
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c1f12528-6ef1-5b73-ad0a-6f3766092b15
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0daa188690f34428abc1cedfeecf6e7b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0daa188690f34428abc1cedfeecf6e7b.jpg not downloaded yet
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 68e48e08-ab0f-577a-884b-99ef7ab35ff0 with identifier 202602230134971
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 68e48e08-ab0f-577a-884b-99ef7ab35ff0
2026-03-26 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9d0b0e07c71741eba8012ad39cbf0905.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'LOW MILEAGE, GOOD CONDITION AND FEATURES EQUIPMENT INCLUDING. '
                'REAR CAMERA, NAVIGATION SYSTEM, APPLE CAR PLAY, ANDROID AUTO, '
                'DAB RADIO, AIR CONDITIONING AND CRUISE CONTROL! COME AND TAKE '
                'A LOOK NOW OR CALL US FOR MORE INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'fuel_type': 'Petrol',
 'id': '68e48e08-ab0f-577a-884b-99ef7ab35ff0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230134971',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 27400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e48e08-ab0f-577a-884b-99ef7ab35ff0/68e48e08-ab0f-577a-884b-99ef7ab35ff0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269577,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9d0b0e07c71741eba8012ad39cbf0905.jpg',
             'Width': 2048}],
 'price': 10399,
 'price_includes_vat': True,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine Plus Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Shine Plus',
 'year': 2022}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230134971%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230134971: {'created_time': 1774523441.767889, 'last_price_update_time': 1774523441.767899}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230134971') HTTP/1.1" 204 0
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3bdbd34861274fe48c54ab650504b0c0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/44525c2fa984465689c85cd6d150655b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/413627b1f8904088a138b83727d26c83.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/68c76010f5b04419b5e94b70cbbb2569.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/548336aae55747dfbda1c42daf1038ab.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c793ae3e704b441a9487b1e4ee77a6cc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514e7b90>
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce18391c-5172-5635-bd16-18ff63343edc/ce18391c-5172-5635-bd16-18ff63343edc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fccc7f5a837884fe89e981e79d4c61db5.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ccc7f5a837884fe89e981e79d4c61db5.jpg saved to cache
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce18391c-5172-5635-bd16-18ff63343edc
2026-03-26 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce18391c-5172-5635-bd16-18ff63343edc sending to next pipeline
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ce18391c-5172-5635-bd16-18ff63343edc with identifier 202602169953357
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ce18391c-5172-5635-bd16-18ff63343edc
2026-03-26 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ccc7f5a837884fe89e981e79d4c61db5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 BMW 4 Series 430i M Sport boasts exceptionally low '
                'mileage for its age, having covered just 24,000 miles. As a '
                'Euro 6 compliant model, it features a responsive 2.0 litre '
                'petrol engine and is presented in the sporty M Sport trim. '
                'This particular example benefits from a comprehensive suite '
                'of optional packages, including the Visibility Pack with LED '
                'and Laser headlights, the M Sport Pro Package, and the '
                'Comfort Package which adds keyless entry and a heated '
                'steering wheel. Further enhancing the driving experience are '
                'the BMW Connected Package Professional, offering seamless '
                'integration with Android Auto and Apple CarPlay.\n'
                '\n'
                'The performance of this 430i M Sport is truly impressive, '
                'achieving 0-62mph in a swift 6.2 seconds, demonstrating its '
                'dynamic capabilities. This acceleration figure is notably '
                'quicker than many other vehicles in its class. Furthermore, '
                'you can expect an excellent fuel economy of around 40 mpg, '
                'making it an efficient choice for both daily commutes and '
                'longer journeys. Practicality is also a strong point, with '
                'generous boot space designed to accommodate your luggage with '
                'ease.\n'
                '\n'
                'For more details please contact our sales team or pop in to '
                'view!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 254,
 'fuel_type': 'Petrol',
 'id': 'ce18391c-5172-5635-bd16-18ff63343edc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169953357',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '4 Series',
 'odometer': 24000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce18391c-5172-5635-bd16-18ff63343edc/ce18391c-5172-5635-bd16-18ff63343edc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 287247,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ccc7f5a837884fe89e981e79d4c61db5.jpg',
             'Width': 2048}],
 'price': 29499,
 'price_includes_vat': True,
 'registration_date': '2021-09-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4 Series 2.0 430i M Sport Auto Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169953357%27 HTTP/1.1" 200 None
2026-03-26 11:10:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169953357: {'created_time': 1774523441.900379, 'last_price_update_time': 1774523441.900387}
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169953357') HTTP/1.1" 204 0
2026-03-26 11:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5ccd089d39c643199bf7b0a74469f7d4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e327d0>
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2519bc5f-abea-5e54-9795-cd5398128e2d/2519bc5f-abea-5e54-9795-cd5398128e2d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3bdbd34861274fe48c54ab650504b0c0.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3bdbd34861274fe48c54ab650504b0c0.jpg saved to cache
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2519bc5f-abea-5e54-9795-cd5398128e2d
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2519bc5f-abea-5e54-9795-cd5398128e2d sending to next pipeline
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5123ab50>
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb1df50-dbdb-552c-b6ba-fdadc3ad16b3/feb1df50-dbdb-552c-b6ba-fdadc3ad16b3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44525c2fa984465689c85cd6d150655b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44525c2fa984465689c85cd6d150655b.jpg saved to cache
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item feb1df50-dbdb-552c-b6ba-fdadc3ad16b3
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item feb1df50-dbdb-552c-b6ba-fdadc3ad16b3 sending to next pipeline
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d751d0>
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1329deec-5d3b-5ae2-b367-a68b4bbb0abe/1329deec-5d3b-5ae2-b367-a68b4bbb0abe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F413627b1f8904088a138b83727d26c83.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/413627b1f8904088a138b83727d26c83.jpg saved to cache
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1329deec-5d3b-5ae2-b367-a68b4bbb0abe
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1329deec-5d3b-5ae2-b367-a68b4bbb0abe sending to next pipeline
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514214d0>
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81/4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68c76010f5b04419b5e94b70cbbb2569.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68c76010f5b04419b5e94b70cbbb2569.jpg saved to cache
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81 sending to next pipeline
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e33dd0>
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_810198c4-fb0b-5295-8cc1-87f314cea7cd/810198c4-fb0b-5295-8cc1-87f314cea7cd_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F548336aae55747dfbda1c42daf1038ab.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/548336aae55747dfbda1c42daf1038ab.jpg saved to cache
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 810198c4-fb0b-5295-8cc1-87f314cea7cd
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 810198c4-fb0b-5295-8cc1-87f314cea7cd sending to next pipeline
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51481e10>
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52dd0466-04e5-5a23-b0b9-9027d73fcacc/52dd0466-04e5-5a23-b0b9-9027d73fcacc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc793ae3e704b441a9487b1e4ee77a6cc.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c793ae3e704b441a9487b1e4ee77a6cc.jpg saved to cache
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52dd0466-04e5-5a23-b0b9-9027d73fcacc
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52dd0466-04e5-5a23-b0b9-9027d73fcacc sending to next pipeline
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2519bc5f-abea-5e54-9795-cd5398128e2d with identifier 202602099782023
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2519bc5f-abea-5e54-9795-cd5398128e2d
2026-03-26 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3bdbd34861274fe48c54ab650504b0c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'JCW MINI NOW AVAILABLE IN GREEN WITH THE POPULAR NAVIGATION '
                'PACK, COMFORT PLUS PACK, HEAD UP DISPLAY AND MORE! THIS '
                'VEHICLE IS IN EXCELLENT CONDITION, FULL OF EQUIPMENT AND FUN '
                'TO DRIVE! CALL US NOW FOR MORE INFORMATION!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 228,
 'fuel_type': 'Petrol',
 'id': '2519bc5f-abea-5e54-9795-cd5398128e2d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602099782023',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Convertible',
 'odometer': 22100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2519bc5f-abea-5e54-9795-cd5398128e2d/2519bc5f-abea-5e54-9795-cd5398128e2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284685,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3bdbd34861274fe48c54ab650504b0c0.jpg',
             'Width': 2048}],
 'price': 18299,
 'price_includes_vat': True,
 'registration_date': '2019-12-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Convertible 2.0 John Cooper Works Euro 6 (s/s) 2dr',
 'transmission': 'manual',
 'trim': 'John Cooper Works',
 'year': 2019}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099782023%27 HTTP/1.1" 200 None
2026-03-26 11:10:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602099782023: {'created_time': 1774523442.497387, 'last_price_update_time': 1774523442.497395}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099782023') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: feb1df50-dbdb-552c-b6ba-fdadc3ad16b3 with identifier 202602109807796
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item feb1df50-dbdb-552c-b6ba-fdadc3ad16b3
2026-03-26 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/44525c2fa984465689c85cd6d150655b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'HUGE SPEC VOLVO V90 WITH THE XENIUM PACK, 21”ALLOY WHEELS, '
                'PANORAMIC SUNROOF, 1/2 LEATHER HEATED FRONT SEATS, 360 '
                'CAMERA, PARK ASSIST, HEATED WINDSCREEN, DIGITAL DASH, POWER '
                'TAILGATE, KEYLESS ENTRY AND MUCH MORE! THIS VEHICLE IS IN '
                'EXCELLENT CONDITION AND IS AVAILABLE NOW! CALL US FOR MORE '
                'INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': 'feb1df50-dbdb-552c-b6ba-fdadc3ad16b3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109807796',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 44500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb1df50-dbdb-552c-b6ba-fdadc3ad16b3/feb1df50-dbdb-552c-b6ba-fdadc3ad16b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265765,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/44525c2fa984465689c85cd6d150655b.jpg',
             'Width': 2048}],
 'price': 22499,
 'price_includes_vat': True,
 'registration_date': '2018-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V90 2.0 D4 R-Design Pro Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Design Pro',
 'year': 2018}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109807796%27 HTTP/1.1" 200 None
2026-03-26 11:10:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109807796: {'created_time': 1774523442.543439, 'last_price_update_time': 1774523442.543449}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109807796') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1329deec-5d3b-5ae2-b367-a68b4bbb0abe with identifier 202602099776020
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1329deec-5d3b-5ae2-b367-a68b4bbb0abe
2026-03-26 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/413627b1f8904088a138b83727d26c83.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Black',
 'currency': 'GBP',
 'description': '18IN ALLOYS, SAT NAV, SMARTPHONE PROJECTION, PARKING CAMERA, '
                'WIRELESS CHARGER, KEYLESS ENTRY, HEATED FRONT SEATS, HEATED '
                'STEERING WHEEL, BOSE SOUND SYSTEM AND PLENTY MORE ON THIS I20 '
                'N MODEL! IT REALLY IS IN EXCELLENT CONDITION AND HAS GREAT '
                'HISTORY TO MATCH! CALL US NOW TO ARRANGE YOUR VIEWING!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 201,
 'fuel_type': 'Petrol',
 'id': '1329deec-5d3b-5ae2-b367-a68b4bbb0abe',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602099776020',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 10000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1329deec-5d3b-5ae2-b367-a68b4bbb0abe/1329deec-5d3b-5ae2-b367-a68b4bbb0abe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257208,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/413627b1f8904088a138b83727d26c83.jpg',
             'Width': 2048}],
 'price': 23999,
 'price_includes_vat': True,
 'registration_date': '2022-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.6 T-GDi N Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'N',
 'year': 2022}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099776020%27 HTTP/1.1" 200 None
2026-03-26 11:10:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602099776020: {'created_time': 1774523442.585727, 'last_price_update_time': 1774523442.585736}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099776020') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81 with identifier 202602099776077
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81
2026-03-26 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/68c76010f5b04419b5e94b70cbbb2569.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'SPORTY CUPRA LEON WITH BIG WHEELS, EXCELLENT DESIGN AND IN '
                'GREAT CONDITION! THIS VEHICLE COMES WITH A NAVIGATION SYTEM, '
                'FULL LINK, DAB RADIO, PARKING CAMERA, PARKING SENSORS, '
                'KEYLESS ENTRY AND PLENTY MORE! COME AND TAKE A LOOK NOW OR '
                'CALL FOR MORE DETAILS',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol Hybrid',
 'id': '4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602099776077',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'CUPRA',
 'model': 'Leon',
 'odometer': 18800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81/4c5754e9-4aa6-5d6b-8cec-d9a1ce264a81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272851,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/68c76010f5b04419b5e94b70cbbb2569.jpg',
             'Width': 2048}],
 'price': 23499,
 'price_includes_vat': True,
 'registration_date': '2023-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA Leon 1.5 eTSI EVO V1 Design Edition DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'V1 Design Edition',
 'year': 2023}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099776077%27 HTTP/1.1" 200 None
2026-03-26 11:10:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602099776077: {'created_time': 1774523442.637099, 'last_price_update_time': 1774523442.637109}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099776077') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 810198c4-fb0b-5295-8cc1-87f314cea7cd with identifier 202602099776056
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 810198c4-fb0b-5295-8cc1-87f314cea7cd
2026-03-26 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/548336aae55747dfbda1c42daf1038ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'JUST ARRIVED! THIS PORSCHE HAS A HUGE SPECIAL AND IS IN '
                'EXCELLENT CONDITION! IT COMES WITH 21”ALLOY WHEELS, HEATED '
                'FRONT SEATS, SAT NAV, PARKING CAMERA, PANORAMIC SUNROOF, '
                'MEMORY SEATS, FULL LEATHER AND SO MUCH MORE! COME AND TAKE A '
                'LOOK NOW OR CALL OUR HELPFUL SALES TEAM TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.9L',
 'engine_horse_power': 375,
 'fuel_type': 'Petrol',
 'id': '810198c4-fb0b-5295-8cc1-87f314cea7cd',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602099776056',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 37600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_810198c4-fb0b-5295-8cc1-87f314cea7cd/810198c4-fb0b-5295-8cc1-87f314cea7cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258151,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/548336aae55747dfbda1c42daf1038ab.jpg',
             'Width': 2048}],
 'price': 52999,
 'price_includes_vat': True,
 'registration_date': '2023-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan 2.9T V6 S PDK 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2023}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602099776056%27 HTTP/1.1" 200 None
2026-03-26 11:10:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602099776056: {'created_time': 1774523442.682841, 'last_price_update_time': 1774523442.68285}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099776056') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 52dd0466-04e5-5a23-b0b9-9027d73fcacc with identifier 202602109807535
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 52dd0466-04e5-5a23-b0b9-9027d73fcacc
2026-03-26 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c793ae3e704b441a9487b1e4ee77a6cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'LOVELY RANGE ROVER SPORT WITH 22”ALLOY WHEELS, ELECTRIC '
                'TOWBAR, PRIVACY GLASS, POWER TAILGATE, KEYLESS ENTRY, HEATED '
                'AND COOLED FRONT SEATS, HEATED OUTER REAR SEATS, HEATED '
                'STEERING WHEEL AND MUCH MORE! CALL US FOR MORE DETAILS OR '
                'COME IN AND VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': '52dd0466-04e5-5a23-b0b9-9027d73fcacc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109807535',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 56400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52dd0466-04e5-5a23-b0b9-9027d73fcacc/52dd0466-04e5-5a23-b0b9-9027d73fcacc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291975,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c793ae3e704b441a9487b1e4ee77a6cc.jpg',
             'Width': 2048}],
 'price': 39799,
 'price_includes_vat': True,
 'registration_date': '2021-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 D300 MHEV Autobiography Dynamic '
          'Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2021}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109807535%27 HTTP/1.1" 200 None
2026-03-26 11:10:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109807535: {'created_time': 1774523442.732088, 'last_price_update_time': 1774523442.732099}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109807535') HTTP/1.1" 204 0
2026-03-26 11:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f0863193b6c446b89f259b3c793bdba8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514d31d0>
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7089bf6-b5ac-52ae-8455-831f450bf1f0/e7089bf6-b5ac-52ae-8455-831f450bf1f0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5ccd089d39c643199bf7b0a74469f7d4.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5ccd089d39c643199bf7b0a74469f7d4.jpg saved to cache
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7089bf6-b5ac-52ae-8455-831f450bf1f0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7089bf6-b5ac-52ae-8455-831f450bf1f0 sending to next pipeline
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e7089bf6-b5ac-52ae-8455-831f450bf1f0 with identifier 202602069738813
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e7089bf6-b5ac-52ae-8455-831f450bf1f0
2026-03-26 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5ccd089d39c643199bf7b0a74469f7d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 244,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'AUDI Q8 WITH THE COMFORT AND SOUND PACKAGE, BIG WHEELS AND '
                'FULL LEATHER HEATED FRONT SEATS! THIS VEHICLE IS IN GREAT '
                'CONDITION AND IS FUN TO DRIVE! CALL OUR SALES TEAM NOW FOR '
                'MORE INFORMATION OR FEEL FREE TO POP IN AND VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 335,
 'fuel_type': 'Petrol',
 'id': 'e7089bf6-b5ac-52ae-8455-831f450bf1f0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602069738813',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 42200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7089bf6-b5ac-52ae-8455-831f450bf1f0/e7089bf6-b5ac-52ae-8455-831f450bf1f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257528,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5ccd089d39c643199bf7b0a74469f7d4.jpg',
             'Width': 2048}],
 'price': 42999,
 'price_includes_vat': True,
 'registration_date': '2022-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q8 3.0 TFSI V6 55 Black Edition Tiptronic quattro Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2022}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602069738813%27 HTTP/1.1" 200 None
2026-03-26 11:10:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602069738813: {'created_time': 1774523442.839984, 'last_price_update_time': 1774523442.839994}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602069738813') HTTP/1.1" 204 0
2026-03-26 11:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0daa188690f34428abc1cedfeecf6e7b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58143050>
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb1a6028-2643-55b7-a944-fa6627e72bec/fb1a6028-2643-55b7-a944-fa6627e72bec_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff0863193b6c446b89f259b3c793bdba8.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f0863193b6c446b89f259b3c793bdba8.jpg saved to cache
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb1a6028-2643-55b7-a944-fa6627e72bec
2026-03-26 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb1a6028-2643-55b7-a944-fa6627e72bec sending to next pipeline
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fb1a6028-2643-55b7-a944-fa6627e72bec with identifier 202602069738915
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fb1a6028-2643-55b7-a944-fa6627e72bec
2026-03-26 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f0863193b6c446b89f259b3c793bdba8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GR YARIS WITH 18”BBS WHEELS, SMART PHONE PROJECTION, CLIMATE '
                'CONTROL, CRUISE CONTROL, REAR CAMERA, SUEDE STYLE STEERING '
                'WHEEL AND IN EXCELLENT CONDITION! THIS VEHICLE HAS VERY LOW '
                'MILEAGE AND GREAT HISTORY! CALL NOW TO LEARN MORE.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 257,
 'fuel_type': 'Petrol',
 'id': 'fb1a6028-2643-55b7-a944-fa6627e72bec',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602069738915',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb1a6028-2643-55b7-a944-fa6627e72bec/fb1a6028-2643-55b7-a944-fa6627e72bec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262720,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f0863193b6c446b89f259b3c793bdba8.jpg',
             'Width': 2048}],
 'price': 30799,
 'price_includes_vat': True,
 'registration_date': '2021-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.6T GR Circuit AWD Euro 6 3dr',
 'transmission': 'manual',
 'trim': 'GR Circuit',
 'year': 2021}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602069738915%27 HTTP/1.1" 200 None
2026-03-26 11:10:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602069738915: {'created_time': 1774523442.991017, 'last_price_update_time': 1774523442.991028}
2026-03-26 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602069738915') HTTP/1.1" 204 0
2026-03-26 11:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58140c90>
2026-03-26 11:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1f12528-6ef1-5b73-ad0a-6f3766092b15/c1f12528-6ef1-5b73-ad0a-6f3766092b15_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0daa188690f34428abc1cedfeecf6e7b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0daa188690f34428abc1cedfeecf6e7b.jpg saved to cache
2026-03-26 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1f12528-6ef1-5b73-ad0a-6f3766092b15
2026-03-26 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1f12528-6ef1-5b73-ad0a-6f3766092b15 sending to next pipeline
2026-03-26 11:10:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c1f12528-6ef1-5b73-ad0a-6f3766092b15 with identifier 202602059697004
2026-03-26 11:10:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c1f12528-6ef1-5b73-ad0a-6f3766092b15
2026-03-26 11:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0daa188690f34428abc1cedfeecf6e7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GREAT CONDITION TOYOTA RAV4 WITH HEATED FRONT SEATS, HEATED '
                'STEERING WHEEL, SMARTPHONE PROJECTION, PARKING CAMERA, POWER '
                'TAILGATE, KEYLESS ENTRY, DAB RADIO, FULL LEATHER SEATS AND '
                'ALOT MORE! CALL US FOR MORE INFORMATION OR POP IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 219,
 'fuel_type': 'Petrol Hybrid',
 'id': 'c1f12528-6ef1-5b73-ad0a-6f3766092b15',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059697004',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Toyota',
 'model': 'RAV4',
 'odometer': 40000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1f12528-6ef1-5b73-ad0a-6f3766092b15/c1f12528-6ef1-5b73-ad0a-6f3766092b15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273613,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0daa188690f34428abc1cedfeecf6e7b.jpg',
             'Width': 2048}],
 'price': 26499,
 'price_includes_vat': True,
 'registration_date': '2022-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV4 2.5 VVT-h Excel CVT 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Excel',
 'year': 2022}
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059697004%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059697004: {'created_time': 1774523443.150347, 'last_price_update_time': 1774523443.150358}
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059697004') HTTP/1.1" 204 0
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Page: 9/16, total results: 304
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279467300%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601279467300: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279467052%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601279467052: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269429556%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269429556: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269424085%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269424085: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269422184%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269422184: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269420950%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269420950: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239361779%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239361779: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229337682%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229337682: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229337488%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229337488: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229337342%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229337342: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229337132%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229337132: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229336982%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229336982: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229336496%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229336496: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229336415%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229336415: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229336284%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229336284: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229335898%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229335898: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229335730%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229335730: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229335566%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229335566: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209277972%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601209277972: 1
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209273093%27 HTTP/1.1" 200 None
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601209273093: 1
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Getting next page: 10
2026-03-26 11:10:43 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 10
2026-03-26 11:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a050deda-f737-548b-858a-29fcd63ca00b with identifier: 202602049665000
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a050deda-f737-548b-858a-29fcd63ca00b
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0cf536d56114de3aea5f6f7d3d7011d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0cf536d56114de3aea5f6f7d3d7011d.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d6765f83-a172-5b74-965c-8eec09417553 with identifier: 202602049664917
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d6765f83-a172-5b74-965c-8eec09417553
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8324b6d04bbb4a7ebdc9e7f177bb79a7.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8324b6d04bbb4a7ebdc9e7f177bb79a7.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1736edd5-17ae-5bbe-9344-be14d9ef5dd4 with identifier: 202602049664821
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1736edd5-17ae-5bbe-9344-be14d9ef5dd4
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a1796ef98c84a9a848bc5d4e1a6da94.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a1796ef98c84a9a848bc5d4e1a6da94.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 57021c35-42e2-5b01-84c0-1f54c7ed29ee with identifier: 202602039628599
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 57021c35-42e2-5b01-84c0-1f54c7ed29ee
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f03d6bb85df45e8ade8e19bcb758593.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f03d6bb85df45e8ade8e19bcb758593.jpg not downloaded yet
2026-03-26 11:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d482866-1909-55b8-beae-b8dc26da5870 with identifier: 202602029605388
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1d482866-1909-55b8-beae-b8dc26da5870
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5e9a2aa1d124b08b0ba805612360cee.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5e9a2aa1d124b08b0ba805612360cee.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e4e4b2bf-54d5-5e9d-9824-7822a14d476e with identifier: 202601309542216
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e4e4b2bf-54d5-5e9d-9824-7822a14d476e
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0951fee7de5e45eabc4a9a2a7704fa22.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0951fee7de5e45eabc4a9a2a7704fa22.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db1b76a-c1b4-56d7-acf8-30c44e32e5a8 with identifier: 202601309541878
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7db1b76a-c1b4-56d7-acf8-30c44e32e5a8
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc13f402cfc004ca89b454a676659bf1d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c13f402cfc004ca89b454a676659bf1d.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c5518986-0c5f-5ade-808e-35937e207646 with identifier: 202601289480958
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c5518986-0c5f-5ade-808e-35937e207646
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8d1ba11b6004f258c65e2ddbb859f8a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8d1ba11b6004f258c65e2ddbb859f8a.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 33fed3d1-c42c-5e23-afb3-c30030098574 with identifier: 202601289480863
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33fed3d1-c42c-5e23-afb3-c30030098574
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e85f19ed9a14992965e925f2f4ee786.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e85f19ed9a14992965e925f2f4ee786.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0 with identifier: 202601289480436
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe1da6b4da7a846e9a581cb3ad83e2a32.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e1da6b4da7a846e9a581cb3ad83e2a32.jpg not downloaded yet
2026-03-26 11:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e0cf536d56114de3aea5f6f7d3d7011d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b342a42e-f792-5441-a1ca-0e3c9a018127 with identifier: 202602059696236
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b342a42e-f792-5441-a1ca-0e3c9a018127
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0ab0c59e2cd4ce39bb6902602f7dc20.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0ab0c59e2cd4ce39bb6902602f7dc20.jpg not downloaded yet
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b6fdf3bc-cc29-57b9-8623-11eba4383adf with identifier: 202602059696099
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b6fdf3bc-cc29-57b9-8623-11eba4383adf
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55433155be524601977ac971851e2f42.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55433155be524601977ac971851e2f42.jpg not downloaded yet
2026-03-26 11:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58dab550>
2026-03-26 11:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a050deda-f737-548b-858a-29fcd63ca00b/a050deda-f737-548b-858a-29fcd63ca00b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0cf536d56114de3aea5f6f7d3d7011d.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0cf536d56114de3aea5f6f7d3d7011d.jpg saved to cache
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a050deda-f737-548b-858a-29fcd63ca00b
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a050deda-f737-548b-858a-29fcd63ca00b sending to next pipeline
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7051e929-4bd3-58b6-a6ef-ee43dcdedd22 with identifier: 202602059695742
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7051e929-4bd3-58b6-a6ef-ee43dcdedd22
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdcbf3d2d864d4ebe93cc7ac3a4907d30.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dcbf3d2d864d4ebe93cc7ac3a4907d30.jpg not downloaded yet
2026-03-26 11:10:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a050deda-f737-548b-858a-29fcd63ca00b with identifier 202602049665000
2026-03-26 11:10:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a050deda-f737-548b-858a-29fcd63ca00b
2026-03-26 11:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e0cf536d56114de3aea5f6f7d3d7011d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2022 Tesla Model Y Long Range offers an impressive 331 '
                'miles of electric range, showcasing its advanced electric '
                'capabilities. As a Four Wheel Drive electric vehicle, it '
                'boasts a substantial 85 kWh battery, providing ample power '
                "for your journeys. Inside, you'll find Premium Engineered "
                'Material in a stylish Black and White finish, complemented by '
                'heated front and rear seats for ultimate comfort. The Model Y '
                'also features 20 inch Induction Alloy Wheels and advanced '
                'Blind Spot Monitoring for added safety and a refined driving '
                'experience.\n'
                '\n'
                'Experience exceptional performance with this Model Y, capable '
                'of accelerating from 0 to 60mph in just 4.8 seconds, '
                'demonstrating its superior acceleration compared to other '
                'vehicles in its class. Charging is convenient, with a full '
                'charge achievable at home in approximately 12 hours using a '
                '7kW charger, and a rapid 25 minute charge to 80% possible at '
                'a public charging station. Furthermore, this model provides '
                'generous boot space, making it a practical choice for '
                'families and those needing extra room for luggage or '
                'shopping.\n'
                '\n'
                'Call us now to learn more!',
 'doors_number': 5,
 'engine_horse_power': 384,
 'fuel_type': 'Electric',
 'id': 'a050deda-f737-548b-858a-29fcd63ca00b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049665000',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 46800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a050deda-f737-548b-858a-29fcd63ca00b/a050deda-f737-548b-858a-29fcd63ca00b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251202,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0cf536d56114de3aea5f6f7d3d7011d.jpg',
             'Width': 2048}],
 'price': 23999,
 'price_includes_vat': True,
 'registration_date': '2022-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y (Dual Motor) Long Range Auto 4WDE 5dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2022}
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049665000%27 HTTP/1.1" 200 None
2026-03-26 11:10:44 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049665000: {'created_time': 1774523444.676847, 'last_price_update_time': 1774523444.676858}
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049665000') HTTP/1.1" 204 0
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8324b6d04bbb4a7ebdc9e7f177bb79a7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5f03d6bb85df45e8ade8e19bcb758593.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0951fee7de5e45eabc4a9a2a7704fa22.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c5e9a2aa1d124b08b0ba805612360cee.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c13f402cfc004ca89b454a676659bf1d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3a1796ef98c84a9a848bc5d4e1a6da94.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d8d1ba11b6004f258c65e2ddbb859f8a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d847b50d-d66e-57c3-a52c-5b42a712086a with identifier: 202602059695056
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d847b50d-d66e-57c3-a52c-5b42a712086a
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28bd4b1c25e6474ab1a4fce914985069.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28bd4b1c25e6474ab1a4fce914985069.jpg not downloaded yet
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2e85f19ed9a14992965e925f2f4ee786.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f1d0c6d-e329-5d76-8180-14b0a13b331d with identifier: 202602049667248
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4f1d0c6d-e329-5d76-8180-14b0a13b331d
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02e922e0b0d54abc9b912fd8083a5336.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02e922e0b0d54abc9b912fd8083a5336.jpg not downloaded yet
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f196f599-6080-5a8b-ad11-fd5118e0ee4e with identifier: 202602049667034
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f196f599-6080-5a8b-ad11-fd5118e0ee4e
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ea8a1bf20474fc19082478ef7a46d00.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ea8a1bf20474fc19082478ef7a46d00.jpg not downloaded yet
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fa1845f-8229-5b3e-9f2d-54f1d71701c0 with identifier: 202602049666962
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2fa1845f-8229-5b3e-9f2d-54f1d71701c0
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39d0f6c6f79b432788f1c02b9db95846.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39d0f6c6f79b432788f1c02b9db95846.jpg not downloaded yet
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e192402-260b-570d-8617-85724d15fcb1 with identifier: 202602049666744
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e192402-260b-570d-8617-85724d15fcb1
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84f23825fa5f43299be9fe314389dbc3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84f23825fa5f43299be9fe314389dbc3.jpg not downloaded yet
2026-03-26 11:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51da2c50>
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6765f83-a172-5b74-965c-8eec09417553/d6765f83-a172-5b74-965c-8eec09417553_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8324b6d04bbb4a7ebdc9e7f177bb79a7.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8324b6d04bbb4a7ebdc9e7f177bb79a7.jpg saved to cache
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6765f83-a172-5b74-965c-8eec09417553
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6765f83-a172-5b74-965c-8eec09417553 sending to next pipeline
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c581c1590>
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57021c35-42e2-5b01-84c0-1f54c7ed29ee/57021c35-42e2-5b01-84c0-1f54c7ed29ee_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f03d6bb85df45e8ade8e19bcb758593.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f03d6bb85df45e8ade8e19bcb758593.jpg saved to cache
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57021c35-42e2-5b01-84c0-1f54c7ed29ee
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57021c35-42e2-5b01-84c0-1f54c7ed29ee sending to next pipeline
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d954d0>
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4e4b2bf-54d5-5e9d-9824-7822a14d476e/e4e4b2bf-54d5-5e9d-9824-7822a14d476e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0951fee7de5e45eabc4a9a2a7704fa22.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0951fee7de5e45eabc4a9a2a7704fa22.jpg saved to cache
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4e4b2bf-54d5-5e9d-9824-7822a14d476e
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4e4b2bf-54d5-5e9d-9824-7822a14d476e sending to next pipeline
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d96b50>
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d482866-1909-55b8-beae-b8dc26da5870/1d482866-1909-55b8-beae-b8dc26da5870_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc5e9a2aa1d124b08b0ba805612360cee.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c5e9a2aa1d124b08b0ba805612360cee.jpg saved to cache
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d482866-1909-55b8-beae-b8dc26da5870
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d482866-1909-55b8-beae-b8dc26da5870 sending to next pipeline
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513b2ed0>
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7db1b76a-c1b4-56d7-acf8-30c44e32e5a8/7db1b76a-c1b4-56d7-acf8-30c44e32e5a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc13f402cfc004ca89b454a676659bf1d.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c13f402cfc004ca89b454a676659bf1d.jpg saved to cache
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7db1b76a-c1b4-56d7-acf8-30c44e32e5a8
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7db1b76a-c1b4-56d7-acf8-30c44e32e5a8 sending to next pipeline
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d976d0>
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1736edd5-17ae-5bbe-9344-be14d9ef5dd4/1736edd5-17ae-5bbe-9344-be14d9ef5dd4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3a1796ef98c84a9a848bc5d4e1a6da94.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3a1796ef98c84a9a848bc5d4e1a6da94.jpg saved to cache
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1736edd5-17ae-5bbe-9344-be14d9ef5dd4
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1736edd5-17ae-5bbe-9344-be14d9ef5dd4 sending to next pipeline
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e24710>
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5518986-0c5f-5ade-808e-35937e207646/c5518986-0c5f-5ade-808e-35937e207646_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd8d1ba11b6004f258c65e2ddbb859f8a.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d8d1ba11b6004f258c65e2ddbb859f8a.jpg saved to cache
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5518986-0c5f-5ade-808e-35937e207646
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5518986-0c5f-5ade-808e-35937e207646 sending to next pipeline
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e30f3ba-7a7d-5ec5-8be7-6da569faad52 with identifier: 202602049666564
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0e30f3ba-7a7d-5ec5-8be7-6da569faad52
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fba59ba93384e40ac83791017b04b6ca1.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ba59ba93384e40ac83791017b04b6ca1.jpg not downloaded yet
2026-03-26 11:10:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d6765f83-a172-5b74-965c-8eec09417553 with identifier 202602049664917
2026-03-26 11:10:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d6765f83-a172-5b74-965c-8eec09417553
2026-03-26 11:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8324b6d04bbb4a7ebdc9e7f177bb79a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'GOOD CONDITION VW PASSAT NOW AVAILABLE WITH FULL LEATHER '
                'UPHOLSTERY, HEATED FRONT SEATS, NAVIGATION, DAB RADIO AND '
                'MORE! CALL US FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': 'd6765f83-a172-5b74-965c-8eec09417553',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049664917',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 73000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6765f83-a172-5b74-965c-8eec09417553/d6765f83-a172-5b74-965c-8eec09417553_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275362,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8324b6d04bbb4a7ebdc9e7f177bb79a7.jpg',
             'Width': 2048}],
 'price': 17499,
 'price_includes_vat': True,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI EVO SEL DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SEL',
 'year': 2022}
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049664917%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049664917: {'created_time': 1774523445.877292, 'last_price_update_time': 1774523445.877305}
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049664917') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 57021c35-42e2-5b01-84c0-1f54c7ed29ee with identifier 202602039628599
2026-03-26 11:10:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 57021c35-42e2-5b01-84c0-1f54c7ed29ee
2026-03-26 11:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5f03d6bb85df45e8ade8e19bcb758593.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'GOOD CONDITION SEAT ARONA WITH 18”ALLOY WHEELS, PARK ASSIST, '
                'REAR CAMERA, KEYLESS ENTRY, HEATED FRONT SEATS, SAT NAV, FULL '
                'LINK, DAB RADIO AND HAS ONLY DONE 26400 MILES! \n'
                'THIS VEHICLE IS AVAILABLE NOW TO VIEW, PLEASE CALL FOR MORE '
                'DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': '57021c35-42e2-5b01-84c0-1f54c7ed29ee',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602039628599',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'SEAT',
 'model': 'Arona',
 'odometer': 26400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57021c35-42e2-5b01-84c0-1f54c7ed29ee/57021c35-42e2-5b01-84c0-1f54c7ed29ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292605,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f03d6bb85df45e8ade8e19bcb758593.jpg',
             'Width': 2048}],
 'price': 13999,
 'price_includes_vat': True,
 'registration_date': '2020-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT Arona 1.0 TSI XCELLENCE Lux DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'XCELLENCE Lux',
 'year': 2020}
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602039628599%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602039628599: {'created_time': 1774523445.93002, 'last_price_update_time': 1774523445.930037}
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602039628599') HTTP/1.1" 204 0
2026-03-26 11:10:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e4e4b2bf-54d5-5e9d-9824-7822a14d476e with identifier 202601309542216
2026-03-26 11:10:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e4e4b2bf-54d5-5e9d-9824-7822a14d476e
2026-03-26 11:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0951fee7de5e45eabc4a9a2a7704fa22.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GREAT CONDITION FORD FIESTA WITH 18” ALLOY WHEELS, REAR '
                'PARKING SENSORS, CLIMATE CONTROL, CRUISE CONTROL, HEATED '
                'FRONT SEATS, HEATED STEERING WHEEL AND THE SYNC 3 NAVIGATION '
                'SYSTEM WITH DAB RADIO, SMARTPHONE PROJECTION AND A PARKING '
                'CAMERA! CALL US NOW TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': 'e4e4b2bf-54d5-5e9d-9824-7822a14d476e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601309542216',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 29300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4e4b2bf-54d5-5e9d-9824-7822a14d476e/e4e4b2bf-54d5-5e9d-9824-7822a14d476e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253949,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0951fee7de5e45eabc4a9a2a7704fa22.jpg',
             'Width': 2048}],
 'price': 13499,
 'price_includes_vat': True,
 'registration_date': '2022-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost ST-Line X Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309542216%27 HTTP/1.1" 200 None
2026-03-26 11:10:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601309542216: {'created_time': 1774523445.985054, 'last_price_update_time': 1774523445.985067}
2026-03-26 11:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309542216') HTTP/1.1" 204 0
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1d482866-1909-55b8-beae-b8dc26da5870 with identifier 202602029605388
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1d482866-1909-55b8-beae-b8dc26da5870
2026-03-26 11:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c5e9a2aa1d124b08b0ba805612360cee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'HONDA CIVIC WITH CLIMATE CONTROL, CRUISE CONTROL, NAVIGATION '
                'SYSTEM DAB RADIO, PARKING CAMERA AND MORE NOW AVAILABLE! FOR '
                'MORE INFORMATION PLEASE CONTACT OUR SALES TEAM OR COME IN TO '
                'VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 180,
 'fuel_type': 'Petrol',
 'id': '1d482866-1909-55b8-beae-b8dc26da5870',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602029605388',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 45900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d482866-1909-55b8-beae-b8dc26da5870/1d482866-1909-55b8-beae-b8dc26da5870_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256619,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c5e9a2aa1d124b08b0ba805612360cee.jpg',
             'Width': 2048}],
 'price': 15799,
 'price_includes_vat': True,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.5 VTEC Turbo Sport Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2021}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602029605388%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602029605388: {'created_time': 1774523446.029339, 'last_price_update_time': 1774523446.029349}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602029605388') HTTP/1.1" 204 0
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7db1b76a-c1b4-56d7-acf8-30c44e32e5a8 with identifier 202601309541878
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7db1b76a-c1b4-56d7-acf8-30c44e32e5a8
2026-03-26 11:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c13f402cfc004ca89b454a676659bf1d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'GOOD CONDITION TOYOTA YARIS WITH ALLOY WHEELS, AIR '
                'CONDITIONING, CRUISE CONTROL, NAVIGATION SYSTEM, DAB RADIO, '
                'PARKING CAMERA AND MORE! CALL US NOW TO ARRANGE YOUR VIEWING!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 109,
 'fuel_type': 'Petrol',
 'id': '7db1b76a-c1b4-56d7-acf8-30c44e32e5a8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601309541878',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 72800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7db1b76a-c1b4-56d7-acf8-30c44e32e5a8/7db1b76a-c1b4-56d7-acf8-30c44e32e5a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282753,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c13f402cfc004ca89b454a676659bf1d.jpg',
             'Width': 2048}],
 'price': 8599,
 'price_includes_vat': True,
 'registration_date': '2019-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 VVT-i Icon Tech Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'Icon Tech',
 'year': 2019}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309541878%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601309541878: {'created_time': 1774523446.084753, 'last_price_update_time': 1774523446.084762}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309541878') HTTP/1.1" 204 0
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1736edd5-17ae-5bbe-9344-be14d9ef5dd4 with identifier 202602049664821
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1736edd5-17ae-5bbe-9344-be14d9ef5dd4
2026-03-26 11:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3a1796ef98c84a9a848bc5d4e1a6da94.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GOOD CONDITION VW GOLF WITH AIR CONDITIONING, ADAPTIVE CRUISE '
                'CONTROL, PARKING SENSORS AND A MEDIA SYSTEM WITH NAVIGATION, '
                'DAB RADIO AND APP-CONNECT! CALL US FOR MORE INFORMATION OR '
                'COME IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 113,
 'fuel_type': 'Diesel',
 'id': '1736edd5-17ae-5bbe-9344-be14d9ef5dd4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049664821',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1736edd5-17ae-5bbe-9344-be14d9ef5dd4/1736edd5-17ae-5bbe-9344-be14d9ef5dd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278097,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3a1796ef98c84a9a848bc5d4e1a6da94.jpg',
             'Width': 2048}],
 'price': 12999,
 'price_includes_vat': True,
 'registration_date': '2019-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.6 TDI Match Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2019}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049664821%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049664821: {'created_time': 1774523446.128439, 'last_price_update_time': 1774523446.128451}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049664821') HTTP/1.1" 204 0
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c5518986-0c5f-5ade-808e-35937e207646 with identifier 202601289480958
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c5518986-0c5f-5ade-808e-35937e207646
2026-03-26 11:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d8d1ba11b6004f258c65e2ddbb859f8a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'GOOD CONDITION VAUXHALL ASTRA WITH UPGRADE 18”ALLOYS WHEELS, '
                'PARKING SENSORS, REAR CAMERA AND A TOUCHSCREEN MEDIA SYSTEM '
                'WITH NAVIGATION, DAB RADIO AND SMARTPHONE PROJECTION! CALL US '
                'NOW FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 178,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'c5518986-0c5f-5ade-808e-35937e207646',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289480958',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Astra',
 'odometer': 20000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5518986-0c5f-5ade-808e-35937e207646/c5518986-0c5f-5ade-808e-35937e207646_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275407,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d8d1ba11b6004f258c65e2ddbb859f8a.jpg',
             'Width': 2048}],
 'price': 15699,
 'price_includes_vat': True,
 'registration_date': '2022-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Astra 1.6 12.4kWh GS Line Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2022}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480958%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289480958: {'created_time': 1774523446.176217, 'last_price_update_time': 1774523446.176227}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289480958') HTTP/1.1" 204 0
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d0ab0c59e2cd4ce39bb6902602f7dc20.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/dcbf3d2d864d4ebe93cc7ac3a4907d30.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/28bd4b1c25e6474ab1a4fce914985069.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c02494-524e-5e9b-b66d-8ad329059517 with identifier: 202602049665279
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b0c02494-524e-5e9b-b66d-8ad329059517
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb698cdf2672748569aea2c83e580e535.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b698cdf2672748569aea2c83e580e535.jpg not downloaded yet
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5144da10>
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33fed3d1-c42c-5e23-afb3-c30030098574/33fed3d1-c42c-5e23-afb3-c30030098574_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e85f19ed9a14992965e925f2f4ee786.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e85f19ed9a14992965e925f2f4ee786.jpg saved to cache
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33fed3d1-c42c-5e23-afb3-c30030098574
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33fed3d1-c42c-5e23-afb3-c30030098574 sending to next pipeline
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 677e34ba-7da0-5593-af06-8bfe5a3b90da with identifier: 202601279467300
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 677e34ba-7da0-5593-af06-8bfe5a3b90da
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5751b3e479674dde8610386524d9b225.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5751b3e479674dde8610386524d9b225.jpg not downloaded yet
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 33fed3d1-c42c-5e23-afb3-c30030098574 with identifier 202601289480863
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 33fed3d1-c42c-5e23-afb3-c30030098574
2026-03-26 11:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2e85f19ed9a14992965e925f2f4ee786.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GREAT CONDITION VAUXHALL ASTRA WITH PARKING SENSORS, 360 '
                'CAMERA, HEATED FRONT SEATS, HEATED STEERING WHEEL, '
                'NAVIGATION, MIRROR SCREEN AND MUCH MORE! CALL OUR SALES TEAM '
                'FOR MORE DETAILS.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': '33fed3d1-c42c-5e23-afb3-c30030098574',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289480863',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Astra',
 'odometer': 33200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33fed3d1-c42c-5e23-afb3-c30030098574/33fed3d1-c42c-5e23-afb3-c30030098574_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242467,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e85f19ed9a14992965e925f2f4ee786.jpg',
             'Width': 2048}],
 'price': 14299,
 'price_includes_vat': True,
 'registration_date': '2022-12-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Astra 1.2 Turbo GS Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2022}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480863%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289480863: {'created_time': 1774523446.364924, 'last_price_update_time': 1774523446.364941}
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289480863') HTTP/1.1" 204 0
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/55433155be524601977ac971851e2f42.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e1da6b4da7a846e9a581cb3ad83e2a32.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f65a1f-7d62-5e56-92ce-c562fe49a45b with identifier: 202601279467052
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9f65a1f-7d62-5e56-92ce-c562fe49a45b
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3536eb1355ea4ca9a7f1b0db1b4f42e5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3536eb1355ea4ca9a7f1b0db1b4f42e5.jpg not downloaded yet
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8ea8a1bf20474fc19082478ef7a46d00.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/02e922e0b0d54abc9b912fd8083a5336.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d916d0>
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b342a42e-f792-5441-a1ca-0e3c9a018127/b342a42e-f792-5441-a1ca-0e3c9a018127_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd0ab0c59e2cd4ce39bb6902602f7dc20.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d0ab0c59e2cd4ce39bb6902602f7dc20.jpg saved to cache
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b342a42e-f792-5441-a1ca-0e3c9a018127
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b342a42e-f792-5441-a1ca-0e3c9a018127 sending to next pipeline
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3590e711-97f7-542b-a822-c9b194a1db15 with identifier: 202601229337132
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3590e711-97f7-542b-a822-c9b194a1db15
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F869a3224dd5e4182917df0aa32b9a9c9.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/869a3224dd5e4182917df0aa32b9a9c9.jpg not downloaded yet
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Page: 10/16, total results: 304
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209273033%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601209273033: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209272803%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601209272803: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209272003%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601209272003: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199245213%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199245213: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199244526%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199244526: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601169206434%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601169206434: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601169202676%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601169202676: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601159156949%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601159156949: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149134060%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149134060: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149133935%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149133935: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149133249%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149133249: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149132719%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149132719: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149132505%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149132505: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149132376%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149132376: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149132128%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149132128: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149131737%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149131737: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149131511%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149131511: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149131216%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149131216: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149130990%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149130990: 1
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601099023856%27 HTTP/1.1" 200 None
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601099023856: 1
2026-03-26 11:10:46 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58179b10>
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7051e929-4bd3-58b6-a6ef-ee43dcdedd22/7051e929-4bd3-58b6-a6ef-ee43dcdedd22_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdcbf3d2d864d4ebe93cc7ac3a4907d30.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dcbf3d2d864d4ebe93cc7ac3a4907d30.jpg saved to cache
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7051e929-4bd3-58b6-a6ef-ee43dcdedd22
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7051e929-4bd3-58b6-a6ef-ee43dcdedd22 sending to next pipeline
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51da0b90>
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d847b50d-d66e-57c3-a52c-5b42a712086a/d847b50d-d66e-57c3-a52c-5b42a712086a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28bd4b1c25e6474ab1a4fce914985069.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28bd4b1c25e6474ab1a4fce914985069.jpg saved to cache
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d847b50d-d66e-57c3-a52c-5b42a712086a
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d847b50d-d66e-57c3-a52c-5b42a712086a sending to next pipeline
2026-03-26 11:10:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afa42d7-eda7-5940-8074-57a4d6191974 with identifier: 202601269429556
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2afa42d7-eda7-5940-8074-57a4d6191974
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa65dc843bdf64420a99653e61e5002a3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a65dc843bdf64420a99653e61e5002a3.jpg not downloaded yet
2026-03-26 11:10:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b342a42e-f792-5441-a1ca-0e3c9a018127 with identifier 202602059696236
2026-03-26 11:10:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b342a42e-f792-5441-a1ca-0e3c9a018127
2026-03-26 11:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d0ab0c59e2cd4ce39bb6902602f7dc20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'This 2021 Porsche Taycan Performance 4S is a remarkable '
                'example of electric performance. As a four wheel drive '
                'electric vehicle, it offers an impressive 254 miles of range '
                'from its 79 kWh battery. Charging is convenient, with a full '
                'charge at home taking approximately 12 hours using a 7kW '
                'charger, while rapid public charging can replenish the '
                'battery from empty to 80% in just 24 minutes. This Taycan 4S '
                'boasts striking 21 inch Jet Black Metallic Mission E Design '
                'alloy wheels, complemented by black painted model designation '
                'and black calipers on the Porsche Surface Coated Brakes. '
                'Inside, the Porsche crest is elegantly embossed on the '
                'headrests, adding a touch of refined detail.\n'
                'Available now to view, please call our sales team for further '
                'information!',
 'doors_number': 4,
 'engine_horse_power': 523,
 'fuel_type': 'Electric',
 'id': 'b342a42e-f792-5441-a1ca-0e3c9a018127',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059696236',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Porsche',
 'model': 'Taycan',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b342a42e-f792-5441-a1ca-0e3c9a018127/b342a42e-f792-5441-a1ca-0e3c9a018127_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267533,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d0ab0c59e2cd4ce39bb6902602f7dc20.jpg',
             'Width': 2048}],
 'price': 36799,
 'price_includes_vat': True,
 'registration_date': '2021-07-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche Taycan Performance 79.2kWh 4S Auto 4WD 4dr',
 'transmission': 'automatic',
 'trim': '4S',
 'year': 2021}
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059696236%27 HTTP/1.1" 200 None
2026-03-26 11:10:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059696236: {'created_time': 1774523447.188578, 'last_price_update_time': 1774523447.188585}
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059696236') HTTP/1.1" 204 0
2026-03-26 11:10:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7051e929-4bd3-58b6-a6ef-ee43dcdedd22 with identifier 202602059695742
2026-03-26 11:10:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7051e929-4bd3-58b6-a6ef-ee43dcdedd22
2026-03-26 11:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/dcbf3d2d864d4ebe93cc7ac3a4907d30.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2022 BMW 330e M Sport presents an exceptional '
                'opportunity with its remarkably low mileage of just 24,800 '
                'miles. As a Euro 6 compliant plug in hybrid, this 3 Series '
                'combines a 2.0 litre petrol engine with electric power, '
                'offering an efficient and dynamic driving experience. The M '
                'Sport trim enhances its sporty appeal, complemented by '
                'striking 19 inch BMW Individual Light Double Spoke Style 793 '
                'alloy wheels in Bicolour Orbit Grey. For added comfort and '
                'convenience, this vehicle features a panoramic glass sunroof '
                'that can be opened, front and rear park distance control for '
                'easier manoeuvring, and heated seats for both the driver and '
                'front passenger.\n'
                '\n'
                'Call us now to arrange your viewing!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 288,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '7051e929-4bd3-58b6-a6ef-ee43dcdedd22',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059695742',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '3 Series',
 'odometer': 24800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7051e929-4bd3-58b6-a6ef-ee43dcdedd22/7051e929-4bd3-58b6-a6ef-ee43dcdedd22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276016,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dcbf3d2d864d4ebe93cc7ac3a4907d30.jpg',
             'Width': 2048}],
 'price': 26499,
 'price_includes_vat': True,
 'registration_date': '2022-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 Series 2.0 330e 12kWh M Sport Touring Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059695742%27 HTTP/1.1" 200 None
2026-03-26 11:10:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059695742: {'created_time': 1774523447.513261, 'last_price_update_time': 1774523447.513271}
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059695742') HTTP/1.1" 204 0
2026-03-26 11:10:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d847b50d-d66e-57c3-a52c-5b42a712086a with identifier 202602059695056
2026-03-26 11:10:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d847b50d-d66e-57c3-a52c-5b42a712086a
2026-03-26 11:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/28bd4b1c25e6474ab1a4fce914985069.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2023 BMW i4 M50 offers an exceptional blend of electric '
                'performance and premium features. This particular model '
                'boasts a substantial 84 kWh battery, providing a maximum '
                'range of 318 miles when new.\n'
                '\n'
                " Inside, you'll find luxurious Vernasca Leather upholstery in "
                'Black with Grey Stitching, complemented by heated front '
                'seats, 20in M Alloy Wheels in Style 868 M, Harman Kardon '
                'Sound System, Parking Assistant Plus, which includes a '
                '360-degree camera and front and rear parking sensors.',
 'doors_number': 5,
 'engine_horse_power': 537,
 'fuel_type': 'Electric',
 'id': 'd847b50d-d66e-57c3-a52c-5b42a712086a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059695056',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'i4',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d847b50d-d66e-57c3-a52c-5b42a712086a/d847b50d-d66e-57c3-a52c-5b42a712086a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270555,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/28bd4b1c25e6474ab1a4fce914985069.jpg',
             'Width': 2048}],
 'price': 30599,
 'price_includes_vat': True,
 'registration_date': '2023-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW i4 M50 83.9kWh Gran Coupe Auto 4WD 5dr',
 'transmission': 'automatic',
 'year': 2023}
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059695056%27 HTTP/1.1" 200 None
2026-03-26 11:10:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059695056: {'created_time': 1774523447.632064, 'last_price_update_time': 1774523447.632079}
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059695056') HTTP/1.1" 204 0
2026-03-26 11:10:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: af331ad1-1f86-5dc3-b3df-6212edff688e with identifier: 202601229336982
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item af331ad1-1f86-5dc3-b3df-6212edff688e
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fabbe9df06b204627b26c717aea372adf.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/abbe9df06b204627b26c717aea372adf.jpg not downloaded yet
2026-03-26 11:10:47 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f with identifier: 202602190048825
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa197771267b94a15b8f8242f0a2fb6b0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a197771267b94a15b8f8242f0a2fb6b0.jpg not downloaded yet
2026-03-26 11:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/39d0f6c6f79b432788f1c02b9db95846.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:47 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:47 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cdd8e569-ba3e-5adc-af7c-927aec028556 with identifier: 202601269424085
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cdd8e569-ba3e-5adc-af7c-927aec028556
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0340bc4370bf4457a586797b3422490e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0340bc4370bf4457a586797b3422490e.jpg not downloaded yet
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d142d0>
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6fdf3bc-cc29-57b9-8623-11eba4383adf/b6fdf3bc-cc29-57b9-8623-11eba4383adf_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55433155be524601977ac971851e2f42.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55433155be524601977ac971851e2f42.jpg saved to cache
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6fdf3bc-cc29-57b9-8623-11eba4383adf
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6fdf3bc-cc29-57b9-8623-11eba4383adf sending to next pipeline
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5108ff50>
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0/ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe1da6b4da7a846e9a581cb3ad83e2a32.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e1da6b4da7a846e9a581cb3ad83e2a32.jpg saved to cache
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0 sending to next pipeline
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5109b810>
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f196f599-6080-5a8b-ad11-fd5118e0ee4e/f196f599-6080-5a8b-ad11-fd5118e0ee4e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ea8a1bf20474fc19082478ef7a46d00.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ea8a1bf20474fc19082478ef7a46d00.jpg saved to cache
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f196f599-6080-5a8b-ad11-fd5118e0ee4e
2026-03-26 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f196f599-6080-5a8b-ad11-fd5118e0ee4e sending to next pipeline
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5108f9d0>
2026-03-26 11:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f1d0c6d-e329-5d76-8180-14b0a13b331d/4f1d0c6d-e329-5d76-8180-14b0a13b331d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02e922e0b0d54abc9b912fd8083a5336.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02e922e0b0d54abc9b912fd8083a5336.jpg saved to cache
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f1d0c6d-e329-5d76-8180-14b0a13b331d
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f1d0c6d-e329-5d76-8180-14b0a13b331d sending to next pipeline
2026-03-26 11:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/84f23825fa5f43299be9fe314389dbc3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2461a5dd-fe94-521e-a4bc-6581a12f533c with identifier: 202601229336496
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2461a5dd-fe94-521e-a4bc-6581a12f533c
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F418cec767c6b4680a84c39ccb975abd5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/418cec767c6b4680a84c39ccb975abd5.jpg not downloaded yet
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Getting next page: 11
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 11
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 85580aab-03e1-508e-aca6-bdf2136828b9 with identifier: 202602190048426
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 85580aab-03e1-508e-aca6-bdf2136828b9
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F233d855b6a654a4dafafd271ab39cfdf.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/233d855b6a654a4dafafd271ab39cfdf.jpg not downloaded yet
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b6fdf3bc-cc29-57b9-8623-11eba4383adf with identifier 202602059696099
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b6fdf3bc-cc29-57b9-8623-11eba4383adf
2026-03-26 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/55433155be524601977ac971851e2f42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'EXCELLENT LAND ROVER RANGE ROVER WITH A PANORAMIC SLIDING '
                'SUNROOF, POWER TAILGATE, ELECTRIC TOWBAR, KEYLESS ENTRY, FULL '
                'LEATHER HEATED FRONT AND REAR OUTER SEATS, COOLING FRONT '
                'SEATS AND A HEATED STEERING WHEEL! \n'
                'THIS VEHICLE IS LOADED WITH OPTIONS AND IS IN EXCELLENT '
                'CONDITION! CALL US NOW TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': 'b6fdf3bc-cc29-57b9-8623-11eba4383adf',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059696099',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 33800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6fdf3bc-cc29-57b9-8623-11eba4383adf/b6fdf3bc-cc29-57b9-8623-11eba4383adf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268660,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/55433155be524601977ac971851e2f42.jpg',
             'Width': 2048}],
 'price': 40999,
 'price_includes_vat': True,
 'registration_date': '2020-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 D300 MHEV Autobiography Dynamic '
          'Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2020}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059696099%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059696099: {'created_time': 1774523448.134907, 'last_price_update_time': 1774523448.134916}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059696099') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0 with identifier 202601289480436
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0
2026-03-26 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e1da6b4da7a846e9a581cb3ad83e2a32.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 Tesla Model Y Performance has a 85 kWh battery, '
                'providing a maximum range of 319 miles when new. This Model Y '
                'features keyless entry and driving, automatic headlights, '
                'dual zone climate control, heated steering wheel, heated '
                'seats for driver and all passengers. The performance variant '
                'truly stands out, achieving 0 to 60 miles per hour in a '
                'remarkable 3.5 seconds!\n'
                '\n'
                'Contact us for more information.',
 'doors_number': 5,
 'engine_horse_power': 426,
 'fuel_type': 'Electric',
 'id': 'ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601289480436',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 36200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0/ff9c518f-5cd7-5f14-bb7a-2b6978b4d9c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234625,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e1da6b4da7a846e9a581cb3ad83e2a32.jpg',
             'Width': 2048}],
 'price': 27799,
 'price_includes_vat': True,
 'registration_date': '2022-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y (Dual Motor) Performance Auto 4WDE 5dr',
 'transmission': 'automatic',
 'trim': 'Performance',
 'year': 2022}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601289480436%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601289480436: {'created_time': 1774523448.188735, 'last_price_update_time': 1774523448.188747}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601289480436') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f196f599-6080-5a8b-ad11-fd5118e0ee4e with identifier 202602049667034
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f196f599-6080-5a8b-ad11-fd5118e0ee4e
2026-03-26 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8ea8a1bf20474fc19082478ef7a46d00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'GOOD CONDITION BMW 218i WITH 18”ALLOY WHEELS, AIR '
                'CONDITIONING, REAR PARKING SENSORS AND THE M-SPORT PLUS '
                'PACKAGE, WITH BETTER BRAKES, HARMAN KARDON SPEAKERS, '
                'NAVIGATION SYSTEM, DAB RADIO AND MUCH MORE! AVAILABLE NOW TO '
                'VIEW, PLEASE CALL US FOR ANYMORE INFORMATION!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': 'f196f599-6080-5a8b-ad11-fd5118e0ee4e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049667034',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '2 Series',
 'odometer': 55500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f196f599-6080-5a8b-ad11-fd5118e0ee4e/f196f599-6080-5a8b-ad11-fd5118e0ee4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265698,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8ea8a1bf20474fc19082478ef7a46d00.jpg',
             'Width': 2048}],
 'price': 13999,
 'price_includes_vat': True,
 'registration_date': '2019-11-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 2 Series 1.5 218i GPF M Sport Auto Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049667034%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049667034: {'created_time': 1774523448.235164, 'last_price_update_time': 1774523448.235174}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049667034') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4f1d0c6d-e329-5d76-8180-14b0a13b331d with identifier 202602049667248
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4f1d0c6d-e329-5d76-8180-14b0a13b331d
2026-03-26 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/02e922e0b0d54abc9b912fd8083a5336.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'EXCELLENT CONDITION KIA SPORTAGE JUST ARRIVED WITH 1/2 '
                'LEATHER SEATS, HEATED FRONT SEATS, NAVIGATION SYSTEM, PARKING '
                'CAMERA, SMARTPHONE PROJECTION AND A HEATED STEERING WHEEL! '
                'THIS VEHICLE IS VERY COMFORTABLE AND HAS PLENTY OF SPACE FOR '
                'A FAMILY, PLUS A LARGE BOOT! CALL US NOW TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 226,
 'fuel_type': 'Petrol Hybrid',
 'id': '4f1d0c6d-e329-5d76-8180-14b0a13b331d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049667248',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 19500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f1d0c6d-e329-5d76-8180-14b0a13b331d/4f1d0c6d-e329-5d76-8180-14b0a13b331d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276223,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/02e922e0b0d54abc9b912fd8083a5336.jpg',
             'Width': 2048}],
 'price': 24699,
 'price_includes_vat': True,
 'registration_date': '2024-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage 1.6 h T-GDi GT-Line Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2024}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049667248%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049667248: {'created_time': 1774523448.282962, 'last_price_update_time': 1774523448.282971}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049667248') HTTP/1.1" 204 0
2026-03-26 11:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 555f0898-e3e2-51a2-abf4-375a8fdae19d with identifier: 202601269422184
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 555f0898-e3e2-51a2-abf4-375a8fdae19d
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5152ef47c56f47d3bf5319b71c485c50.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5152ef47c56f47d3bf5319b71c485c50.jpg not downloaded yet
2026-03-26 11:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ba59ba93384e40ac83791017b04b6ca1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b698cdf2672748569aea2c83e580e535.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c61c7ba-36c3-556c-8b62-aff37c5abf1f with identifier: 202601229336415
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9c61c7ba-36c3-556c-8b62-aff37c5abf1f
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F12870878377247299cc68823dc6dd986.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/12870878377247299cc68823dc6dd986.jpg not downloaded yet
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e631fb69-4a91-5bfb-b4e8-824eda7c1695 with identifier: 202602179995328
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e631fb69-4a91-5bfb-b4e8-824eda7c1695
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8546d9d1f8ec4a45808063f0e459609c.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8546d9d1f8ec4a45808063f0e459609c.jpg not downloaded yet
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0186867e-1d1a-55c6-b47b-ec3e6d044dbc with identifier: 202601269420950
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0186867e-1d1a-55c6-b47b-ec3e6d044dbc
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd74d39ce534b4b24b0fb9af548c58852.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d74d39ce534b4b24b0fb9af548c58852.jpg not downloaded yet
2026-03-26 11:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5108a3d0>
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fa1845f-8229-5b3e-9f2d-54f1d71701c0/2fa1845f-8229-5b3e-9f2d-54f1d71701c0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39d0f6c6f79b432788f1c02b9db95846.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39d0f6c6f79b432788f1c02b9db95846.jpg saved to cache
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fa1845f-8229-5b3e-9f2d-54f1d71701c0
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fa1845f-8229-5b3e-9f2d-54f1d71701c0 sending to next pipeline
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514d7110>
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e192402-260b-570d-8617-85724d15fcb1/4e192402-260b-570d-8617-85724d15fcb1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84f23825fa5f43299be9fe314389dbc3.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84f23825fa5f43299be9fe314389dbc3.jpg saved to cache
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e192402-260b-570d-8617-85724d15fcb1
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e192402-260b-570d-8617-85724d15fcb1 sending to next pipeline
2026-03-26 11:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5751b3e479674dde8610386524d9b225.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bb866d26-54bb-5a31-82b6-c2850ab7e0a8 with identifier: 202601229336284
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bb866d26-54bb-5a31-82b6-c2850ab7e0a8
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a8709dbf91d43d3a234344d376afadd.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a8709dbf91d43d3a234344d376afadd.jpg not downloaded yet
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f12bb8-3bae-52db-99df-3e77a9adc8bb with identifier: 202602179995193
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 78f12bb8-3bae-52db-99df-3e77a9adc8bb
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F562cc5539272484eb3291a29378495b6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/562cc5539272484eb3291a29378495b6.jpg not downloaded yet
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2fa1845f-8229-5b3e-9f2d-54f1d71701c0 with identifier 202602049666962
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2fa1845f-8229-5b3e-9f2d-54f1d71701c0
2026-03-26 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/39d0f6c6f79b432788f1c02b9db95846.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2020 Skoda Superb TDI SE L presents an exceptional '
                'opportunity with its remarkably low mileage of just 42,700 '
                "miles and large boot space. Inside, you'll find electrically "
                'adjustable drivers seat with memory function and lumbar, '
                'alongside heated front seats, Bluetooth and front and rear '
                'parking sensors. \n'
                '\n'
                'Contact us today!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': '2fa1845f-8229-5b3e-9f2d-54f1d71701c0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049666962',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 42700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fa1845f-8229-5b3e-9f2d-54f1d71701c0/2fa1845f-8229-5b3e-9f2d-54f1d71701c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288722,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/39d0f6c6f79b432788f1c02b9db95846.jpg',
             'Width': 2048}],
 'price': 19999,
 'price_includes_vat': True,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Superb 2.0 TDI SE L DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SE L',
 'year': 2020}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049666962%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049666962: {'created_time': 1774523448.671671, 'last_price_update_time': 1774523448.671678}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049666962') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4e192402-260b-570d-8617-85724d15fcb1 with identifier 202602049666744
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4e192402-260b-570d-8617-85724d15fcb1
2026-03-26 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/84f23825fa5f43299be9fe314389dbc3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'LOVELY CONDITION JAGUAR XF WITH FULL LEATHER UPHOLSTERY, '
                'HEATED FRONT AND OUTER REAR SEATS, HEATED STEERING WHEEL, '
                '20”ALLOY WHEELS, PANORAMIC ROOF, PARKING CAMERA, NAVIGATION '
                'SYSTEM, SMARTPHONE PROJECTION, KEYLESS ENTRY, POWER TAILGATE '
                'AND MUCH MORE! \n'
                'THIS VEHICLE FEELS VERY COMFORTABLE AND HAS BEEN LOOKED '
                'AFTER! CALL OUR SALES TEAM NOW TO LEARN MORE',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': '4e192402-260b-570d-8617-85724d15fcb1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049666744',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 43800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e192402-260b-570d-8617-85724d15fcb1/4e192402-260b-570d-8617-85724d15fcb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279983,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/84f23825fa5f43299be9fe314389dbc3.jpg',
             'Width': 2048}],
 'price': 24999,
 'price_includes_vat': True,
 'registration_date': '2019-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 3.0d V6 S Sportbrake Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2019}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049666744%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049666744: {'created_time': 1774523448.719302, 'last_price_update_time': 1774523448.719311}
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049666744') HTTP/1.1" 204 0
2026-03-26 11:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3536eb1355ea4ca9a7f1b0db1b4f42e5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8947cbec-d0c7-5f35-8e27-6ca7eeea4f85 with identifier: 202601239361779
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8947cbec-d0c7-5f35-8e27-6ca7eeea4f85
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faba882f3e7a54ae7b18c3f1e4c8638ea.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aba882f3e7a54ae7b18c3f1e4c8638ea.jpg not downloaded yet
2026-03-26 11:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/869a3224dd5e4182917df0aa32b9a9c9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 14796989-1dbd-5fbc-9547-a1436ce2d967 with identifier: 202601229335898
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 14796989-1dbd-5fbc-9547-a1436ce2d967
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F996ec121a89042dc9cec725fb8966d1e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/996ec121a89042dc9cec725fb8966d1e.jpg not downloaded yet
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9291be7b-bd7b-500a-84f8-d545d4ea3677 with identifier: 202602179995062
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9291be7b-bd7b-500a-84f8-d545d4ea3677
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e0badc3c9894616bc0e148f085f832f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e0badc3c9894616bc0e148f085f832f.jpg not downloaded yet
2026-03-26 11:10:48 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:48 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e65b269-3904-53e7-a244-de3bdf1441a8 with identifier: 202601229337682
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e65b269-3904-53e7-a244-de3bdf1441a8
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c10ba6c16e840519eaacfbf3cc8af6c.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c10ba6c16e840519eaacfbf3cc8af6c.jpg not downloaded yet
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5ad8b990>
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e30f3ba-7a7d-5ec5-8be7-6da569faad52/0e30f3ba-7a7d-5ec5-8be7-6da569faad52_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fba59ba93384e40ac83791017b04b6ca1.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ba59ba93384e40ac83791017b04b6ca1.jpg saved to cache
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e30f3ba-7a7d-5ec5-8be7-6da569faad52
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e30f3ba-7a7d-5ec5-8be7-6da569faad52 sending to next pipeline
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5130edd0>
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0c02494-524e-5e9b-b66d-8ad329059517/b0c02494-524e-5e9b-b66d-8ad329059517_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb698cdf2672748569aea2c83e580e535.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b698cdf2672748569aea2c83e580e535.jpg saved to cache
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0c02494-524e-5e9b-b66d-8ad329059517
2026-03-26 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0c02494-524e-5e9b-b66d-8ad329059517 sending to next pipeline
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58dccc90>
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_677e34ba-7da0-5593-af06-8bfe5a3b90da/677e34ba-7da0-5593-af06-8bfe5a3b90da_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5751b3e479674dde8610386524d9b225.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5751b3e479674dde8610386524d9b225.jpg saved to cache
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 677e34ba-7da0-5593-af06-8bfe5a3b90da
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 677e34ba-7da0-5593-af06-8bfe5a3b90da sending to next pipeline
2026-03-26 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/abbe9df06b204627b26c717aea372adf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 92365357-a99b-5bd7-a596-a20e12557f6f with identifier: 202601229335730
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92365357-a99b-5bd7-a596-a20e12557f6f
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe22d6359ca9b41cc82ae838c3f08910b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e22d6359ca9b41cc82ae838c3f08910b.jpg not downloaded yet
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9246a58a-0845-598c-ab5e-d32f7fa8567f with identifier: 202602179994934
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9246a58a-0845-598c-ab5e-d32f7fa8567f
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F47229866e320402bad22a747095bff56.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/47229866e320402bad22a747095bff56.jpg not downloaded yet
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0e30f3ba-7a7d-5ec5-8be7-6da569faad52 with identifier 202602049666564
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0e30f3ba-7a7d-5ec5-8be7-6da569faad52
2026-03-26 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ba59ba93384e40ac83791017b04b6ca1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Silver',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': '0e30f3ba-7a7d-5ec5-8be7-6da569faad52',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049666564',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 53100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e30f3ba-7a7d-5ec5-8be7-6da569faad52/0e30f3ba-7a7d-5ec5-8be7-6da569faad52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267708,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ba59ba93384e40ac83791017b04b6ca1.jpg',
             'Width': 2048}],
 'price': 13999,
 'price_includes_vat': True,
 'registration_date': '2020-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.5T EcoBoost ST-3 Euro 6 3dr',
 'transmission': 'manual',
 'trim': 'ST-3',
 'year': 2020}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049666564%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049666564: {'created_time': 1774523449.132713, 'last_price_update_time': 1774523449.132725}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049666564') HTTP/1.1" 204 0
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b0c02494-524e-5e9b-b66d-8ad329059517 with identifier 202602049665279
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b0c02494-524e-5e9b-b66d-8ad329059517
2026-03-26 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b698cdf2672748569aea2c83e580e535.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This Qashqai Acenta Premium comes with 17 inch alloy wheels, '
                'Bluetooth, climate control, cruise control, rear parking '
                'sensors and reversing camera.\n'
                '\n'
                'Contact our friendly sales team today for more information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 156,
 'fuel_type': 'Petrol Hybrid',
 'id': 'b0c02494-524e-5e9b-b66d-8ad329059517',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602049665279',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 12100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0c02494-524e-5e9b-b66d-8ad329059517/b0c02494-524e-5e9b-b66d-8ad329059517_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251855,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b698cdf2672748569aea2c83e580e535.jpg',
             'Width': 2048}],
 'price': 16799,
 'price_includes_vat': True,
 'registration_date': '2023-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T MHEV Acenta Premium XTRON Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Acenta Premium',
 'year': 2023}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602049665279%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602049665279: {'created_time': 1774523449.197249, 'last_price_update_time': 1774523449.197265}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602049665279') HTTP/1.1" 204 0
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 677e34ba-7da0-5593-af06-8bfe5a3b90da with identifier 202601279467300
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 677e34ba-7da0-5593-af06-8bfe5a3b90da
2026-03-26 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5751b3e479674dde8610386524d9b225.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GREAT LOOKING CUPRA ATECA JUST IN WITH BIG WHEELS, FULL '
                'LEATHER HEATED FRONT SEATS, HEATED STEERING WHEEL, PARK '
                'ASSIST, NAVIGATION SYSTEM, SMARTPHONE PROJECTION AND A REAR '
                'CAMERA! CALL US NOW TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '677e34ba-7da0-5593-af06-8bfe5a3b90da',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601279467300',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'CUPRA',
 'model': 'Ateca',
 'odometer': 48000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_677e34ba-7da0-5593-af06-8bfe5a3b90da/677e34ba-7da0-5593-af06-8bfe5a3b90da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260524,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5751b3e479674dde8610386524d9b225.jpg',
             'Width': 2048}],
 'price': 20999,
 'price_includes_vat': True,
 'registration_date': '2024-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA Ateca 1.5 EcoTSI V2 DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'V2',
 'year': 2024}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279467300%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601279467300: {'created_time': 1774523449.266168, 'last_price_update_time': 1774523449.26618}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601279467300') HTTP/1.1" 204 0
2026-03-26 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a197771267b94a15b8f8242f0a2fb6b0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a65dc843bdf64420a99653e61e5002a3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a25bf638-0cca-5558-8a47-f4e407ca9f4b with identifier: 202601229337488
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a25bf638-0cca-5558-8a47-f4e407ca9f4b
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc40ffb8c94a64f5094342613536c27cf.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c40ffb8c94a64f5094342613536c27cf.jpg not downloaded yet
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e741c87-030b-58c3-863c-e192d8b1b13b with identifier: 202601229335566
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8e741c87-030b-58c3-863c-e192d8b1b13b
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fae96de9af5474f74be87bcba3990f1ad.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ae96de9af5474f74be87bcba3990f1ad.jpg not downloaded yet
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e9dfd200-28e7-58a6-ad91-e28e15e63e9f with identifier: 202602169957081
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e9dfd200-28e7-58a6-ad91-e28e15e63e9f
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2e7d60af1d44b9999f8018acefe906a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2e7d60af1d44b9999f8018acefe906a.jpg not downloaded yet
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c510751d0>
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9f65a1f-7d62-5e56-92ce-c562fe49a45b/f9f65a1f-7d62-5e56-92ce-c562fe49a45b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3536eb1355ea4ca9a7f1b0db1b4f42e5.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3536eb1355ea4ca9a7f1b0db1b4f42e5.jpg saved to cache
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9f65a1f-7d62-5e56-92ce-c562fe49a45b
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9f65a1f-7d62-5e56-92ce-c562fe49a45b sending to next pipeline
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52fbced0>
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3590e711-97f7-542b-a822-c9b194a1db15/3590e711-97f7-542b-a822-c9b194a1db15_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F869a3224dd5e4182917df0aa32b9a9c9.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/869a3224dd5e4182917df0aa32b9a9c9.jpg saved to cache
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3590e711-97f7-542b-a822-c9b194a1db15
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3590e711-97f7-542b-a822-c9b194a1db15 sending to next pipeline
2026-03-26 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5152ef47c56f47d3bf5319b71c485c50.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 98e53230-c521-5abf-8295-73cb2fefcb68 with identifier: 202601229337342
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 98e53230-c521-5abf-8295-73cb2fefcb68
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9e7253ceeae4b39be5498ac53cada89.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9e7253ceeae4b39be5498ac53cada89.jpg not downloaded yet
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f9f65a1f-7d62-5e56-92ce-c562fe49a45b with identifier 202601279467052
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f9f65a1f-7d62-5e56-92ce-c562fe49a45b
2026-03-26 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3536eb1355ea4ca9a7f1b0db1b4f42e5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'SKODA KODIAQ WITH 7 SEATS NOW AVAILABLE! THIS VEHICLE '
                'FEATURES CRUISE CONTROL, CLIMATE CONTROL, HEATED FRONT SEATS '
                'AND A TOUCHSCREEN NAVIGATION SYSTEM WITH DAB RADIO AND '
                'SMARTPHONE PROJECTION! CALL US NOW TO ARRANGE YOUR VIEWING!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 197,
 'fuel_type': 'Diesel',
 'id': 'f9f65a1f-7d62-5e56-92ce-c562fe49a45b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601279467052',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9f65a1f-7d62-5e56-92ce-c562fe49a45b/f9f65a1f-7d62-5e56-92ce-c562fe49a45b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269195,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3536eb1355ea4ca9a7f1b0db1b4f42e5.jpg',
             'Width': 2048}],
 'price': 23799,
 'price_includes_vat': True,
 'registration_date': '2021-11-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'SKODA Kodiaq 2.0 TDI SE L DSG 4WD Euro 6 (s/s) 5dr (7 Seat)',
 'transmission': 'automatic',
 'trim': 'SE L',
 'year': 2021}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279467052%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601279467052: {'created_time': 1774523449.58841, 'last_price_update_time': 1774523449.588418}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601279467052') HTTP/1.1" 204 0
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3590e711-97f7-542b-a822-c9b194a1db15 with identifier 202601229337132
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3590e711-97f7-542b-a822-c9b194a1db15
2026-03-26 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/869a3224dd5e4182917df0aa32b9a9c9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'GOOD CONDITION I 10 WITH BLUETOOTH, DAB RADIO AND AIR '
                'CONDITIONING NOW AVAILABLE! IF YOU WOULD LIKE MORE DETAILS '
                'PLEASE CALL OUR SALES OR PLEASE POP IN AND SEE US!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 66,
 'fuel_type': 'Petrol',
 'id': '3590e711-97f7-542b-a822-c9b194a1db15',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229337132',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 46100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3590e711-97f7-542b-a822-c9b194a1db15/3590e711-97f7-542b-a822-c9b194a1db15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274002,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/869a3224dd5e4182917df0aa32b9a9c9.jpg',
             'Width': 2048}],
 'price': 8899,
 'price_includes_vat': True,
 'registration_date': '2023-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 SE Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2023}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229337132%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229337132: {'created_time': 1774523449.632856, 'last_price_update_time': 1774523449.632865}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229337132') HTTP/1.1" 204 0
2026-03-26 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0340bc4370bf4457a586797b3422490e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/418cec767c6b4680a84c39ccb975abd5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 770983dd-4c08-54dc-a16f-86f285df627f with identifier: 202601209277972
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 770983dd-4c08-54dc-a16f-86f285df627f
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0e40daf763042b7b2ceeeaf09ab7a01.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0e40daf763042b7b2ceeeaf09ab7a01.jpg not downloaded yet
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bc20cc13-b066-5cf7-a322-4a83052dbe68 with identifier: 202602169956982
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bc20cc13-b066-5cf7-a322-4a83052dbe68
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf0eff7231594ae1af40934c4c54d9ee.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df0eff7231594ae1af40934c4c54d9ee.jpg not downloaded yet
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514b7c10>
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af331ad1-1f86-5dc3-b3df-6212edff688e/af331ad1-1f86-5dc3-b3df-6212edff688e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fabbe9df06b204627b26c717aea372adf.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/abbe9df06b204627b26c717aea372adf.jpg saved to cache
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af331ad1-1f86-5dc3-b3df-6212edff688e
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af331ad1-1f86-5dc3-b3df-6212edff688e sending to next pipeline
2026-03-26 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/233d855b6a654a4dafafd271ab39cfdf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: af331ad1-1f86-5dc3-b3df-6212edff688e with identifier 202601229336982
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item af331ad1-1f86-5dc3-b3df-6212edff688e
2026-03-26 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/abbe9df06b204627b26c717aea372adf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'White',
 'currency': 'GBP',
 'description': 'MAZDA 2 WITH AIR CONDITIONING, CRUISE CONTROL, BLUETOOTH, DAB '
                'RADIO, NAVIGATION SYSTEM AND SMARTPHONE PROJECTION VIA APPLE '
                'CAR PLAY AND ANDROID  AUTO! CALL US NOW TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': 'af331ad1-1f86-5dc3-b3df-6212edff688e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229336982',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mazda',
 'model': 'Mazda2',
 'odometer': 39800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af331ad1-1f86-5dc3-b3df-6212edff688e/af331ad1-1f86-5dc3-b3df-6212edff688e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255168,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/abbe9df06b204627b26c717aea372adf.jpg',
             'Width': 2048}],
 'price': 10799,
 'price_includes_vat': True,
 'registration_date': '2023-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda2 1.5 e-SKYACTIV G MHEV MHEV SE-L Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE-L',
 'year': 2023}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229336982%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229336982: {'created_time': 1774523449.79147, 'last_price_update_time': 1774523449.791484}
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229336982') HTTP/1.1" 204 0
2026-03-26 11:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8546d9d1f8ec4a45808063f0e459609c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 72be56a0-7214-5188-8ae6-89b97355b39e with identifier: 202601209273093
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72be56a0-7214-5188-8ae6-89b97355b39e
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc249c2e3cdcd4b89a0249e98fba5a3b5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c249c2e3cdcd4b89a0249e98fba5a3b5.jpg not downloaded yet
2026-03-26 11:10:49 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e637b860-9666-52de-9cc7-6e24bbe8dfd6 with identifier: 202602169956773
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e637b860-9666-52de-9cc7-6e24bbe8dfd6
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a734183ae80446eb0e9182f96b73320.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a734183ae80446eb0e9182f96b73320.jpg not downloaded yet
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121ac90>
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f/b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa197771267b94a15b8f8242f0a2fb6b0.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a197771267b94a15b8f8242f0a2fb6b0.jpg saved to cache
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f
2026-03-26 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f sending to next pipeline
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121e2d0>
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2afa42d7-eda7-5940-8074-57a4d6191974/2afa42d7-eda7-5940-8074-57a4d6191974_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa65dc843bdf64420a99653e61e5002a3.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a65dc843bdf64420a99653e61e5002a3.jpg saved to cache
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2afa42d7-eda7-5940-8074-57a4d6191974
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2afa42d7-eda7-5940-8074-57a4d6191974 sending to next pipeline
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51298790>
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_555f0898-e3e2-51a2-abf4-375a8fdae19d/555f0898-e3e2-51a2-abf4-375a8fdae19d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5152ef47c56f47d3bf5319b71c485c50.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5152ef47c56f47d3bf5319b71c485c50.jpg saved to cache
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 555f0898-e3e2-51a2-abf4-375a8fdae19d
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 555f0898-e3e2-51a2-abf4-375a8fdae19d sending to next pipeline
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121de10>
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd8e569-ba3e-5adc-af7c-927aec028556/cdd8e569-ba3e-5adc-af7c-927aec028556_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0340bc4370bf4457a586797b3422490e.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0340bc4370bf4457a586797b3422490e.jpg saved to cache
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdd8e569-ba3e-5adc-af7c-927aec028556
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdd8e569-ba3e-5adc-af7c-927aec028556 sending to next pipeline
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5104f050>
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2461a5dd-fe94-521e-a4bc-6581a12f533c/2461a5dd-fe94-521e-a4bc-6581a12f533c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F418cec767c6b4680a84c39ccb975abd5.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/418cec767c6b4680a84c39ccb975abd5.jpg saved to cache
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2461a5dd-fe94-521e-a4bc-6581a12f533c
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2461a5dd-fe94-521e-a4bc-6581a12f533c sending to next pipeline
2026-03-26 11:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/12870878377247299cc68823dc6dd986.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/aba882f3e7a54ae7b18c3f1e4c8638ea.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e288a04-7964-58d6-b57c-3023dbab1420 with identifier: 202602169954217
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7e288a04-7964-58d6-b57c-3023dbab1420
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71e3b0273b524193807783cc7b57d1b3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71e3b0273b524193807783cc7b57d1b3.jpg not downloaded yet
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f with identifier 202602190048825
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f
2026-03-26 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a197771267b94a15b8f8242f0a2fb6b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'LOVELY CONDITION FORD FIESTA WITH HEATED FRONT SEATS, HEATED '
                'STEERING WHEEL, 1/2 LEATHER UPHOLSTERY, THE BANG & OLUFSEN '
                'SOUND SYSTEM, KEYLESS ENTRY, REAR CAMERA AND MORE NOW '
                'AVAILABLE! FOR MORE DETAILS PLEASE CONTACT OUR SALES TEAM OR '
                'POP IN TO VIEW',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': 'b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190048825',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 37800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f/b99de0ee-f19d-5f39-a1d8-d7bf02bdb60f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 279948,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a197771267b94a15b8f8242f0a2fb6b0.jpg',
             'Width': 2048}],
 'price': 12499,
 'price_includes_vat': True,
 'registration_date': '2022-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost MHEV ST-Line X Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line X Edition',
 'year': 2022}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190048825%27 HTTP/1.1" 200 None
2026-03-26 11:10:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190048825: {'created_time': 1774523450.347184, 'last_price_update_time': 1774523450.347193}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190048825') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2afa42d7-eda7-5940-8074-57a4d6191974 with identifier 202601269429556
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2afa42d7-eda7-5940-8074-57a4d6191974
2026-03-26 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a65dc843bdf64420a99653e61e5002a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'SPORTY HYUNDAI I30N WITH HEATED FRONT SEATS, HEATED STEERING '
                'WHEEL, PARKING SENSORS, REAR CAMERA, KEYLESS ENTRY, CLIMATE '
                'CONTROL, 19”ALLOYS, CRUISE CONTROL AND MUCH MORE! THIS '
                'VEHICLE IS IN GOOD CONDITION AND IS AVAILABLE NOW FOR '
                'VIEWING! CALL FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 271,
 'fuel_type': 'Petrol',
 'id': '2afa42d7-eda7-5940-8074-57a4d6191974',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269429556',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 75000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2afa42d7-eda7-5940-8074-57a4d6191974/2afa42d7-eda7-5940-8074-57a4d6191974_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 281361,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a65dc843bdf64420a99653e61e5002a3.jpg',
             'Width': 2048}],
 'price': 16699,
 'price_includes_vat': True,
 'registration_date': '2018-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 2.0 T-GDi N Performance Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2018}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269429556%27 HTTP/1.1" 200 None
2026-03-26 11:10:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269429556: {'created_time': 1774523450.394644, 'last_price_update_time': 1774523450.394654}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269429556') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 555f0898-e3e2-51a2-abf4-375a8fdae19d with identifier 202601269422184
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 555f0898-e3e2-51a2-abf4-375a8fdae19d
2026-03-26 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5152ef47c56f47d3bf5319b71c485c50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2022 MINI Countryman Cooper Exclusive offers a superb '
                'blend of style and practicality, making it an excellent '
                'choice for those seeking a versatile vehicle. Powered by an '
                'efficient 1.5 litre petrol engine meeting Euro 6 emissions '
                'standards, this model boasts a highlight fuel economy of 45 '
                'miles per gallon. It comes equipped with the desirable '
                'Comfort Pack, which includes heated seats for those chilly '
                'mornings, and the Navigation Pack, featuring Apple CarPlay '
                'for seamless connectivity. Further enhancing its appeal are '
                'the stylish 19 inch Turnstile Spoke alloy wheels in a two '
                'tone finish, rear parking distance control with rear parking '
                'assistance sensors, and automatic headlights that activate '
                'with the rain sensor and automatic headlight activation '
                'system.\n'
                '\n'
                'This vehicle is in nice condition and is available now! Call '
                'us for more information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '555f0898-e3e2-51a2-abf4-375a8fdae19d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269422184',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 27000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_555f0898-e3e2-51a2-abf4-375a8fdae19d/555f0898-e3e2-51a2-abf4-375a8fdae19d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253929,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5152ef47c56f47d3bf5319b71c485c50.jpg',
             'Width': 2048}],
 'price': 21899,
 'price_includes_vat': True,
 'registration_date': '2022-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman 1.5 Cooper Exclusive Steptronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Cooper Exclusive',
 'year': 2022}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269422184%27 HTTP/1.1" 200 None
2026-03-26 11:10:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269422184: {'created_time': 1774523450.441772, 'last_price_update_time': 1774523450.441779}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269422184') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cdd8e569-ba3e-5adc-af7c-927aec028556 with identifier 202601269424085
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cdd8e569-ba3e-5adc-af7c-927aec028556
2026-03-26 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0340bc4370bf4457a586797b3422490e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'MERCEDES A-CLASS WITH AIR CONDITIONING, CRUISE CONTROL, '
                'NAVIGATION SYSTEM, DAB RADIO, BLUETOOTH AND MORE NOW '
                'AVAILABLE! THIS VEHICLE IS IN GOOD CONDITION AND DRIVES '
                'GREAT! CALL US NOW FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': 'cdd8e569-ba3e-5adc-af7c-927aec028556',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269424085',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'A Class',
 'odometer': 52600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd8e569-ba3e-5adc-af7c-927aec028556/cdd8e569-ba3e-5adc-af7c-927aec028556_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268767,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0340bc4370bf4457a586797b3422490e.jpg',
             'Width': 2048}],
 'price': 13499,
 'price_includes_vat': True,
 'registration_date': '2019-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A Class 1.3 A180 AMG Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269424085%27 HTTP/1.1" 200 None
2026-03-26 11:10:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269424085: {'created_time': 1774523450.487186, 'last_price_update_time': 1774523450.487193}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269424085') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2461a5dd-fe94-521e-a4bc-6581a12f533c with identifier 202601229336496
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2461a5dd-fe94-521e-a4bc-6581a12f533c
2026-03-26 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/418cec767c6b4680a84c39ccb975abd5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'MERCEDES EQC WITH THE PREMIUM PLUS PACK GIVING YOU HUGE 21” '
                'BLACK ALLOY WHEELS, PANORAMIC SUNROOF AND MICH MORE! THIS '
                'VEHICLE IS LOADED WITH EQUIPMENT INCLUDING HEATED FRONTS, '
                'MEMORY FRONT SEATS, 360 CAMERA, HEAD UP DISPLAY AND MORE! '
                'CALL US NOW FOR MORE DETAILS!',
 'doors_number': 5,
 'engine_horse_power': 402,
 'fuel_type': 'Electric',
 'id': '2461a5dd-fe94-521e-a4bc-6581a12f533c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229336496',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'EQC',
 'odometer': 31200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2461a5dd-fe94-521e-a4bc-6581a12f533c/2461a5dd-fe94-521e-a4bc-6581a12f533c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259747,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/418cec767c6b4680a84c39ccb975abd5.jpg',
             'Width': 2048}],
 'price': 27999,
 'price_includes_vat': True,
 'registration_date': '2023-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz EQC 400 80kWh AMG Line (Premium Plus) Auto 4MATIC 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229336496%27 HTTP/1.1" 200 None
2026-03-26 11:10:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229336496: {'created_time': 1774523450.535473, 'last_price_update_time': 1774523450.535482}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229336496') HTTP/1.1" 204 0
2026-03-26 11:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d74d39ce534b4b24b0fb9af548c58852.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51288ad0>
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85580aab-03e1-508e-aca6-bdf2136828b9/85580aab-03e1-508e-aca6-bdf2136828b9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F233d855b6a654a4dafafd271ab39cfdf.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/233d855b6a654a4dafafd271ab39cfdf.jpg saved to cache
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 85580aab-03e1-508e-aca6-bdf2136828b9
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 85580aab-03e1-508e-aca6-bdf2136828b9 sending to next pipeline
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5133cb10>
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e631fb69-4a91-5bfb-b4e8-824eda7c1695/e631fb69-4a91-5bfb-b4e8-824eda7c1695_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8546d9d1f8ec4a45808063f0e459609c.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8546d9d1f8ec4a45808063f0e459609c.jpg saved to cache
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e631fb69-4a91-5bfb-b4e8-824eda7c1695
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e631fb69-4a91-5bfb-b4e8-824eda7c1695 sending to next pipeline
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5133f250>
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c61c7ba-36c3-556c-8b62-aff37c5abf1f/9c61c7ba-36c3-556c-8b62-aff37c5abf1f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F12870878377247299cc68823dc6dd986.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/12870878377247299cc68823dc6dd986.jpg saved to cache
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c61c7ba-36c3-556c-8b62-aff37c5abf1f
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c61c7ba-36c3-556c-8b62-aff37c5abf1f sending to next pipeline
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513d5650>
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8947cbec-d0c7-5f35-8e27-6ca7eeea4f85/8947cbec-d0c7-5f35-8e27-6ca7eeea4f85_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faba882f3e7a54ae7b18c3f1e4c8638ea.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aba882f3e7a54ae7b18c3f1e4c8638ea.jpg saved to cache
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8947cbec-d0c7-5f35-8e27-6ca7eeea4f85
2026-03-26 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8947cbec-d0c7-5f35-8e27-6ca7eeea4f85 sending to next pipeline
2026-03-26 11:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9a8709dbf91d43d3a234344d376afadd.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 85580aab-03e1-508e-aca6-bdf2136828b9 with identifier 202602190048426
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 85580aab-03e1-508e-aca6-bdf2136828b9
2026-03-26 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/233d855b6a654a4dafafd271ab39cfdf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'White',
 'currency': 'GBP',
 'description': 'BMW 128TI WITH 1/2 LEATHER UPHOLSTERY, HEATED FRONT SEATS, '
                'NAVIGATION SYSTEM, DAB RADIO, POWER FOLDING MIRRORS, PARKING '
                'SENSORS AND MORE! THIS VEHICLE IS IN GREAT CONDITION AND IS '
                'AVAILABLE NOW FOR VIEWING! CALL US FOR MORE INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 261,
 'fuel_type': 'Petrol',
 'id': '85580aab-03e1-508e-aca6-bdf2136828b9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190048426',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 26300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85580aab-03e1-508e-aca6-bdf2136828b9/85580aab-03e1-508e-aca6-bdf2136828b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 280140,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/233d855b6a654a4dafafd271ab39cfdf.jpg',
             'Width': 2048}],
 'price': 22799,
 'price_includes_vat': True,
 'registration_date': '2023-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 Series 2.0 128ti (LCP) Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'year': 2023}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190048426%27 HTTP/1.1" 200 None
2026-03-26 11:10:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190048426: {'created_time': 1774523450.963273, 'last_price_update_time': 1774523450.963283}
2026-03-26 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190048426') HTTP/1.1" 204 0
2026-03-26 11:10:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e631fb69-4a91-5bfb-b4e8-824eda7c1695 with identifier 202602179995328
2026-03-26 11:10:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e631fb69-4a91-5bfb-b4e8-824eda7c1695
2026-03-26 11:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8546d9d1f8ec4a45808063f0e459609c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Black',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'e631fb69-4a91-5bfb-b4e8-824eda7c1695',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179995328',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Mokka',
 'odometer': 24100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e631fb69-4a91-5bfb-b4e8-824eda7c1695/e631fb69-4a91-5bfb-b4e8-824eda7c1695_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285453,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8546d9d1f8ec4a45808063f0e459609c.jpg',
             'Width': 2048}],
 'price': 13499,
 'price_includes_vat': True,
 'registration_date': '2022-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka 1.2 Turbo Elite Premium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Elite Premium',
 'year': 2022}
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179995328%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179995328: {'created_time': 1774523451.049852, 'last_price_update_time': 1774523451.049861}
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179995328') HTTP/1.1" 204 0
2026-03-26 11:10:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9c61c7ba-36c3-556c-8b62-aff37c5abf1f with identifier 202601229336415
2026-03-26 11:10:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9c61c7ba-36c3-556c-8b62-aff37c5abf1f
2026-03-26 11:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/12870878377247299cc68823dc6dd986.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'AUDI A3 WITH THE COMFORT & SOUND PACK, 18”ALLOYS, BANG & '
                'OLUFSEN SPEAKERS, REAR CAMERA, PARKING SENSORS, HEATED FRONT '
                'SEATS AND IN GREAT CONDITION! AVAILABLE NOW FOR VIEWING, '
                'PLEASE CALL US FOR MORE INFORMATION',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '9c61c7ba-36c3-556c-8b62-aff37c5abf1f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229336415',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c61c7ba-36c3-556c-8b62-aff37c5abf1f/9c61c7ba-36c3-556c-8b62-aff37c5abf1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263669,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/12870878377247299cc68823dc6dd986.jpg',
             'Width': 2048}],
 'price': 20499,
 'price_includes_vat': True,
 'registration_date': '2022-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.0 TFSI 30 S line Sportback S Tronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229336415%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229336415: {'created_time': 1774523451.09832, 'last_price_update_time': 1774523451.098331}
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229336415') HTTP/1.1" 204 0
2026-03-26 11:10:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8947cbec-d0c7-5f35-8e27-6ca7eeea4f85 with identifier 202601239361779
2026-03-26 11:10:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8947cbec-d0c7-5f35-8e27-6ca7eeea4f85
2026-03-26 11:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/aba882f3e7a54ae7b18c3f1e4c8638ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Discover this 2021 Audi e-tron GT, a sophisticated electric '
                'vehicle offering an impressive new range of up to 296 miles. '
                'This four wheel drive model boasts a substantial 93 kWh '
                'battery, ensuring ample power for your journeys. Charging is '
                'convenient, with a full charge at home taking approximately '
                '14 hours using a 7kW charger, while rapid public charging can '
                'take you from empty to 80% in just 24 minutes.\n'
                '\n'
                'This e-tron GT comes equipped with the desirable Comfort and '
                'Sound Pack Plus, enhancing your driving experience with LED '
                'headlights and a 360 degree parking assistance camera. Stay '
                'comfortable in all conditions with automatic three zone '
                'climate control and enjoy the luxury of heated front  & '
                'Ventilated seats. The Audi Phone Box with wireless charging '
                'keeps your devices powered up and connected via Bluetooth. '
                'Furthermore, the glass roof is lovely to have! \n'
                '\n'
                'Call us now to learn more!',
 'doors_number': 4,
 'engine_horse_power': 469,
 'fuel_type': 'Electric',
 'id': '8947cbec-d0c7-5f35-8e27-6ca7eeea4f85',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601239361779',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'e-tron GT',
 'odometer': 39200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8947cbec-d0c7-5f35-8e27-6ca7eeea4f85/8947cbec-d0c7-5f35-8e27-6ca7eeea4f85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260341,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/aba882f3e7a54ae7b18c3f1e4c8638ea.jpg',
             'Width': 2048}],
 'price': 34999,
 'price_includes_vat': True,
 'registration_date': '2021-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi e-tron GT 93.4kWh Auto quattro 4dr',
 'transmission': 'automatic',
 'year': 2021}
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239361779%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601239361779: {'created_time': 1774523451.14494, 'last_price_update_time': 1774523451.14495}
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239361779') HTTP/1.1" 204 0
2026-03-26 11:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/562cc5539272484eb3291a29378495b6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6e0badc3c9894616bc0e148f085f832f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/47229866e320402bad22a747095bff56.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e22d6359ca9b41cc82ae838c3f08910b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51166a90>
2026-03-26 11:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0186867e-1d1a-55c6-b47b-ec3e6d044dbc/0186867e-1d1a-55c6-b47b-ec3e6d044dbc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd74d39ce534b4b24b0fb9af548c58852.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d74d39ce534b4b24b0fb9af548c58852.jpg saved to cache
2026-03-26 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0186867e-1d1a-55c6-b47b-ec3e6d044dbc
2026-03-26 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0186867e-1d1a-55c6-b47b-ec3e6d044dbc sending to next pipeline
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Page: 11/16, total results: 304
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601078973294%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601078973294: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601078973164%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601078973164: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601078971894%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601078971894: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601058923269%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601058923269: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601058923189%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601058923189: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601058921408%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601058921408: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512248790303%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512248790303: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512248789895%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512248789895: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512248789791%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512248789791: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763906%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512238763906: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763891%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512238763891: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763879%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512238763879: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763859%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512238763859: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763823%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512238763823: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178649372%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512178649372: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178647898%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512178647898: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178646977%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512178646977: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168616611%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512168616611: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168616264%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512168616264: 1
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168616001%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512168616001: 1
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6 with identifier: 202601209273033
2026-03-26 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff979a04950e04f8c87a72b37374d33e4.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f979a04950e04f8c87a72b37374d33e4.jpg not downloaded yet
2026-03-26 11:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51170290>
2026-03-26 11:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb866d26-54bb-5a31-82b6-c2850ab7e0a8/bb866d26-54bb-5a31-82b6-c2850ab7e0a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a8709dbf91d43d3a234344d376afadd.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a8709dbf91d43d3a234344d376afadd.jpg saved to cache
2026-03-26 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb866d26-54bb-5a31-82b6-c2850ab7e0a8
2026-03-26 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb866d26-54bb-5a31-82b6-c2850ab7e0a8 sending to next pipeline
2026-03-26 11:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ae96de9af5474f74be87bcba3990f1ad.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0186867e-1d1a-55c6-b47b-ec3e6d044dbc with identifier 202601269420950
2026-03-26 11:10:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0186867e-1d1a-55c6-b47b-ec3e6d044dbc
2026-03-26 11:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d74d39ce534b4b24b0fb9af548c58852.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'MINI SEVEN JUST IN WITH HEATED FRONT SEATS, 1/2 LEATHER '
                'SEATS, SATELLITE NAVIGATION, DAB RADIO, ALLOYS, CRUISE '
                'CONTROL, CLIMATE CONTROL AND SEVEN DECALS AND EXTRAS!\n'
                'CALL OUR SALES TEAM NOW FOR MORE INFORMATION OR POP IN TO '
                'VIEW!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '0186867e-1d1a-55c6-b47b-ec3e6d044dbc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269420950',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 48700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0186867e-1d1a-55c6-b47b-ec3e6d044dbc/0186867e-1d1a-55c6-b47b-ec3e6d044dbc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261657,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d74d39ce534b4b24b0fb9af548c58852.jpg',
             'Width': 2048}],
 'price': 9499,
 'price_includes_vat': True,
 'registration_date': '2017-09-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Hatch 1.5 Cooper Seven Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'Cooper Seven',
 'year': 2017}
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269420950%27 HTTP/1.1" 200 None
2026-03-26 11:10:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269420950: {'created_time': 1774523451.770012, 'last_price_update_time': 1774523451.770022}
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269420950') HTTP/1.1" 204 0
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bb866d26-54bb-5a31-82b6-c2850ab7e0a8 with identifier 202601229336284
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bb866d26-54bb-5a31-82b6-c2850ab7e0a8
2026-03-26 11:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9a8709dbf91d43d3a234344d376afadd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'GOOD CONDITION HYUNDAI I 10 WITH BLUETOOTH, DAB RADIO, AIR '
                'CONDITIONING, CRUISE CONTROL, ELECTRIC WINDOWS AND MIRRORS! '
                'GIVE US A CALL FOR MORE DETAILS OR POP IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 66,
 'fuel_type': 'Petrol',
 'id': 'bb866d26-54bb-5a31-82b6-c2850ab7e0a8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229336284',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 27400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb866d26-54bb-5a31-82b6-c2850ab7e0a8/bb866d26-54bb-5a31-82b6-c2850ab7e0a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257560,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9a8709dbf91d43d3a234344d376afadd.jpg',
             'Width': 2048}],
 'price': 9799,
 'price_includes_vat': True,
 'registration_date': '2023-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 SE Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2023}
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229336284%27 HTTP/1.1" 200 None
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229336284: {'created_time': 1774523452.281438, 'last_price_update_time': 1774523452.281447}
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229336284') HTTP/1.1" 204 0
2026-03-26 11:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a2e7d60af1d44b9999f8018acefe906a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c40ffb8c94a64f5094342613536c27cf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8847c3f9-b03f-5dd2-b30e-a0545e112912 with identifier: 202601209272803
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8847c3f9-b03f-5dd2-b30e-a0545e112912
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F75e66956a4f149f7a205ed76b2d25071.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/75e66956a4f149f7a205ed76b2d25071.jpg not downloaded yet
2026-03-26 11:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d6dd50>
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f12bb8-3bae-52db-99df-3e77a9adc8bb/78f12bb8-3bae-52db-99df-3e77a9adc8bb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F562cc5539272484eb3291a29378495b6.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/562cc5539272484eb3291a29378495b6.jpg saved to cache
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78f12bb8-3bae-52db-99df-3e77a9adc8bb
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78f12bb8-3bae-52db-99df-3e77a9adc8bb sending to next pipeline
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e05910>
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9291be7b-bd7b-500a-84f8-d545d4ea3677/9291be7b-bd7b-500a-84f8-d545d4ea3677_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6e0badc3c9894616bc0e148f085f832f.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6e0badc3c9894616bc0e148f085f832f.jpg saved to cache
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9291be7b-bd7b-500a-84f8-d545d4ea3677
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9291be7b-bd7b-500a-84f8-d545d4ea3677 sending to next pipeline
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e05cd0>
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9246a58a-0845-598c-ab5e-d32f7fa8567f/9246a58a-0845-598c-ab5e-d32f7fa8567f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F47229866e320402bad22a747095bff56.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/47229866e320402bad22a747095bff56.jpg saved to cache
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9246a58a-0845-598c-ab5e-d32f7fa8567f
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9246a58a-0845-598c-ab5e-d32f7fa8567f sending to next pipeline
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51481fd0>
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92365357-a99b-5bd7-a596-a20e12557f6f/92365357-a99b-5bd7-a596-a20e12557f6f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe22d6359ca9b41cc82ae838c3f08910b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e22d6359ca9b41cc82ae838c3f08910b.jpg saved to cache
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92365357-a99b-5bd7-a596-a20e12557f6f
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92365357-a99b-5bd7-a596-a20e12557f6f sending to next pipeline
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e55d98e-c73a-56a5-a221-1eb7c5877063 with identifier: 202601149133249
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9e55d98e-c73a-56a5-a221-1eb7c5877063
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2a635d8db9f4d39bab0c6d24f5e6774.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2a635d8db9f4d39bab0c6d24f5e6774.jpg not downloaded yet
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Getting next page: 12
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 12
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:52 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c196aa-9bb2-5102-a54e-50e6b5032442 with identifier: 202601209272003
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6c196aa-9bb2-5102-a54e-50e6b5032442
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa4a69c1aa6f422aa644fcb9e222e41b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa4a69c1aa6f422aa644fcb9e222e41b.jpg not downloaded yet
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 78f12bb8-3bae-52db-99df-3e77a9adc8bb with identifier 202602179995193
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 78f12bb8-3bae-52db-99df-3e77a9adc8bb
2026-03-26 11:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/562cc5539272484eb3291a29378495b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2023 Nissan Qashqai DIG-T Acenta Premium is a fantastic '
                'example of a modern family car, boasting a fuel efficient 1.3 '
                'litre petrol hybrid engine and meeting Euro 6 emissions '
                'standards.  This particular model comes with the Acenta '
                'Premium trim, offering a comfortable and connected driving '
                "experience. You'll appreciate the convenience of Bluetooth "
                'with Audio Streaming, allowing seamless music playback and '
                'handsfree calls. Parking is made easier with rear parking '
                'sensors, and the automatic dual zone climate control with '
                'pollen filter ensures a pleasant cabin environment for all '
                'occupants.  For smartphone integration, it features wired '
                'Android Auto and wired Apple CarPlay, keeping your essential '
                'apps accessible on the go.\n'
                'For more details please call our sales team or come in to '
                'view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol Hybrid',
 'id': '78f12bb8-3bae-52db-99df-3e77a9adc8bb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179995193',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 26500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78f12bb8-3bae-52db-99df-3e77a9adc8bb/78f12bb8-3bae-52db-99df-3e77a9adc8bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268292,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/562cc5539272484eb3291a29378495b6.jpg',
             'Width': 2048}],
 'price': 14499,
 'price_includes_vat': True,
 'registration_date': '2023-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T MHEV Acenta Premium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Acenta Premium',
 'year': 2023}
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179995193%27 HTTP/1.1" 200 None
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179995193: {'created_time': 1774523452.768825, 'last_price_update_time': 1774523452.768833}
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179995193') HTTP/1.1" 204 0
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9291be7b-bd7b-500a-84f8-d545d4ea3677 with identifier 202602179995062
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9291be7b-bd7b-500a-84f8-d545d4ea3677
2026-03-26 11:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6e0badc3c9894616bc0e148f085f832f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2022 Nissan Qashqai DIG-T N-Connecta is a superb example '
                'of this popular family car, boasting a fuel efficient 1.3L '
                'Petrol Hybrid engine and meeting Euro 6 emission standards.  '
                'It comes equipped with the convenience of Intelligent Key '
                'with keyless entry, allowing you to unlock and start the car '
                'with ease.  Stay connected and entertained with seamless '
                'integration for both Android Auto and Wireless Apple CarPlay, '
                'while the Intelligent Auto Headlights ensure optimal '
                'visibility without you needing to lift a finger.\n'
                'Call us now for more information or please come in and view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol Hybrid',
 'id': '9291be7b-bd7b-500a-84f8-d545d4ea3677',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179995062',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 67900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9291be7b-bd7b-500a-84f8-d545d4ea3677/9291be7b-bd7b-500a-84f8-d545d4ea3677_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 292691,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6e0badc3c9894616bc0e148f085f832f.jpg',
             'Width': 2048}],
 'price': 12499,
 'price_includes_vat': True,
 'registration_date': '2022-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T MHEV N-Connecta Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2022}
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179995062%27 HTTP/1.1" 200 None
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179995062: {'created_time': 1774523452.8242, 'last_price_update_time': 1774523452.824212}
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179995062') HTTP/1.1" 204 0
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9246a58a-0845-598c-ab5e-d32f7fa8567f with identifier 202602179994934
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9246a58a-0845-598c-ab5e-d32f7fa8567f
2026-03-26 11:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/47229866e320402bad22a747095bff56.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GREAT CONDITION VW TIGUAN WITH HUGE 20”ALLOY WHEELS, PARK '
                'ASSIST, KEYLESS ENTRY, ADAPTIVE CRUISE CONTROL, HEATED FRONT '
                'SEATS, HEATED STEERING WHEEL, NAVIGATION SYSTEM AND '
                'SMARTPHONE PROJECTION VOA APPLE CAR PLAY AND ANDROID AUTO! '
                'CALL NOW TO LEARN MORE',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '9246a58a-0845-598c-ab5e-d32f7fa8567f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179994934',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 38000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9246a58a-0845-598c-ab5e-d32f7fa8567f/9246a58a-0845-598c-ab5e-d32f7fa8567f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282069,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/47229866e320402bad22a747095bff56.jpg',
             'Width': 2048}],
 'price': 24799,
 'price_includes_vat': True,
 'registration_date': '2023-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI R-Line DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179994934%27 HTTP/1.1" 200 None
2026-03-26 11:10:52 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179994934: {'created_time': 1774523452.969305, 'last_price_update_time': 1774523452.969317}
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179994934') HTTP/1.1" 204 0
2026-03-26 11:10:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 92365357-a99b-5bd7-a596-a20e12557f6f with identifier 202601229335730
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 92365357-a99b-5bd7-a596-a20e12557f6f
2026-03-26 11:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e22d6359ca9b41cc82ae838c3f08910b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'MINI COOPER CLASSIC WITH LEATHER STEERING WHEEL, 16” BLACK '
                'VICTORY SPOKE ALLOYS, HEATED FRONT WINDSCREEN, CRUISE CONTROL '
                'AND  AIR CONDITIONING! THIS VEHICLE IS NICE TO DRIVE AND '
                'AVAILABLE NOW TO VIEW! CALL FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '92365357-a99b-5bd7-a596-a20e12557f6f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229335730',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 31100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92365357-a99b-5bd7-a596-a20e12557f6f/92365357-a99b-5bd7-a596-a20e12557f6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261783,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e22d6359ca9b41cc82ae838c3f08910b.jpg',
             'Width': 2048}],
 'price': 12299,
 'price_includes_vat': True,
 'registration_date': '2019-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Hatch 1.5 Cooper Classic Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Cooper Classic',
 'year': 2019}
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229335730%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229335730: {'created_time': 1774523453.017197, 'last_price_update_time': 1774523453.017205}
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229335730') HTTP/1.1" 204 0
2026-03-26 11:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b9e7253ceeae4b39be5498ac53cada89.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 23dd2ae7-cd3c-5122-9105-ce3266b3347a with identifier: 202601149132719
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 23dd2ae7-cd3c-5122-9105-ce3266b3347a
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe3a41ed813ab40798f913996c32feea7.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e3a41ed813ab40798f913996c32feea7.jpg not downloaded yet
2026-03-26 11:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e7f350>
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e741c87-030b-58c3-863c-e192d8b1b13b/8e741c87-030b-58c3-863c-e192d8b1b13b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fae96de9af5474f74be87bcba3990f1ad.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ae96de9af5474f74be87bcba3990f1ad.jpg saved to cache
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e741c87-030b-58c3-863c-e192d8b1b13b
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e741c87-030b-58c3-863c-e192d8b1b13b sending to next pipeline
2026-03-26 11:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8a734183ae80446eb0e9182f96b73320.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/df0eff7231594ae1af40934c4c54d9ee.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c249c2e3cdcd4b89a0249e98fba5a3b5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 542ed611-c5bd-5a08-b17e-0912662de5d6 with identifier: 202601199245213
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 542ed611-c5bd-5a08-b17e-0912662de5d6
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd6861e54c80e4585b088c5b9973e4e9d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d6861e54c80e4585b088c5b9973e4e9d.jpg not downloaded yet
2026-03-26 11:10:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8e741c87-030b-58c3-863c-e192d8b1b13b with identifier 202601229335566
2026-03-26 11:10:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8e741c87-030b-58c3-863c-e192d8b1b13b
2026-03-26 11:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ae96de9af5474f74be87bcba3990f1ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'GOOD CONDITION TESLA MODEL 3 WITH 19”SILVER ALLOY WHEELS, '
                'PANORAMIC ROOF, LEATHER UPHOLSTERY, HEATED FRONT AND REAR '
                'SEATS, NAVIGATION, GAMES, CAMERAS AND MORE NOW AVAILABLE! '
                'PLEASE GIVE US A CALL TO LEARN MORE!',
 'doors_number': 4,
 'engine_horse_power': 341,
 'fuel_type': 'Electric',
 'id': '8e741c87-030b-58c3-863c-e192d8b1b13b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229335566',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 32500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e741c87-030b-58c3-863c-e192d8b1b13b/8e741c87-030b-58c3-863c-e192d8b1b13b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244593,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ae96de9af5474f74be87bcba3990f1ad.jpg',
             'Width': 2048}],
 'price': 19499,
 'price_includes_vat': True,
 'registration_date': '2021-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 (Dual Motor) Long Range Auto 4WDE 4dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2021}
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229335566%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229335566: {'created_time': 1774523453.151402, 'last_price_update_time': 1774523453.151413}
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229335566') HTTP/1.1" 204 0
2026-03-26 11:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/71e3b0273b524193807783cc7b57d1b3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: adbd81a0-2521-56b6-b1e4-fadde2477507 with identifier: 202601149132505
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item adbd81a0-2521-56b6-b1e4-fadde2477507
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4abb00deba1c42ceb6d367d85ff9a5f1.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4abb00deba1c42ceb6d367d85ff9a5f1.jpg not downloaded yet
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f708d0>
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9dfd200-28e7-58a6-ad91-e28e15e63e9f/e9dfd200-28e7-58a6-ad91-e28e15e63e9f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2e7d60af1d44b9999f8018acefe906a.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2e7d60af1d44b9999f8018acefe906a.jpg saved to cache
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9dfd200-28e7-58a6-ad91-e28e15e63e9f
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9dfd200-28e7-58a6-ad91-e28e15e63e9f sending to next pipeline
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f75550>
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a25bf638-0cca-5558-8a47-f4e407ca9f4b/a25bf638-0cca-5558-8a47-f4e407ca9f4b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc40ffb8c94a64f5094342613536c27cf.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c40ffb8c94a64f5094342613536c27cf.jpg saved to cache
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a25bf638-0cca-5558-8a47-f4e407ca9f4b
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a25bf638-0cca-5558-8a47-f4e407ca9f4b sending to next pipeline
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 83150fce-b50f-5e77-9ab9-e9eee1791f41 with identifier: 202601199244526
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 83150fce-b50f-5e77-9ab9-e9eee1791f41
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8bf564f08c914160a9a6b8158ababb87.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8bf564f08c914160a9a6b8158ababb87.jpg not downloaded yet
2026-03-26 11:10:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e9dfd200-28e7-58a6-ad91-e28e15e63e9f with identifier 202602169957081
2026-03-26 11:10:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e9dfd200-28e7-58a6-ad91-e28e15e63e9f
2026-03-26 11:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a2e7d60af1d44b9999f8018acefe906a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2017 Volkswagen Golf TSI EVO GT presents an exceptional '
                'opportunity with its lower than average mileage. It comes '
                'with many features including Winter Pack with heated seats, '
                'an opening panoramic sunroof, 17 inch alloys, Car Net App '
                'Connect system, compatible with both Android Auto and Apple '
                'CarPlay. \n'
                '\n'
                'Call, email or pop in to see us today!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': 'e9dfd200-28e7-58a6-ad91-e28e15e63e9f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169957081',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 45800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9dfd200-28e7-58a6-ad91-e28e15e63e9f/e9dfd200-28e7-58a6-ad91-e28e15e63e9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296631,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2e7d60af1d44b9999f8018acefe906a.jpg',
             'Width': 2048}],
 'price': 13799,
 'price_includes_vat': True,
 'registration_date': '2017-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.5 TSI EVO GT DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169957081%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169957081: {'created_time': 1774523453.454717, 'last_price_update_time': 1774523453.454732}
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169957081') HTTP/1.1" 204 0
2026-03-26 11:10:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a25bf638-0cca-5558-8a47-f4e407ca9f4b with identifier 202601229337488
2026-03-26 11:10:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a25bf638-0cca-5558-8a47-f4e407ca9f4b
2026-03-26 11:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c40ffb8c94a64f5094342613536c27cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'RANGEROVER SPORT WITH HUGE WHEELS, POWER TAILGATE, PARKING '
                'SENSORS, REAR CAMERA, FULL LEATHER UPHOLSTERY, HEATED FRONT '
                'AND REAR SEATS, HEATED STEERING WHEEL AND MUCH MORE! CALL US '
                'NOW FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 302,
 'fuel_type': 'Diesel',
 'id': 'a25bf638-0cca-5558-8a47-f4e407ca9f4b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229337488',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 35000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a25bf638-0cca-5558-8a47-f4e407ca9f4b/a25bf638-0cca-5558-8a47-f4e407ca9f4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257506,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c40ffb8c94a64f5094342613536c27cf.jpg',
             'Width': 2048}],
 'price': 32499,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE Auto 4WD Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2019}
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229337488%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229337488: {'created_time': 1774523453.507067, 'last_price_update_time': 1774523453.507078}
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229337488') HTTP/1.1" 204 0
2026-03-26 11:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c0e40daf763042b7b2ceeeaf09ab7a01.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8c10ba6c16e840519eaacfbf3cc8af6c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d18034e-cc28-553d-a702-2e19b0af30d7 with identifier: 202601149132376
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7d18034e-cc28-553d-a702-2e19b0af30d7
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa512dec15d149c2b4bed43685b1a2ca.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa512dec15d149c2b4bed43685b1a2ca.jpg not downloaded yet
2026-03-26 11:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/996ec121a89042dc9cec725fb8966d1e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:53 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe31dc7-692d-5258-b584-b8cb321f88e5 with identifier: 202601169206434
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8fe31dc7-692d-5258-b584-b8cb321f88e5
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb79041547434a2d87ca2474bbef9067.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db79041547434a2d87ca2474bbef9067.jpg not downloaded yet
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d9fb10>
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98e53230-c521-5abf-8295-73cb2fefcb68/98e53230-c521-5abf-8295-73cb2fefcb68_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9e7253ceeae4b39be5498ac53cada89.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9e7253ceeae4b39be5498ac53cada89.jpg saved to cache
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98e53230-c521-5abf-8295-73cb2fefcb68
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98e53230-c521-5abf-8295-73cb2fefcb68 sending to next pipeline
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51df17d0>
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e637b860-9666-52de-9cc7-6e24bbe8dfd6/e637b860-9666-52de-9cc7-6e24bbe8dfd6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8a734183ae80446eb0e9182f96b73320.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8a734183ae80446eb0e9182f96b73320.jpg saved to cache
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e637b860-9666-52de-9cc7-6e24bbe8dfd6
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e637b860-9666-52de-9cc7-6e24bbe8dfd6 sending to next pipeline
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5110b3d0>
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc20cc13-b066-5cf7-a322-4a83052dbe68/bc20cc13-b066-5cf7-a322-4a83052dbe68_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf0eff7231594ae1af40934c4c54d9ee.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df0eff7231594ae1af40934c4c54d9ee.jpg saved to cache
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc20cc13-b066-5cf7-a322-4a83052dbe68
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc20cc13-b066-5cf7-a322-4a83052dbe68 sending to next pipeline
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121e410>
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72be56a0-7214-5188-8ae6-89b97355b39e/72be56a0-7214-5188-8ae6-89b97355b39e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc249c2e3cdcd4b89a0249e98fba5a3b5.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c249c2e3cdcd4b89a0249e98fba5a3b5.jpg saved to cache
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72be56a0-7214-5188-8ae6-89b97355b39e
2026-03-26 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72be56a0-7214-5188-8ae6-89b97355b39e sending to next pipeline
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512c7350>
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e288a04-7964-58d6-b57c-3023dbab1420/7e288a04-7964-58d6-b57c-3023dbab1420_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71e3b0273b524193807783cc7b57d1b3.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71e3b0273b524193807783cc7b57d1b3.jpg saved to cache
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e288a04-7964-58d6-b57c-3023dbab1420
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e288a04-7964-58d6-b57c-3023dbab1420 sending to next pipeline
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3868f20b-2808-5499-8f4d-648ff8a1f7e3 with identifier: 202601149132128
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3868f20b-2808-5499-8f4d-648ff8a1f7e3
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2db06fcc6ae34ef9b5bc09c9d49670a5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2db06fcc6ae34ef9b5bc09c9d49670a5.jpg not downloaded yet
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 98e53230-c521-5abf-8295-73cb2fefcb68 with identifier 202601229337342
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 98e53230-c521-5abf-8295-73cb2fefcb68
2026-03-26 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b9e7253ceeae4b39be5498ac53cada89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'LOW MILEAGE AND GOOD CONDITION BMW I3 WHICH COMES WITH '
                '20”ALLOY WHEELS, AIR CONDITIONING, CRUISE CONTROL, NAVIGATION '
                'SYSTEM, DAB RADIO, APPLE CAR PLAY AND HEATED FRONT SEATS! '
                'CALL OUR SALES TEAM NOW TO BOOK YOUR APPOINTMENT!',
 'doors_number': 5,
 'engine_horse_power': 181,
 'fuel_type': 'Electric',
 'id': '98e53230-c521-5abf-8295-73cb2fefcb68',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229337342',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'i3',
 'odometer': 26400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98e53230-c521-5abf-8295-73cb2fefcb68/98e53230-c521-5abf-8295-73cb2fefcb68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251596,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9e7253ceeae4b39be5498ac53cada89.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2022-01-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW i3 42.2kWh S Auto 5dr',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2022}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229337342%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229337342: {'created_time': 1774523454.081133, 'last_price_update_time': 1774523454.081141}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229337342') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e637b860-9666-52de-9cc7-6e24bbe8dfd6 with identifier 202602169956773
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e637b860-9666-52de-9cc7-6e24bbe8dfd6
2026-03-26 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8a734183ae80446eb0e9182f96b73320.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2020 BMW M4 BiTurbo Competition is a standout example, '
                'offering plenty of extra features such as 20 inch alloy '
                'wheels in style 666M, Comfort Access, Apple CarPlay '
                'Preparation, heated steering wheel  and front seats, '
                'Reversing Assist Camera, M Head Up Display, Harman/Kardon '
                'audio system, extended merino leather in Silverstone '
                'providing a striking contrast to the all black exterior. \n'
                '\n'
                'Contact us for more information or to arrange a viewing and '
                'test drive.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 444,
 'fuel_type': 'Petrol',
 'id': 'e637b860-9666-52de-9cc7-6e24bbe8dfd6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169956773',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'M4',
 'odometer': 38100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e637b860-9666-52de-9cc7-6e24bbe8dfd6/e637b860-9666-52de-9cc7-6e24bbe8dfd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269778,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8a734183ae80446eb0e9182f96b73320.jpg',
             'Width': 2048}],
 'price': 34999,
 'price_includes_vat': True,
 'registration_date': '2020-06-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW M4 3.0 BiTurbo Competition DCT Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2020}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169956773%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169956773: {'created_time': 1774523454.151736, 'last_price_update_time': 1774523454.151748}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169956773') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bc20cc13-b066-5cf7-a322-4a83052dbe68 with identifier 202602169956982
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bc20cc13-b066-5cf7-a322-4a83052dbe68
2026-03-26 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/df0eff7231594ae1af40934c4c54d9ee.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 Vauxhall Corsa Turbo Elite Nav Premium comes with '
                'Smartphone Interface compatible with both Android Auto and '
                'Apple CarPlay, keyless entry and start front and rear parking '
                'distance sensors, rear view camera, front heated seats, '
                'heated steering wheel, cruise control and air conditioning.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': 'bc20cc13-b066-5cf7-a322-4a83052dbe68',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169956982',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 52800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc20cc13-b066-5cf7-a322-4a83052dbe68/bc20cc13-b066-5cf7-a322-4a83052dbe68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 274506,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/df0eff7231594ae1af40934c4c54d9ee.jpg',
             'Width': 2048}],
 'price': 10199,
 'price_includes_vat': True,
 'registration_date': '2021-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 Turbo Elite Nav Premium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Elite Nav Premium',
 'year': 2021}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169956982%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169956982: {'created_time': 1774523454.197136, 'last_price_update_time': 1774523454.197143}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169956982') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 72be56a0-7214-5188-8ae6-89b97355b39e with identifier 202601209273093
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 72be56a0-7214-5188-8ae6-89b97355b39e
2026-03-26 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c249c2e3cdcd4b89a0249e98fba5a3b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'LOVELY WHITE TESLA MODEL 3 PERFORMANCE JUST IN WITH FULL '
                'BLACK LEATHER INTERIOR, HEATED FRONT AND REAR SEATS, '
                'PANORAMIC ROOF, PARKING CAMERAS, GAMES AND MUCH MORE! THIS '
                'VEHICLE IS IN GREAT CONDITION AND IS AVAILABLE NOW FOR '
                'VIEWING! CALL OUR SALES TEAM TO LEARN MORE!',
 'doors_number': 4,
 'engine_horse_power': 449,
 'fuel_type': 'Electric',
 'id': '72be56a0-7214-5188-8ae6-89b97355b39e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601209273093',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 27700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72be56a0-7214-5188-8ae6-89b97355b39e/72be56a0-7214-5188-8ae6-89b97355b39e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270084,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c249c2e3cdcd4b89a0249e98fba5a3b5.jpg',
             'Width': 2048}],
 'price': 26599,
 'price_includes_vat': True,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 (Dual Motor) Performance Auto 4WDE 4dr (Performance '
          'Upgrade)',
 'transmission': 'automatic',
 'trim': 'Performance',
 'year': 2023}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209273093%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601209273093: {'created_time': 1774523454.241741, 'last_price_update_time': 1774523454.24175}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601209273093') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7e288a04-7964-58d6-b57c-3023dbab1420 with identifier 202602169954217
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7e288a04-7964-58d6-b57c-3023dbab1420
2026-03-26 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/71e3b0273b524193807783cc7b57d1b3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'HUGE SPEC BMW 520D WITH ELECTRIC PANORAMIC SUNROOF, HARMAN '
                'KARDON SPEAKERS, 19”ALLOYS WHEELS, FULL DAKOTA LEATHER, '
                'HEATED FRONT SEATS THE M-SPORT PLUS PACK, POWER TAILGATE, '
                'REAR CAMERA AND A-LOT MORE! CALL OUR SALES TEAM NOW FOR MORE '
                'INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': '7e288a04-7964-58d6-b57c-3023dbab1420',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169954217',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '5 Series',
 'odometer': 61900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e288a04-7964-58d6-b57c-3023dbab1420/7e288a04-7964-58d6-b57c-3023dbab1420_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278244,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/71e3b0273b524193807783cc7b57d1b3.jpg',
             'Width': 2048}],
 'price': 19999,
 'price_includes_vat': True,
 'registration_date': '2017-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 Series 2.0 520d M Sport Touring Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169954217%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169954217: {'created_time': 1774523454.296097, 'last_price_update_time': 1774523454.296116}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169954217') HTTP/1.1" 204 0
2026-03-26 11:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f979a04950e04f8c87a72b37374d33e4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a2a635d8db9f4d39bab0c6d24f5e6774.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ace9c5c-29b2-5952-9f85-be3d940de3d1 with identifier: 202601169202676
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6ace9c5c-29b2-5952-9f85-be3d940de3d1
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00d22154e92d423e961918389598a640.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00d22154e92d423e961918389598a640.jpg not downloaded yet
2026-03-26 11:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/75e66956a4f149f7a205ed76b2d25071.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 47557092-b6e7-572d-9f81-238222e34a5e with identifier: 202601149131737
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 47557092-b6e7-572d-9f81-238222e34a5e
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F240d77f7995f4351b76d96028d0c12f2.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/240d77f7995f4351b76d96028d0c12f2.jpg not downloaded yet
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c511e9010>
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_770983dd-4c08-54dc-a16f-86f285df627f/770983dd-4c08-54dc-a16f-86f285df627f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0e40daf763042b7b2ceeeaf09ab7a01.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0e40daf763042b7b2ceeeaf09ab7a01.jpg saved to cache
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 770983dd-4c08-54dc-a16f-86f285df627f
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 770983dd-4c08-54dc-a16f-86f285df627f sending to next pipeline
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5108ed50>
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e65b269-3904-53e7-a244-de3bdf1441a8/4e65b269-3904-53e7-a244-de3bdf1441a8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8c10ba6c16e840519eaacfbf3cc8af6c.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8c10ba6c16e840519eaacfbf3cc8af6c.jpg saved to cache
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e65b269-3904-53e7-a244-de3bdf1441a8
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e65b269-3904-53e7-a244-de3bdf1441a8 sending to next pipeline
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51da29d0>
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14796989-1dbd-5fbc-9547-a1436ce2d967/14796989-1dbd-5fbc-9547-a1436ce2d967_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F996ec121a89042dc9cec725fb8966d1e.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/996ec121a89042dc9cec725fb8966d1e.jpg saved to cache
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14796989-1dbd-5fbc-9547-a1436ce2d967
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14796989-1dbd-5fbc-9547-a1436ce2d967 sending to next pipeline
2026-03-26 11:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fa4a69c1aa6f422aa644fcb9e222e41b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 00eb66d5-4d19-5ca4-ac50-72b282c606a2 with identifier: 202601159156949
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 00eb66d5-4d19-5ca4-ac50-72b282c606a2
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf18aac1deab492099d5576f292a7b49.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df18aac1deab492099d5576f292a7b49.jpg not downloaded yet
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 770983dd-4c08-54dc-a16f-86f285df627f with identifier 202601209277972
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 770983dd-4c08-54dc-a16f-86f285df627f
2026-03-26 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c0e40daf763042b7b2ceeeaf09ab7a01.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': '770983dd-4c08-54dc-a16f-86f285df627f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601209277972',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 44900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_770983dd-4c08-54dc-a16f-86f285df627f/770983dd-4c08-54dc-a16f-86f285df627f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267528,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c0e40daf763042b7b2ceeeaf09ab7a01.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2021-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Niro 64kWh 4+ Auto 5dr',
 'transmission': 'automatic',
 'trim': '4+',
 'year': 2021}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209277972%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601209277972: {'created_time': 1774523454.597819, 'last_price_update_time': 1774523454.59783}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601209277972') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4e65b269-3904-53e7-a244-de3bdf1441a8 with identifier 202601229337682
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4e65b269-3904-53e7-a244-de3bdf1441a8
2026-03-26 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8c10ba6c16e840519eaacfbf3cc8af6c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'WESTMINSTER RANGE ROVER D300 NOW AVAILABLE TO VIEW! THIS '
                'VEHICLE IS IN EXCELLENT CONDITION AND FEATURES SO MANY '
                'COMFORTS, INCLUDING HEATED FRONT AND REAR OUTER SEATS, HEATED '
                'STEERING WHEEL, FULL LEATHER UPHOLSTERY, KEYLESS ENTRY, '
                'DEPLOYABLE SIDE STEPS, SLIDING PANORAMIC GLASS SUNROOF, REAR '
                'CAMERA, NAVIGATION, SMARTPHONE PROJECTION, TV AND MUCH MORE! '
                'CALL OUR SALES TEAM NOW FOR MORE DETAILS OR COME IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': '4e65b269-3904-53e7-a244-de3bdf1441a8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229337682',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 36500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e65b269-3904-53e7-a244-de3bdf1441a8/4e65b269-3904-53e7-a244-de3bdf1441a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226538,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8c10ba6c16e840519eaacfbf3cc8af6c.jpg',
             'Width': 2048}],
 'price': 44999,
 'price_includes_vat': True,
 'registration_date': '2021-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover 3.0 D300 MHEV Westminster Black Auto 4WD '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Westminster Black',
 'year': 2021}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229337682%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229337682: {'created_time': 1774523454.644844, 'last_price_update_time': 1774523454.644855}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229337682') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 14796989-1dbd-5fbc-9547-a1436ce2d967 with identifier 202601229335898
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 14796989-1dbd-5fbc-9547-a1436ce2d967
2026-03-26 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/996ec121a89042dc9cec725fb8966d1e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'SPORTY CUPRA FORMENTOR NOW AVAILABLE WITH PETROL BLUE NAPPA '
                'LEATHER SEATS, HEATED FRONT SEATS, HEATED STEERING WHEEL, '
                '19”ALLOYS, NAVIGATION SYSTEM, PARKING CAMERA AND SMARTPHONE '
                'PROJECTION VIA APPLE CAR PLAY! CALL US NOW FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '14796989-1dbd-5fbc-9547-a1436ce2d967',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229335898',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'CUPRA',
 'model': 'Formentor',
 'odometer': 67600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14796989-1dbd-5fbc-9547-a1436ce2d967/14796989-1dbd-5fbc-9547-a1436ce2d967_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266210,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/996ec121a89042dc9cec725fb8966d1e.jpg',
             'Width': 2048}],
 'price': 16299,
 'price_includes_vat': True,
 'registration_date': '2021-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA Formentor 1.5 TSI V2 Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'V2',
 'year': 2021}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229335898%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229335898: {'created_time': 1774523454.689775, 'last_price_update_time': 1774523454.689781}
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229335898') HTTP/1.1" 204 0
2026-03-26 11:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e3a41ed813ab40798f913996c32feea7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c27edde-bd06-5ceb-956e-fa49abbdb957 with identifier: 202601149131511
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7c27edde-bd06-5ceb-956e-fa49abbdb957
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a576a89722e422b94601cfac99fe4fa.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a576a89722e422b94601cfac99fe4fa.jpg not downloaded yet
2026-03-26 11:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d6861e54c80e4585b088c5b9973e4e9d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:54 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2489a356-0778-5f13-9796-190187291623 with identifier: 202601149134060
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2489a356-0778-5f13-9796-190187291623
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01115d2c90594095875dc0471c4f820b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01115d2c90594095875dc0471c4f820b.jpg not downloaded yet
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58dcce50>
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6/c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff979a04950e04f8c87a72b37374d33e4.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f979a04950e04f8c87a72b37374d33e4.jpg saved to cache
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6 sending to next pipeline
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514cba50>
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e55d98e-c73a-56a5-a221-1eb7c5877063/9e55d98e-c73a-56a5-a221-1eb7c5877063_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2a635d8db9f4d39bab0c6d24f5e6774.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2a635d8db9f4d39bab0c6d24f5e6774.jpg saved to cache
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e55d98e-c73a-56a5-a221-1eb7c5877063
2026-03-26 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e55d98e-c73a-56a5-a221-1eb7c5877063 sending to next pipeline
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e00310>
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8847c3f9-b03f-5dd2-b30e-a0545e112912/8847c3f9-b03f-5dd2-b30e-a0545e112912_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F75e66956a4f149f7a205ed76b2d25071.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/75e66956a4f149f7a205ed76b2d25071.jpg saved to cache
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8847c3f9-b03f-5dd2-b30e-a0545e112912
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8847c3f9-b03f-5dd2-b30e-a0545e112912 sending to next pipeline
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:55 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 063755d2-c1c8-55bd-9c22-a70ed2f38d21 with identifier: 202601149131216
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 063755d2-c1c8-55bd-9c22-a70ed2f38d21
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b66547b07704a5792100203d1499319.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b66547b07704a5792100203d1499319.jpg not downloaded yet
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6 with identifier 202601209273033
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f979a04950e04f8c87a72b37374d33e4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'NISSAN MICRA WITH REAR PARKING SENSORS, KEYLESS ENTRY, '
                'PRIVACY GLASS AND A 360 PARKING CAMERA NOW AVAILABLE! INSIDE '
                'IT COMES WITH AIR CONDITIONING, CRUISE CONTROL AND A '
                'TOUCHSCREEN MEDIA SYSTEM WITH NAV, DAB AND SMARTPHONE '
                'PROJECTION! CALL US FOR FURTHER DETAILS',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 91,
 'fuel_type': 'Petrol',
 'id': 'c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601209273033',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 36400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6/c2f2d33f-dab2-51b0-b7bb-f1a73f5e62d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266772,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f979a04950e04f8c87a72b37374d33e4.jpg',
             'Width': 2048}],
 'price': 10799,
 'price_includes_vat': True,
 'registration_date': '2022-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.0 IG-T Tekna Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2022}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209273033%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601209273033: {'created_time': 1774523455.051024, 'last_price_update_time': 1774523455.051033}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601209273033') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9e55d98e-c73a-56a5-a221-1eb7c5877063 with identifier 202601149133249
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9e55d98e-c73a-56a5-a221-1eb7c5877063
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a2a635d8db9f4d39bab0c6d24f5e6774.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2020 Abarth 595 T-Jet Trofeo offers a compelling blend '
                "of performance and modern technology. Inside, you'll find a "
                '7in touchscreen radio complete with Bluetooth connectivity, '
                'USB port, and DAB digital radio, seamlessly integrating your '
                'smartphone experience through Apple CarPlay and Android Auto '
                'plus upgrade 17 inch alloys! \n'
                '\n'
                'Contact our friendly sales team for more information.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 160,
 'fuel_type': 'Petrol',
 'id': '9e55d98e-c73a-56a5-a221-1eb7c5877063',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149133249',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Abarth',
 'model': '595',
 'odometer': 28900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 45,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e55d98e-c73a-56a5-a221-1eb7c5877063/9e55d98e-c73a-56a5-a221-1eb7c5877063_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254552,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2a635d8db9f4d39bab0c6d24f5e6774.jpg',
             'Width': 2048}],
 'price': 11799,
 'price_includes_vat': True,
 'registration_date': '2020-08-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 595 1.4 T-Jet Trofeo Euro 6 3dr',
 'transmission': 'manual',
 'trim': 'Trofeo',
 'year': 2020}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149133249%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149133249: {'created_time': 1774523455.099157, 'last_price_update_time': 1774523455.099165}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149133249') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8847c3f9-b03f-5dd2-b30e-a0545e112912 with identifier 202601209272803
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8847c3f9-b03f-5dd2-b30e-a0545e112912
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/75e66956a4f149f7a205ed76b2d25071.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Hyundai i30 T GDi N Line comes equipped with a '
                'useful rear camera and guidance system for easier parking, '
                'smart key system,  plus seamless integration with your '
                'smartphone through Android Auto and Apple CarPlay.\n'
                '\n'
                'Contact our friendly sales team for more information.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 157,
 'fuel_type': 'Petrol Hybrid',
 'id': '8847c3f9-b03f-5dd2-b30e-a0545e112912',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601209272803',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 49800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8847c3f9-b03f-5dd2-b30e-a0545e112912/8847c3f9-b03f-5dd2-b30e-a0545e112912_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268564,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/75e66956a4f149f7a205ed76b2d25071.jpg',
             'Width': 2048}],
 'price': 14699,
 'price_includes_vat': True,
 'registration_date': '2023-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.5 T-GDi MHEV N Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'N Line',
 'year': 2023}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209272803%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601209272803: {'created_time': 1774523455.147577, 'last_price_update_time': 1774523455.147586}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601209272803') HTTP/1.1" 204 0
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512c7b50>
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c196aa-9bb2-5102-a54e-50e6b5032442/e6c196aa-9bb2-5102-a54e-50e6b5032442_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa4a69c1aa6f422aa644fcb9e222e41b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa4a69c1aa6f422aa644fcb9e222e41b.jpg saved to cache
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6c196aa-9bb2-5102-a54e-50e6b5032442
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6c196aa-9bb2-5102-a54e-50e6b5032442 sending to next pipeline
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8bf564f08c914160a9a6b8158ababb87.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4abb00deba1c42ceb6d367d85ff9a5f1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fa512dec15d149c2b4bed43685b1a2ca.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:55 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d50546-d6b0-5486-8c0d-32f85a0b1f5c with identifier: 202601149133935
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 33d50546-d6b0-5486-8c0d-32f85a0b1f5c
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F253366d7efbb4a45ad56f03e579da128.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/253366d7efbb4a45ad56f03e579da128.jpg not downloaded yet
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e6c196aa-9bb2-5102-a54e-50e6b5032442 with identifier 202601209272003
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e6c196aa-9bb2-5102-a54e-50e6b5032442
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fa4a69c1aa6f422aa644fcb9e222e41b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2019 Mercedes Benz E Class E220d AMG Line comes equipped '
                'with a helpful reversing camera, heated front seats, '
                'automatic 2-zone climate control, cruise control and '
                'satellite navigation.\n'
                '\n'
                'Contact us for more information!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 191,
 'fuel_type': 'Diesel',
 'id': 'e6c196aa-9bb2-5102-a54e-50e6b5032442',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601209272003',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'E Class',
 'odometer': 62400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c196aa-9bb2-5102-a54e-50e6b5032442/e6c196aa-9bb2-5102-a54e-50e6b5032442_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268557,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa4a69c1aa6f422aa644fcb9e222e41b.jpg',
             'Width': 2048}],
 'price': 19299,
 'price_includes_vat': True,
 'registration_date': '2019-09-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E Class 2.0 E220d AMG Line G-Tronic+ Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209272003%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601209272003: {'created_time': 1774523455.271364, 'last_price_update_time': 1774523455.271371}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601209272003') HTTP/1.1" 204 0
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/db79041547434a2d87ca2474bbef9067.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:55 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 31132a73-3e33-5cf9-8f84-9c2476ee41e7 with identifier: 202601149130990
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 31132a73-3e33-5cf9-8f84-9c2476ee41e7
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d28a458f65c443e8cc1b1c391e23161.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d28a458f65c443e8cc1b1c391e23161.jpg not downloaded yet
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58dc1290>
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23dd2ae7-cd3c-5122-9105-ce3266b3347a/23dd2ae7-cd3c-5122-9105-ce3266b3347a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe3a41ed813ab40798f913996c32feea7.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e3a41ed813ab40798f913996c32feea7.jpg saved to cache
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23dd2ae7-cd3c-5122-9105-ce3266b3347a
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23dd2ae7-cd3c-5122-9105-ce3266b3347a sending to next pipeline
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512d8810>
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542ed611-c5bd-5a08-b17e-0912662de5d6/542ed611-c5bd-5a08-b17e-0912662de5d6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd6861e54c80e4585b088c5b9973e4e9d.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d6861e54c80e4585b088c5b9973e4e9d.jpg saved to cache
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 542ed611-c5bd-5a08-b17e-0912662de5d6
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 542ed611-c5bd-5a08-b17e-0912662de5d6 sending to next pipeline
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 23dd2ae7-cd3c-5122-9105-ce3266b3347a with identifier 202601149132719
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 23dd2ae7-cd3c-5122-9105-ce3266b3347a
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e3a41ed813ab40798f913996c32feea7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2022 Tesla Model 3 Long Range, four wheel drive has a 78 '
                'kWh battery, offering a maximum range of 389 miles when new. '
                'It comes equipped with a host of convenient features, '
                'including heated front and rear seats, Bluetooth '
                'connectivity, blind spot information, and two inductive '
                'charging mats for smartphones. The large boot space provides '
                'ample practicality for everyday use and longer journeys.\n'
                '\n'
                'Contact our friendly sales team for more',
 'doors_number': 4,
 'engine_horse_power': 341,
 'fuel_type': 'Electric',
 'id': '23dd2ae7-cd3c-5122-9105-ce3266b3347a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149132719',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 25730,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23dd2ae7-cd3c-5122-9105-ce3266b3347a/23dd2ae7-cd3c-5122-9105-ce3266b3347a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238896,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e3a41ed813ab40798f913996c32feea7.jpg',
             'Width': 2048}],
 'price': 22699,
 'price_includes_vat': True,
 'registration_date': '2022-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 (Dual Motor) Long Range Auto 4WDE 4dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2022}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149132719%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149132719: {'created_time': 1774523455.428539, 'last_price_update_time': 1774523455.428547}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149132719') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 542ed611-c5bd-5a08-b17e-0912662de5d6 with identifier 202601199245213
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 542ed611-c5bd-5a08-b17e-0912662de5d6
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d6861e54c80e4585b088c5b9973e4e9d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'CLEAN AND TIDY VAUXHALL MOKKA WITH HEATED FRONT SEATS, THE '
                'NAVI PRO SYSTEM WITH REAR CAMERA, HEATED STEERING WHEEL, '
                'DIGITAL DASH AND LOTS MORE! THIS VEHICLE IS AVAILABLE NOW TO '
                'VIEW, CALL US TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '542ed611-c5bd-5a08-b17e-0912662de5d6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199245213',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Mokka',
 'odometer': 34600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542ed611-c5bd-5a08-b17e-0912662de5d6/542ed611-c5bd-5a08-b17e-0912662de5d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251399,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d6861e54c80e4585b088c5b9973e4e9d.jpg',
             'Width': 2048}],
 'price': 12999,
 'price_includes_vat': True,
 'registration_date': '2021-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka 1.2 Turbo Elite Nav Premium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Elite Nav Premium',
 'year': 2021}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199245213%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199245213: {'created_time': 1774523455.477334, 'last_price_update_time': 1774523455.477341}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199245213') HTTP/1.1" 204 0
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2db06fcc6ae34ef9b5bc09c9d49670a5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:55 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d177a47-a465-50a7-bf37-145c793e2473 with identifier: 202601099023856
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9d177a47-a465-50a7-bf37-145c793e2473
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F005e0f6a22a54f629ad4663ba4faa24b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/005e0f6a22a54f629ad4663ba4faa24b.jpg not downloaded yet
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/00d22154e92d423e961918389598a640.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/240d77f7995f4351b76d96028d0c12f2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f70790>
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83150fce-b50f-5e77-9ab9-e9eee1791f41/83150fce-b50f-5e77-9ab9-e9eee1791f41_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8bf564f08c914160a9a6b8158ababb87.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8bf564f08c914160a9a6b8158ababb87.jpg saved to cache
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83150fce-b50f-5e77-9ab9-e9eee1791f41
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83150fce-b50f-5e77-9ab9-e9eee1791f41 sending to next pipeline
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c50ffd410>
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adbd81a0-2521-56b6-b1e4-fadde2477507/adbd81a0-2521-56b6-b1e4-fadde2477507_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4abb00deba1c42ceb6d367d85ff9a5f1.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4abb00deba1c42ceb6d367d85ff9a5f1.jpg saved to cache
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adbd81a0-2521-56b6-b1e4-fadde2477507
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adbd81a0-2521-56b6-b1e4-fadde2477507 sending to next pipeline
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512854d0>
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d18034e-cc28-553d-a702-2e19b0af30d7/7d18034e-cc28-553d-a702-2e19b0af30d7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa512dec15d149c2b4bed43685b1a2ca.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa512dec15d149c2b4bed43685b1a2ca.jpg saved to cache
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d18034e-cc28-553d-a702-2e19b0af30d7
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d18034e-cc28-553d-a702-2e19b0af30d7 sending to next pipeline
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5148f0d0>
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fe31dc7-692d-5258-b584-b8cb321f88e5/8fe31dc7-692d-5258-b584-b8cb321f88e5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb79041547434a2d87ca2474bbef9067.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db79041547434a2d87ca2474bbef9067.jpg saved to cache
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fe31dc7-692d-5258-b584-b8cb321f88e5
2026-03-26 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fe31dc7-692d-5258-b584-b8cb321f88e5 sending to next pipeline
2026-03-26 11:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/df18aac1deab492099d5576f292a7b49.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 83150fce-b50f-5e77-9ab9-e9eee1791f41 with identifier 202601199244526
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 83150fce-b50f-5e77-9ab9-e9eee1791f41
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8bf564f08c914160a9a6b8158ababb87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'color': 'White',
 'currency': 'GBP',
 'description': 'PORSCHE GTS PDK WITH 20”ALLOY WHEELS, BOSE SOUND SYSTEM, GTS '
                'INTERIOR PACK, TILT AND SLIDE ELECTRIC SUNROOF, 18 WAY '
                'ADAPTIVE SPORTS SEATS PLUS, PARKING SENSORS INCLUDING REAR '
                'CAMERA, HEATED FRONT SEATS, NAVIGATION AND MUCH MORE NOW '
                'AVAILABLE! THIS VEHICLE IS IN SUPERB CONDITION AND UNDER '
                '20000 MILES! CALL OUR SALES TEAM TO LEARN MORE!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 444,
 'fuel_type': 'Petrol',
 'id': '83150fce-b50f-5e77-9ab9-e9eee1791f41',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199244526',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Porsche',
 'model': '911',
 'odometer': 19900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83150fce-b50f-5e77-9ab9-e9eee1791f41/83150fce-b50f-5e77-9ab9-e9eee1791f41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244065,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8bf564f08c914160a9a6b8158ababb87.jpg',
             'Width': 2048}],
 'price': 81499,
 'price_includes_vat': True,
 'registration_date': '2017-06-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche 911 3.0T 991 Carrera 4 GTS PDK 4WD Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': '991 Carrera 4 GTS',
 'year': 2017}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199244526%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199244526: {'created_time': 1774523455.833042, 'last_price_update_time': 1774523455.833056}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199244526') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: adbd81a0-2521-56b6-b1e4-fadde2477507 with identifier 202601149132505
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item adbd81a0-2521-56b6-b1e4-fadde2477507
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4abb00deba1c42ceb6d367d85ff9a5f1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2022 Mercedes Benz EQC 400 AMG Line (Premium) is a fully '
                'electric, four wheel drive vehicle, offering a sophisticated '
                'driving experience. Equipped with the sporty AMG Line trim, '
                'wireless smartphone charging, Blind Spot Assist, premium '
                'Burmester surround sound, electric sliding sunroof and '
                'navigate tight spaces with ease thanks to the Parking '
                'Package, which includes Parking Assist PARKTRONIC and a rear '
                'camera.\n'
                '\n'
                'With a substantial 88 kWh battery, you can expect a maximum '
                'range of up to 254 miles when new. \n'
                '\n'
                'Contact us for more information!',
 'doors_number': 5,
 'engine_horse_power': 402,
 'fuel_type': 'Electric',
 'id': 'adbd81a0-2521-56b6-b1e4-fadde2477507',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149132505',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'EQC',
 'odometer': 28000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adbd81a0-2521-56b6-b1e4-fadde2477507/adbd81a0-2521-56b6-b1e4-fadde2477507_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257827,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4abb00deba1c42ceb6d367d85ff9a5f1.jpg',
             'Width': 2048}],
 'price': 25499,
 'price_includes_vat': True,
 'registration_date': '2022-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz EQC 400 80kWh AMG Line (Premium) Auto 4MATIC 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149132505%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149132505: {'created_time': 1774523455.887487, 'last_price_update_time': 1774523455.8875}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149132505') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7d18034e-cc28-553d-a702-2e19b0af30d7 with identifier 202601149132376
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7d18034e-cc28-553d-a702-2e19b0af30d7
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fa512dec15d149c2b4bed43685b1a2ca.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'BLACK EDITION AUDI TT WITH 20”ALLOY WHEELS, AIR CONDITIONING, '
                'HEATED FRONT SEATS AND THE TECHNOLOGY PACKAGE INCLUDING THE '
                'AUDO PHONE BOX, HARD DRIVE NAVIGATION SYSTEM, VIRTUAL COCKPIT '
                'AND TOUCH MMI INTERFACE! THIS VEHICLE IS FUN TO DRIVE, IN '
                'EXCELLENT CONDITION AND IS AVAILABLE NOW FOR VIEWING! CALL '
                'FOR MORE DETAILS!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 194,
 'fuel_type': 'Petrol',
 'id': '7d18034e-cc28-553d-a702-2e19b0af30d7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149132376',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 47500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d18034e-cc28-553d-a702-2e19b0af30d7/7d18034e-cc28-553d-a702-2e19b0af30d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252092,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa512dec15d149c2b4bed43685b1a2ca.jpg',
             'Width': 2048}],
 'price': 22299,
 'price_includes_vat': True,
 'registration_date': '2020-10-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI 40 Black Edition S Tronic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2020}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149132376%27 HTTP/1.1" 200 None
2026-03-26 11:10:55 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149132376: {'created_time': 1774523455.961546, 'last_price_update_time': 1774523455.961556}
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149132376') HTTP/1.1" 204 0
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8fe31dc7-692d-5258-b584-b8cb321f88e5 with identifier 202601169206434
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8fe31dc7-692d-5258-b584-b8cb321f88e5
2026-03-26 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/db79041547434a2d87ca2474bbef9067.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'EXCEPTIONALLY LOW MILEAGE, ONLY 2 OWNERS FROM NEW AND GREAT '
                'SPEC! OUR M2 COMPETITION COMES WITH 19”ALLOY WHEELS, M2 PLUS '
                'PACK, BMW ICON ADAPTIVE LED HEADLIGHTS, BLACK DAKOTA LEATHER '
                'WITH ORANGE STITCHING, HEATED FRONT SEATS, HARMAN KARDON '
                'SOUND SYSTEM AND LOTS MORE! THIS VEHICLE IS AVAILABLE NOW TO '
                'VIEW! CALL FOR MORE DETAILS!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 404,
 'fuel_type': 'Petrol',
 'id': '8fe31dc7-692d-5258-b584-b8cb321f88e5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601169206434',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'M2',
 'odometer': 18200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fe31dc7-692d-5258-b584-b8cb321f88e5/8fe31dc7-692d-5258-b584-b8cb321f88e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252324,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/db79041547434a2d87ca2474bbef9067.jpg',
             'Width': 2048}],
 'price': 37799,
 'price_includes_vat': True,
 'registration_date': '2020-11-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW M2 3.0 BiTurbo Competition DCT Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2020}
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601169206434%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601169206434: {'created_time': 1774523456.01404, 'last_price_update_time': 1774523456.014052}
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601169206434') HTTP/1.1" 204 0
2026-03-26 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4a576a89722e422b94601cfac99fe4fa.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f8e410>
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3868f20b-2808-5499-8f4d-648ff8a1f7e3/3868f20b-2808-5499-8f4d-648ff8a1f7e3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2db06fcc6ae34ef9b5bc09c9d49670a5.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2db06fcc6ae34ef9b5bc09c9d49670a5.jpg saved to cache
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3868f20b-2808-5499-8f4d-648ff8a1f7e3
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3868f20b-2808-5499-8f4d-648ff8a1f7e3 sending to next pipeline
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d801d0>
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ace9c5c-29b2-5952-9f85-be3d940de3d1/6ace9c5c-29b2-5952-9f85-be3d940de3d1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F00d22154e92d423e961918389598a640.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/00d22154e92d423e961918389598a640.jpg saved to cache
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ace9c5c-29b2-5952-9f85-be3d940de3d1
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ace9c5c-29b2-5952-9f85-be3d940de3d1 sending to next pipeline
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f29f10>
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47557092-b6e7-572d-9f81-238222e34a5e/47557092-b6e7-572d-9f81-238222e34a5e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F240d77f7995f4351b76d96028d0c12f2.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/240d77f7995f4351b76d96028d0c12f2.jpg saved to cache
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47557092-b6e7-572d-9f81-238222e34a5e
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47557092-b6e7-572d-9f81-238222e34a5e sending to next pipeline
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Page: 12/16, total results: 304
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168615893%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512168615893: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168615642%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512168615642: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512128547245%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512128547245: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512128546449%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512128546449: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512128545090%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512128545090: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108509590%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512108509590: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108509022%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512108509022: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108508040%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512108508040: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108507825%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512108507825: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108503036%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512108503036: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108498910%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512108498910: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048384655%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048384655: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048384292%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048384292: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048383980%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048383980: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048382153%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048382153: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048380940%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048380940: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048380417%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512048380417: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512038314585%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512038314585: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511288198174%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511288198174: 1
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511288198053%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511288198053: 1
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51393c10>
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00eb66d5-4d19-5ca4-ac50-72b282c606a2/00eb66d5-4d19-5ca4-ac50-72b282c606a2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf18aac1deab492099d5576f292a7b49.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df18aac1deab492099d5576f292a7b49.jpg saved to cache
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00eb66d5-4d19-5ca4-ac50-72b282c606a2
2026-03-26 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00eb66d5-4d19-5ca4-ac50-72b282c606a2 sending to next pipeline
2026-03-26 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3b66547b07704a5792100203d1499319.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/253366d7efbb4a45ad56f03e579da128.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3868f20b-2808-5499-8f4d-648ff8a1f7e3 with identifier 202601149132128
2026-03-26 11:10:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3868f20b-2808-5499-8f4d-648ff8a1f7e3
2026-03-26 11:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2db06fcc6ae34ef9b5bc09c9d49670a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2021 Audi A5 boasts the desirable Edition 1 trim, '
                'enhancing its already impressive specification including, '
                'Keyless entry Bang & Olufsen sound system,  360 degree camera '
                'and front and rear parking sensors, Audi Phone Box featuring '
                'wireless charging, 3-Zone Electronic Climate Control and 20 '
                'inch alloys!\n'
                '\n'
                'Contact us for more information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 201,
 'fuel_type': 'Petrol',
 'id': '3868f20b-2808-5499-8f4d-648ff8a1f7e3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149132128',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 66800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3868f20b-2808-5499-8f4d-648ff8a1f7e3/3868f20b-2808-5499-8f4d-648ff8a1f7e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259487,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2db06fcc6ae34ef9b5bc09c9d49670a5.jpg',
             'Width': 2048}],
 'price': 23799,
 'price_includes_vat': True,
 'registration_date': '2021-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI 40 Edition 1 Sportback S Tronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Edition 1',
 'year': 2021}
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149132128%27 HTTP/1.1" 200 None
2026-03-26 11:10:56 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149132128: {'created_time': 1774523456.661732, 'last_price_update_time': 1774523456.661741}
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149132128') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6ace9c5c-29b2-5952-9f85-be3d940de3d1 with identifier 202601169202676
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6ace9c5c-29b2-5952-9f85-be3d940de3d1
2026-03-26 11:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/00d22154e92d423e961918389598a640.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'THIS MINI GP IS FROM A LIMITED PRODUCTION OF ONLY 3000 MADE '
                'TO CELEBRATE MINIS 60th BIRTHDAY! IT IS RECOGNISED AS THE '
                'FASTEST AND MOST POWERFUL MINI EVER BUILT, FEATURING A '
                '2.0-LITER 4-CYLINDER TURBO ENGINE THAT PRODUCES 306 '
                'HORSEPOWER! \n'
                'THIS VEHICLE IS IN GREAT CONDITION AND ALSO FEATURES THE GP '
                'TOURING PACK, GIVING YOU THE NAVIGATION PLUS SYSTEM, HEATED '
                'FRONT SEATS, CLIMATE CONTROL, WIRELESS PHONE CHARGER AND AN '
                'ARM REST! CALL US NOW TO ARRANGE YOUR VIEWING!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 302,
 'fuel_type': 'Petrol',
 'id': '6ace9c5c-29b2-5952-9f85-be3d940de3d1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601169202676',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ace9c5c-29b2-5952-9f85-be3d940de3d1/6ace9c5c-29b2-5952-9f85-be3d940de3d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264968,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/00d22154e92d423e961918389598a640.jpg',
             'Width': 2048}],
 'price': 29799,
 'price_includes_vat': True,
 'registration_date': '2020-06-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 John Cooper Works GP Steptronic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'John Cooper Works GP',
 'year': 2020}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601169202676%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601169202676: {'created_time': 1774523457.211779, 'last_price_update_time': 1774523457.211787}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601169202676') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 47557092-b6e7-572d-9f81-238222e34a5e with identifier 202601149131737
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 47557092-b6e7-572d-9f81-238222e34a5e
2026-03-26 11:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/240d77f7995f4351b76d96028d0c12f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'LUXURY MERCEDES C43 JUST IN WITH ALLOY WHEEL UPGRADE, '
                'PANORAMIC SUNROOF, BURMESTER SPEAKERS, 1/2 LEATHER HEATED '
                'FRONT SEATS, SATELLITE NAVIGATION, DAB RADIO, REAR CAMERA AND '
                'SO MUCH MORE! THIS VEHICLE IS IN LOVELY CONDITION AND '
                'AVAILABLE NOW! CALL OUR SALES TEAM TO LEARN MORE!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 362,
 'fuel_type': 'Petrol',
 'id': '47557092-b6e7-572d-9f81-238222e34a5e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149131737',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'C Class',
 'odometer': 47500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47557092-b6e7-572d-9f81-238222e34a5e/47557092-b6e7-572d-9f81-238222e34a5e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258129,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/240d77f7995f4351b76d96028d0c12f2.jpg',
             'Width': 2048}],
 'price': 25799,
 'price_includes_vat': True,
 'registration_date': '2018-03-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C Class 3.0 C43 V6 AMG (Premium Plus) G-Tronic+ '
          '4MATIC Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'AMG',
 'year': 2018}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149131737%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149131737: {'created_time': 1774523457.263198, 'last_price_update_time': 1774523457.263207}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149131737') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 00eb66d5-4d19-5ca4-ac50-72b282c606a2 with identifier 202601159156949
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 00eb66d5-4d19-5ca4-ac50-72b282c606a2
2026-03-26 11:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/df18aac1deab492099d5576f292a7b49.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2020 MINI Hatch John Cooper Works is a truly exceptional '
                'example, boasting incredibly low mileage of just 9052 miles '
                'from its single owner.  It comes equipped with the desirable '
                'Comfort Plus Pack, which includes climate control, heated '
                'front seats, and comprehensive parking assistance with front '
                'and rear sensors and a rear camera.  Further enhancing your '
                'driving experience are automatic headlights, Bluetooth '
                'connectivity with audio streaming, and a heated front '
                'windscreen for those icy mornings.\n'
                '\n'
                'Contact our friendly sales team today.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 228,
 'fuel_type': 'Petrol',
 'id': '00eb66d5-4d19-5ca4-ac50-72b282c606a2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601159156949',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 9000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00eb66d5-4d19-5ca4-ac50-72b282c606a2/00eb66d5-4d19-5ca4-ac50-72b282c606a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245333,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/df18aac1deab492099d5576f292a7b49.jpg',
             'Width': 2048}],
 'price': 21799,
 'price_includes_vat': True,
 'registration_date': '2020-09-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 John Cooper Works Steptronic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'John Cooper Works',
 'year': 2020}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601159156949%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601159156949: {'created_time': 1774523457.311475, 'last_price_update_time': 1774523457.311483}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601159156949') HTTP/1.1" 204 0
2026-03-26 11:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/01115d2c90594095875dc0471c4f820b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6d28a458f65c443e8cc1b1c391e23161.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52ff9410>
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c27edde-bd06-5ceb-956e-fa49abbdb957/7c27edde-bd06-5ceb-956e-fa49abbdb957_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a576a89722e422b94601cfac99fe4fa.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a576a89722e422b94601cfac99fe4fa.jpg saved to cache
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c27edde-bd06-5ceb-956e-fa49abbdb957
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c27edde-bd06-5ceb-956e-fa49abbdb957 sending to next pipeline
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4103470c-d677-5c33-8e5a-8babb768dab5 with identifier: 202601078973294
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4103470c-d677-5c33-8e5a-8babb768dab5
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf1a2e26e1494fc498f92c0b6c4bf51d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df1a2e26e1494fc498f92c0b6c4bf51d.jpg not downloaded yet
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Getting next page: 13
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 13
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7c27edde-bd06-5ceb-956e-fa49abbdb957 with identifier 202601149131511
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7c27edde-bd06-5ceb-956e-fa49abbdb957
2026-03-26 11:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4a576a89722e422b94601cfac99fe4fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'CONVERTIBLE MERCEDES C200 WITH BIG WHEELS, LEATHER '
                'UPHOLSTERY, HEATED FRONT SEATS, WIND SCARF, MEMORY SEATS, '
                'SATELLITE NAVIGATION, DAB RADIO, PARKING SENSORS AND KEYLESS '
                'ENTRY NOW AVAILABLE!  THIS VEHICLE IS COMFORTABLE TO DRIVE '
                'AND IN GOOD CONDITION! CALL US NOW TO LEARN MORE!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 181,
 'fuel_type': 'Petrol',
 'id': '7c27edde-bd06-5ceb-956e-fa49abbdb957',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149131511',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'C Class',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c27edde-bd06-5ceb-956e-fa49abbdb957/7c27edde-bd06-5ceb-956e-fa49abbdb957_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261271,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a576a89722e422b94601cfac99fe4fa.jpg',
             'Width': 2048}],
 'price': 15999,
 'price_includes_vat': True,
 'registration_date': '2018-04-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C Class 2.0 C200 AMG Line Cabriolet G-Tronic+ Euro 6 '
          '(s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149131511%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149131511: {'created_time': 1774523457.517649, 'last_price_update_time': 1774523457.517658}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149131511') HTTP/1.1" 204 0
2026-03-26 11:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/005e0f6a22a54f629ad4663ba4faa24b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f59c2dd-2661-5902-9a11-aba652dd455d with identifier: 202601078973164
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7f59c2dd-2661-5902-9a11-aba652dd455d
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8b6fb1845b034ca48a7e36f4876e0ab8.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8b6fb1845b034ca48a7e36f4876e0ab8.jpg not downloaded yet
2026-03-26 11:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514ceb50>
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_063755d2-c1c8-55bd-9c22-a70ed2f38d21/063755d2-c1c8-55bd-9c22-a70ed2f38d21_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b66547b07704a5792100203d1499319.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b66547b07704a5792100203d1499319.jpg saved to cache
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 063755d2-c1c8-55bd-9c22-a70ed2f38d21
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 063755d2-c1c8-55bd-9c22-a70ed2f38d21 sending to next pipeline
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e29810>
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50546-d6b0-5486-8c0d-32f85a0b1f5c/33d50546-d6b0-5486-8c0d-32f85a0b1f5c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F253366d7efbb4a45ad56f03e579da128.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/253366d7efbb4a45ad56f03e579da128.jpg saved to cache
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33d50546-d6b0-5486-8c0d-32f85a0b1f5c
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33d50546-d6b0-5486-8c0d-32f85a0b1f5c sending to next pipeline
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 063755d2-c1c8-55bd-9c22-a70ed2f38d21 with identifier 202601149131216
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 063755d2-c1c8-55bd-9c22-a70ed2f38d21
2026-03-26 11:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3b66547b07704a5792100203d1499319.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GREAT CONDITION SEAT ATECA WITH PARK ASSIST, SATELLITE '
                'NAVIGATION, DAB RADIO, FULL LINK, CLIMATE CONTROL, CRUISE '
                'CONTROL AND A NICE SET OF ALLOY WHEELS NOW AVAILABLE! THIS '
                'VEHICLE HAS PLENTY OF SPACE, IS VERY COMFORTABLE AND IS '
                'AVAILABLE NOW TO VIEW! CALL US FOR MORE DETAILS',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '063755d2-c1c8-55bd-9c22-a70ed2f38d21',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149131216',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'SEAT',
 'model': 'Ateca',
 'odometer': 39100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_063755d2-c1c8-55bd-9c22-a70ed2f38d21/063755d2-c1c8-55bd-9c22-a70ed2f38d21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252938,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b66547b07704a5792100203d1499319.jpg',
             'Width': 2048}],
 'price': 13799,
 'price_includes_vat': True,
 'registration_date': '2019-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SEAT Ateca 1.5 TSI EVO FR Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2019}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149131216%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149131216: {'created_time': 1774523457.674696, 'last_price_update_time': 1774523457.674704}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149131216') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 33d50546-d6b0-5486-8c0d-32f85a0b1f5c with identifier 202601149133935
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 33d50546-d6b0-5486-8c0d-32f85a0b1f5c
2026-03-26 11:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/253366d7efbb4a45ad56f03e579da128.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'PERFORMANCE MODEL 3 TESLA JUST IN WITH 20”ALLOY WHEELS, '
                'PANORAMIC ROOF, HEATED FRONT AND REAR SEATS, HEATED STEERING '
                'WHEEL, FULL WHITE LEATHER UPHOLSTERY, SAT NAV SYSTEM, DAB '
                'RADIO, PARKING CAMERAS, GAMES AND ALOT MORE! CALL FOR MORE '
                'DETAILS!',
 'doors_number': 4,
 'engine_horse_power': 449,
 'fuel_type': 'Electric',
 'id': '33d50546-d6b0-5486-8c0d-32f85a0b1f5c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149133935',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 33200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50546-d6b0-5486-8c0d-32f85a0b1f5c/33d50546-d6b0-5486-8c0d-32f85a0b1f5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242937,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/253366d7efbb4a45ad56f03e579da128.jpg',
             'Width': 2048}],
 'price': 22999,
 'price_includes_vat': True,
 'registration_date': '2021-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 (Dual Motor) Performance Auto 4WDE 4dr (Performance '
          'Upgrade)',
 'transmission': 'automatic',
 'trim': 'Performance',
 'year': 2021}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149133935%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149133935: {'created_time': 1774523457.722536, 'last_price_update_time': 1774523457.722543}
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149133935') HTTP/1.1" 204 0
2026-03-26 11:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 24ec70ed-a564-5c50-8493-726baf7ff87a with identifier: 202601078971894
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 24ec70ed-a564-5c50-8493-726baf7ff87a
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a912001f7dd4ab685c450251c3f3675.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a912001f7dd4ab685c450251c3f3675.jpg not downloaded yet
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51408190>
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2489a356-0778-5f13-9796-190187291623/2489a356-0778-5f13-9796-190187291623_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F01115d2c90594095875dc0471c4f820b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/01115d2c90594095875dc0471c4f820b.jpg saved to cache
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2489a356-0778-5f13-9796-190187291623
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2489a356-0778-5f13-9796-190187291623 sending to next pipeline
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58191f90>
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31132a73-3e33-5cf9-8f84-9c2476ee41e7/31132a73-3e33-5cf9-8f84-9c2476ee41e7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d28a458f65c443e8cc1b1c391e23161.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d28a458f65c443e8cc1b1c391e23161.jpg saved to cache
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31132a73-3e33-5cf9-8f84-9c2476ee41e7
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31132a73-3e33-5cf9-8f84-9c2476ee41e7 sending to next pipeline
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 75553a17-df06-5dd8-8e6c-e42aa52726d3 with identifier: 202512238763891
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 75553a17-df06-5dd8-8e6c-e42aa52726d3
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b30123e2467466c9efdffbe7fd289cd.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b30123e2467466c9efdffbe7fd289cd.jpg not downloaded yet
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5815e1d0>
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d177a47-a465-50a7-bf37-145c793e2473/9d177a47-a465-50a7-bf37-145c793e2473_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F005e0f6a22a54f629ad4663ba4faa24b.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/005e0f6a22a54f629ad4663ba4faa24b.jpg saved to cache
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d177a47-a465-50a7-bf37-145c793e2473
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d177a47-a465-50a7-bf37-145c793e2473 sending to next pipeline
2026-03-26 11:10:57 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b026fb5d-7f49-54f5-ba74-29fcab41e643 with identifier: 202601058923269
2026-03-26 11:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b026fb5d-7f49-54f5-ba74-29fcab41e643
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1fd1ce1b4014743b6516ace1b708c93.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1fd1ce1b4014743b6516ace1b708c93.jpg not downloaded yet
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2489a356-0778-5f13-9796-190187291623 with identifier 202601149134060
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2489a356-0778-5f13-9796-190187291623
2026-03-26 11:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/01115d2c90594095875dc0471c4f820b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2023 Volkswagen ID.3 Pro Family is powered by a 62 kWh '
                'battery that provides a maximum range of 257 miles when new. '
                'It comes equipped with desirable features including 18 inch '
                'East Derry alloy wheels, a Comfort Package Plus for enhanced '
                'comfort with heated seats and steering wheel, and Climate '
                'Control. Parking is made easier with front and rear parking '
                'sensors and a rear camera, further supported by a Parking '
                'Assistance system. The Design Package Plus adds a panoramic '
                'opening sunroof.\n'
                '\n'
                'Contact us for more information.',
 'doors_number': 5,
 'engine_horse_power': 143,
 'fuel_type': 'Electric',
 'id': '2489a356-0778-5f13-9796-190187291623',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149134060',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 16400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2489a356-0778-5f13-9796-190187291623/2489a356-0778-5f13-9796-190187291623_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273762,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/01115d2c90594095875dc0471c4f820b.jpg',
             'Width': 2048}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2023-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 Pro 58kWh Family Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Family',
 'year': 2023}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149134060%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149134060: {'created_time': 1774523458.069298, 'last_price_update_time': 1774523458.069314}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149134060') HTTP/1.1" 204 0
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 31132a73-3e33-5cf9-8f84-9c2476ee41e7 with identifier 202601149130990
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 31132a73-3e33-5cf9-8f84-9c2476ee41e7
2026-03-26 11:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6d28a458f65c443e8cc1b1c391e23161.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2022 Nissan Qashqai DIG-T Acenta Premium is a fantastic '
                'example of a modern family car, boasting a fuel efficient '
                '1.3L Petrol Hybrid engine and meeting Euro 6 emission '
                'standards. This particular model comes with a rear view '
                'camera, complete with parking assistance, and intelligent '
                "auto headlights that switch on automatically. You'll also "
                'benefit from blind spot warning technology, ensuring safer '
                'lane changes, and seamless integration with your smartphone '
                'through Android Auto and Apple CarPlay.\n'
                '\n'
                'Call our helpful sales team now to learn more or please pop '
                'in to view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 156,
 'fuel_type': 'Petrol Hybrid',
 'id': '31132a73-3e33-5cf9-8f84-9c2476ee41e7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149130990',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 49400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31132a73-3e33-5cf9-8f84-9c2476ee41e7/31132a73-3e33-5cf9-8f84-9c2476ee41e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251688,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d28a458f65c443e8cc1b1c391e23161.jpg',
             'Width': 2048}],
 'price': 14299,
 'price_includes_vat': True,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T MHEV Acenta Premium XTRON Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Acenta Premium',
 'year': 2022}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149130990%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149130990: {'created_time': 1774523458.117038, 'last_price_update_time': 1774523458.117054}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149130990') HTTP/1.1" 204 0
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9d177a47-a465-50a7-bf37-145c793e2473 with identifier 202601099023856
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9d177a47-a465-50a7-bf37-145c793e2473
2026-03-26 11:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/005e0f6a22a54f629ad4663ba4faa24b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Now on site is this all electric Kia EV6, finished in black '
                'for a sleek and sporty look. Packed full of features '
                'including sunroof, heated and cooling front seats, rear view '
                'camera, Meridian audio, large curved screen and head up '
                'display. \n'
                '\n'
                'Call or pop in to see us, today!',
 'doors_number': 5,
 'engine_horse_power': 320,
 'fuel_type': 'Electric',
 'id': '9d177a47-a465-50a7-bf37-145c793e2473',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601099023856',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 23400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d177a47-a465-50a7-bf37-145c793e2473/9d177a47-a465-50a7-bf37-145c793e2473_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248924,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/005e0f6a22a54f629ad4663ba4faa24b.jpg',
             'Width': 2048}],
 'price': 27999,
 'price_includes_vat': True,
 'registration_date': '2023-08-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA EV6 77.4kWh GT-Line S Auto AWD 5dr',
 'transmission': 'automatic',
 'trim': 'GT-Line S',
 'year': 2023}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601099023856%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601099023856: {'created_time': 1774523458.164176, 'last_price_update_time': 1774523458.164186}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601099023856') HTTP/1.1" 204 0
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d73c9c5d-767e-5a03-8b45-20feb346d3d6 with identifier: 202512238763879
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d73c9c5d-767e-5a03-8b45-20feb346d3d6
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e4c77baebed42718e419a19295e49cf.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e4c77baebed42718e419a19295e49cf.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ca187b4f-2afb-5aaa-983b-429851a4bf4d with identifier: 202601058923189
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca187b4f-2afb-5aaa-983b-429851a4bf4d
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f4d11ca4e194626b1482f5540b8c96e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f4d11ca4e194626b1482f5540b8c96e.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4229aa01-2407-5e5e-81ef-94ab4a9a0cbe with identifier: 202512238763859
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4229aa01-2407-5e5e-81ef-94ab4a9a0cbe
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F93a0deb0d43e496faf01d6c8f16942df.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/93a0deb0d43e496faf01d6c8f16942df.jpg not downloaded yet
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/df1a2e26e1494fc498f92c0b6c4bf51d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3af0a4ce-dcdf-59ae-9c39-7427ae562039 with identifier: 202601058921408
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3af0a4ce-dcdf-59ae-9c39-7427ae562039
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F120b40a8193448c98a4f9137a18025a9.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/120b40a8193448c98a4f9137a18025a9.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d569d17-910f-53a3-832b-c26f22eea2f4 with identifier: 202512238763823
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6d569d17-910f-53a3-832b-c26f22eea2f4
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6825fdb7c8d5411d8691668ea735d1e3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6825fdb7c8d5411d8691668ea735d1e3.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 089d10c8-76d0-5f01-ae0b-7ad1cf5c3745 with identifier: 202512248790303
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 089d10c8-76d0-5f01-ae0b-7ad1cf5c3745
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F030fb09cc7f04ebba5a07d827a8ecf9c.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/030fb09cc7f04ebba5a07d827a8ecf9c.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e9c25f3-88f9-5750-9dad-34a685f799a5 with identifier: 202512178649372
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9e9c25f3-88f9-5750-9dad-34a685f799a5
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc4277aca66d41a4801c6ec6be38e898.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc4277aca66d41a4801c6ec6be38e898.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1 with identifier: 202512248789895
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd08ce856015f4a929a93c7047f0f19fa.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d08ce856015f4a929a93c7047f0f19fa.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e76969fe-0ec6-5484-abc0-249035dfac23 with identifier: 202512178647898
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e76969fe-0ec6-5484-abc0-249035dfac23
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0a448f785c1481b9077e33a2aef7d9f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0a448f785c1481b9077e33a2aef7d9f.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 17e886ac-f4ba-5c3c-bdaa-23580f547ffe with identifier: 202512248789791
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 17e886ac-f4ba-5c3c-bdaa-23580f547ffe
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F290d1385af9449768f6893dee024cf2b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/290d1385af9449768f6893dee024cf2b.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ecaff1-fbf9-5928-b72c-fe6c87b97060 with identifier: 202512178646977
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f0ecaff1-fbf9-5928-b72c-fe6c87b97060
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9f3d091f11a4465884ae3d24b69847b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9f3d091f11a4465884ae3d24b69847b.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 16f83063-3b7e-56a4-a7bc-308841565d49 with identifier: 202512238763906
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 16f83063-3b7e-56a4-a7bc-308841565d49
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0ef333a9cb145ac8e61421287ca84cd.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0ef333a9cb145ac8e61421287ca84cd.jpg not downloaded yet
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e52012d4-7bba-5e70-afe5-fed4c20b3d4f with identifier: 202512168616611
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e52012d4-7bba-5e70-afe5-fed4c20b3d4f
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b95a7e96edb4a18b9fb6a02953683f5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b95a7e96edb4a18b9fb6a02953683f5.jpg not downloaded yet
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514d1350>
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4103470c-d677-5c33-8e5a-8babb768dab5/4103470c-d677-5c33-8e5a-8babb768dab5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdf1a2e26e1494fc498f92c0b6c4bf51d.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/df1a2e26e1494fc498f92c0b6c4bf51d.jpg saved to cache
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4103470c-d677-5c33-8e5a-8babb768dab5
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4103470c-d677-5c33-8e5a-8babb768dab5 sending to next pipeline
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4b30123e2467466c9efdffbe7fd289cd.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4103470c-d677-5c33-8e5a-8babb768dab5 with identifier 202601078973294
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4103470c-d677-5c33-8e5a-8babb768dab5
2026-03-26 11:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/df1a2e26e1494fc498f92c0b6c4bf51d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'The Nissan Juke is a 2021 model, boasting a 1.0L Petrol '
                'Engine and a Euro 6 emission class. This variant is the DIG-T '
                'Tekna, a trim level that comes with a range of impressive '
                'features. The Tekna trim is equipped with the ProPilot Pack, '
                'which includes Blind Spot Assistance, Adaptive Cruise '
                'Control, and a 360-degree camera system for parking '
                'assistance. Additionally, the Comfort Pack provides climate '
                'control, ensuring a comfortable ride. The vehicle also '
                'features a Bose Personal Plus Audio System, complete with a '
                'premium branded sound system, as well as Android Auto and '
                'Apple CarPlay for seamless connectivity. Parking is made '
                'easier with the front parking sensor and parking assistance '
                'system.\n'
                'Call our sales team now for more details or pop in to view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 112,
 'fuel_type': 'Petrol',
 'id': '4103470c-d677-5c33-8e5a-8babb768dab5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601078973294',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 29900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4103470c-d677-5c33-8e5a-8babb768dab5/4103470c-d677-5c33-8e5a-8babb768dab5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241521,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/df1a2e26e1494fc498f92c0b6c4bf51d.jpg',
             'Width': 2048}],
 'price': 13999,
 'price_includes_vat': True,
 'registration_date': '2021-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T Tekna DCT Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2021}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601078973294%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601078973294: {'created_time': 1774523458.514999, 'last_price_update_time': 1774523458.515008}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601078973294') HTTP/1.1" 204 0
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3e4c77baebed42718e419a19295e49cf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9a912001f7dd4ab685c450251c3f3675.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 339c333c-1552-5ff6-8e92-86f4f8819dc3 with identifier: 202512168616264
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 339c333c-1552-5ff6-8e92-86f4f8819dc3
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55aab72b29744b5e8010204d1531b7e3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55aab72b29744b5e8010204d1531b7e3.jpg not downloaded yet
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8b6fb1845b034ca48a7e36f4876e0ab8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8f4d11ca4e194626b1482f5540b8c96e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d1fd1ce1b4014743b6516ace1b708c93.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:10:58 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1591bc68-4526-51bf-8e24-45afd903d10d with identifier: 202512168616001
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1591bc68-4526-51bf-8e24-45afd903d10d
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F499813ef36e348ffaca85dde5870374e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/499813ef36e348ffaca85dde5870374e.jpg not downloaded yet
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/93a0deb0d43e496faf01d6c8f16942df.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/120b40a8193448c98a4f9137a18025a9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5108a390>
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75553a17-df06-5dd8-8e6c-e42aa52726d3/75553a17-df06-5dd8-8e6c-e42aa52726d3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b30123e2467466c9efdffbe7fd289cd.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b30123e2467466c9efdffbe7fd289cd.jpg saved to cache
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75553a17-df06-5dd8-8e6c-e42aa52726d3
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75553a17-df06-5dd8-8e6c-e42aa52726d3 sending to next pipeline
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 75553a17-df06-5dd8-8e6c-e42aa52726d3 with identifier 202512238763891
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 75553a17-df06-5dd8-8e6c-e42aa52726d3
2026-03-26 11:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4b30123e2467466c9efdffbe7fd289cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': '75553a17-df06-5dd8-8e6c-e42aa52726d3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512238763891',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 17000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75553a17-df06-5dd8-8e6c-e42aa52726d3/75553a17-df06-5dd8-8e6c-e42aa52726d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252423,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b30123e2467466c9efdffbe7fd289cd.jpg',
             'Width': 2048}],
 'price': 19799,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Niro 64.8kWh 4 Auto 5dr',
 'transmission': 'automatic',
 'trim': '4',
 'year': 2022}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763891%27 HTTP/1.1" 200 None
2026-03-26 11:10:58 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512238763891: {'created_time': 1774523458.754442, 'last_price_update_time': 1774523458.754457}
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512238763891') HTTP/1.1" 204 0
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d7a2d0>
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d73c9c5d-767e-5a03-8b45-20feb346d3d6/d73c9c5d-767e-5a03-8b45-20feb346d3d6_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e4c77baebed42718e419a19295e49cf.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e4c77baebed42718e419a19295e49cf.jpg saved to cache
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d73c9c5d-767e-5a03-8b45-20feb346d3d6
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d73c9c5d-767e-5a03-8b45-20feb346d3d6 sending to next pipeline
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512d7650>
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ec70ed-a564-5c50-8493-726baf7ff87a/24ec70ed-a564-5c50-8493-726baf7ff87a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9a912001f7dd4ab685c450251c3f3675.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9a912001f7dd4ab685c450251c3f3675.jpg saved to cache
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24ec70ed-a564-5c50-8493-726baf7ff87a
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24ec70ed-a564-5c50-8493-726baf7ff87a sending to next pipeline
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51498050>
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f59c2dd-2661-5902-9a11-aba652dd455d/7f59c2dd-2661-5902-9a11-aba652dd455d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8b6fb1845b034ca48a7e36f4876e0ab8.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8b6fb1845b034ca48a7e36f4876e0ab8.jpg saved to cache
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f59c2dd-2661-5902-9a11-aba652dd455d
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f59c2dd-2661-5902-9a11-aba652dd455d sending to next pipeline
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51495e10>
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca187b4f-2afb-5aaa-983b-429851a4bf4d/ca187b4f-2afb-5aaa-983b-429851a4bf4d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f4d11ca4e194626b1482f5540b8c96e.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f4d11ca4e194626b1482f5540b8c96e.jpg saved to cache
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca187b4f-2afb-5aaa-983b-429851a4bf4d
2026-03-26 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca187b4f-2afb-5aaa-983b-429851a4bf4d sending to next pipeline
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512d8790>
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b026fb5d-7f49-54f5-ba74-29fcab41e643/b026fb5d-7f49-54f5-ba74-29fcab41e643_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd1fd1ce1b4014743b6516ace1b708c93.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d1fd1ce1b4014743b6516ace1b708c93.jpg saved to cache
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b026fb5d-7f49-54f5-ba74-29fcab41e643
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b026fb5d-7f49-54f5-ba74-29fcab41e643 sending to next pipeline
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c0a448f785c1481b9077e33a2aef7d9f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d73c9c5d-767e-5a03-8b45-20feb346d3d6 with identifier 202512238763879
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d73c9c5d-767e-5a03-8b45-20feb346d3d6
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3e4c77baebed42718e419a19295e49cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This Niro 4 comes equipped with a tilting and sliding power '
                'sunroof, smart entry system, front and rear parking sensors,  '
                'adaptive cruise control, .68 kWh battery, offering a maximum '
                'range of 285 miles when new\n'
                '\n'
                'The charging capabilities of this Kia Niro: full charge at '
                'home using a 7kW charger taking approximately 9 hours and 25 '
                'minutes. Charging on the go, can reach 80% charge from empty '
                'in just 43 minutes at a public charging station.',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': 'd73c9c5d-767e-5a03-8b45-20feb346d3d6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512238763879',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 21000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d73c9c5d-767e-5a03-8b45-20feb346d3d6/d73c9c5d-767e-5a03-8b45-20feb346d3d6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246952,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e4c77baebed42718e419a19295e49cf.jpg',
             'Width': 2048}],
 'price': 19799,
 'price_includes_vat': True,
 'registration_date': '2022-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Niro 64.8kWh 4 Auto 5dr',
 'transmission': 'automatic',
 'trim': '4',
 'year': 2022}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763879%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512238763879: {'created_time': 1774523459.047976, 'last_price_update_time': 1774523459.047986}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512238763879') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 24ec70ed-a564-5c50-8493-726baf7ff87a with identifier 202601078971894
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 24ec70ed-a564-5c50-8493-726baf7ff87a
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9a912001f7dd4ab685c450251c3f3675.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2022 Abarth 595 T-Jet Competizione presents an '
                'exceptional opportunity with its remarkably low mileage of '
                'just 14,900 miles. This Euro 6 compliant 1.4L petrol model, '
                'in its striking Competizione trim, offers a compelling blend '
                "of performance and modern technology. Inside, you'll find a "
                '7in touchscreen radio complete with navigation, Bluetooth, '
                'USB, and Aux in connectivity, alongside DAB digital radio. '
                'Seamless integration with your smartphone is guaranteed '
                'thanks to Apple CarPlay and Android Auto compatibility. For '
                'added convenience, rear parking sensors are fitted, and the '
                'automatic climate control ensures a comfortable cabin '
                'environment no matter the weather.\n'
                'Please give us a call to learn more or pop in to view!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 180,
 'fuel_type': 'Petrol',
 'id': '24ec70ed-a564-5c50-8493-726baf7ff87a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601078971894',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Abarth',
 'model': '595',
 'odometer': 14900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ec70ed-a564-5c50-8493-726baf7ff87a/24ec70ed-a564-5c50-8493-726baf7ff87a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252799,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9a912001f7dd4ab685c450251c3f3675.jpg',
             'Width': 2048}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2022-04-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 595 1.4 T-Jet Competizione Euro 6 3dr',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2022}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601078971894%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601078971894: {'created_time': 1774523459.090958, 'last_price_update_time': 1774523459.090968}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601078971894') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7f59c2dd-2661-5902-9a11-aba652dd455d with identifier 202601078973164
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7f59c2dd-2661-5902-9a11-aba652dd455d
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8b6fb1845b034ca48a7e36f4876e0ab8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'White',
 'currency': 'GBP',
 'description': 'LOVELY BMW X3 WITH 19”ALLOYS, VERNASCA BLACK LEATHER, HEATED '
                'FRONT SEATS, POWER TAILGATE, PARK ASSIST, REAR CAMERA, '
                'SATELLITE NAVIGATION, CLIMATE CONTROL AND MUCH MORE! \n'
                'THIS VEHICLE HAS ONLY JUST ARRIVED AND IN EXCELLENT '
                'CONDITION, PLEASE CALL US TO LEARN MORE OR POP IN TO VIEW!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': '7f59c2dd-2661-5902-9a11-aba652dd455d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601078973164',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 47300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f59c2dd-2661-5902-9a11-aba652dd455d/7f59c2dd-2661-5902-9a11-aba652dd455d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256229,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8b6fb1845b034ca48a7e36f4876e0ab8.jpg',
             'Width': 2048}],
 'price': 22799,
 'price_includes_vat': True,
 'registration_date': '2019-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 2.0 20d M Sport Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601078973164%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601078973164: {'created_time': 1774523459.133569, 'last_price_update_time': 1774523459.133577}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601078973164') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ca187b4f-2afb-5aaa-983b-429851a4bf4d with identifier 202601058923189
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ca187b4f-2afb-5aaa-983b-429851a4bf4d
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8f4d11ca4e194626b1482f5540b8c96e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Mercedes Benz EQC 400 AMG Line (Premium Plus) '
                'boasts exceptionally low mileage for its age, having covered '
                'just 28,100 miles. As a fully electric, four wheel drive '
                'vehicle, it offers a sophisticated driving experience. This '
                'particular model features the desirable AMG Line trim and '
                'comes equipped with a host of premium features including an '
                'electric sliding sunroof, a head up display for convenient '
                'information access, blind spot assist for enhanced safety, '
                'heated front seats for comfort, and wireless smartphone '
                'charging.\n'
                'This EQC is in excellent condition and has full leather, '
                'memory seats which are very comfortable! Come and take a look '
                'now or call us for more information!',
 'doors_number': 5,
 'engine_horse_power': 402,
 'fuel_type': 'Electric',
 'id': 'ca187b4f-2afb-5aaa-983b-429851a4bf4d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601058923189',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'EQC',
 'odometer': 28100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca187b4f-2afb-5aaa-983b-429851a4bf4d/ca187b4f-2afb-5aaa-983b-429851a4bf4d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245879,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f4d11ca4e194626b1482f5540b8c96e.jpg',
             'Width': 2048}],
 'price': 26999,
 'price_includes_vat': True,
 'registration_date': '2021-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz EQC 400 80kWh AMG Line (Premium Plus) Auto 4MATIC 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601058923189%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601058923189: {'created_time': 1774523459.202358, 'last_price_update_time': 1774523459.202365}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601058923189') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b026fb5d-7f49-54f5-ba74-29fcab41e643 with identifier 202601058923269
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b026fb5d-7f49-54f5-ba74-29fcab41e643
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d1fd1ce1b4014743b6516ace1b708c93.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2024 Volkswagen Golf TSI R Line offers a blend of sporty '
                'design and advanced technology.  As a Euro 6 compliant model, '
                'it features a responsive 1.5 litre petrol engine and is '
                'presented in the desirable R Line trim.  Notable features '
                'include stylish 18 inch Bergamo alloy wheels, front and rear '
                'parking sensors with parking assistance, and a 1 zone '
                'electronic climate control system for your comfort.  The Golf '
                'also benefits from a dusk sensor for automatic headlights and '
                'adaptive cruise control and heated front seats and steering '
                'wheel, making journeys more enjoyable!\n'
                'Come and take a look now or call our helpful sales team!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': 'b026fb5d-7f49-54f5-ba74-29fcab41e643',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601058923269',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 40000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b026fb5d-7f49-54f5-ba74-29fcab41e643/b026fb5d-7f49-54f5-ba74-29fcab41e643_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251474,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d1fd1ce1b4014743b6516ace1b708c93.jpg',
             'Width': 2048}],
 'price': 20299,
 'price_includes_vat': True,
 'registration_date': '2024-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.5 TSI R-Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2024}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601058923269%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601058923269: {'created_time': 1774523459.248551, 'last_price_update_time': 1774523459.24856}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601058923269') HTTP/1.1" 204 0
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51ee47d0>
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4229aa01-2407-5e5e-81ef-94ab4a9a0cbe/4229aa01-2407-5e5e-81ef-94ab4a9a0cbe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F93a0deb0d43e496faf01d6c8f16942df.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/93a0deb0d43e496faf01d6c8f16942df.jpg saved to cache
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4229aa01-2407-5e5e-81ef-94ab4a9a0cbe
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4229aa01-2407-5e5e-81ef-94ab4a9a0cbe sending to next pipeline
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51498f50>
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af0a4ce-dcdf-59ae-9c39-7427ae562039/3af0a4ce-dcdf-59ae-9c39-7427ae562039_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F120b40a8193448c98a4f9137a18025a9.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/120b40a8193448c98a4f9137a18025a9.jpg saved to cache
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3af0a4ce-dcdf-59ae-9c39-7427ae562039
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3af0a4ce-dcdf-59ae-9c39-7427ae562039 sending to next pipeline
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bc4277aca66d41a4801c6ec6be38e898.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b0ef333a9cb145ac8e61421287ca84cd.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0b95a7e96edb4a18b9fb6a02953683f5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d08ce856015f4a929a93c7047f0f19fa.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4229aa01-2407-5e5e-81ef-94ab4a9a0cbe with identifier 202512238763859
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4229aa01-2407-5e5e-81ef-94ab4a9a0cbe
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/93a0deb0d43e496faf01d6c8f16942df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 Tesla Model 3 Standard Range Plus presents an '
                'excellent opportunity to experience electric driving with '
                'impressive range. As an electric vehicle, it boasts a 53 kWh '
                'battery offering a maximum range of 278 miles when new. '
                'Charging is convenient, with a full charge at home taking '
                'approximately 7 hours and 10 minutes using a 7kW charger, '
                'while rapid public charging can take you from empty to 80% in '
                "just 29 minutes. Inside, you'll find comfort and convenience "
                'with 12 way power adjustable front and rear heated seats, '
                'adaptive cruise control for effortless journeys, and a 2 zone '
                'climate control system. Parking is made easier with front '
                'parking sensors, and the cabin remains at your ideal '
                'temperature thanks to the air conditioning.\n'
                '\n'
                'For more details please contact our sales team or feel free '
                'to come in to view!',
 'doors_number': 4,
 'engine_horse_power': 241,
 'fuel_type': 'Electric',
 'id': '4229aa01-2407-5e5e-81ef-94ab4a9a0cbe',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512238763859',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 43500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4229aa01-2407-5e5e-81ef-94ab4a9a0cbe/4229aa01-2407-5e5e-81ef-94ab4a9a0cbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247817,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/93a0deb0d43e496faf01d6c8f16942df.jpg',
             'Width': 2048}],
 'price': 16299,
 'price_includes_vat': True,
 'registration_date': '2021-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus Auto RWD 4dr',
 'transmission': 'automatic',
 'trim': 'Standard Range Plus',
 'year': 2021}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763859%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512238763859: {'created_time': 1774523459.40106, 'last_price_update_time': 1774523459.401067}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512238763859') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3af0a4ce-dcdf-59ae-9c39-7427ae562039 with identifier 202601058921408
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3af0a4ce-dcdf-59ae-9c39-7427ae562039
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/120b40a8193448c98a4f9137a18025a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Orange',
 'currency': 'GBP',
 'description': 'LOW MILEAGE AND GOOD CONDITION FIAT 500 WITH AIR '
                'CONDITIONING, CRUISE CONTROL AND A TOUCHSCREEN MEDIA SYSTEM '
                'WITH DAB RADIO, APPLE CAR PLAY AND MORE! \n'
                '\n'
                'COME AND TAKE A LOOK NOW OR CALL US FOR FURTHER DETAILS!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 70,
 'fuel_type': 'Petrol',
 'id': '3af0a4ce-dcdf-59ae-9c39-7427ae562039',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601058921408',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Fiat',
 'model': '500',
 'odometer': 9800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af0a4ce-dcdf-59ae-9c39-7427ae562039/3af0a4ce-dcdf-59ae-9c39-7427ae562039_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260456,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/120b40a8193448c98a4f9137a18025a9.jpg',
             'Width': 2048}],
 'price': 11499,
 'price_includes_vat': True,
 'registration_date': '2024-09-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 MHEV Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'year': 2024}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601058921408%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601058921408: {'created_time': 1774523459.44358, 'last_price_update_time': 1774523459.443586}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601058921408') HTTP/1.1" 204 0
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/030fb09cc7f04ebba5a07d827a8ecf9c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6825fdb7c8d5411d8691668ea735d1e3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51489b10>
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e76969fe-0ec6-5484-abc0-249035dfac23/e76969fe-0ec6-5484-abc0-249035dfac23_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0a448f785c1481b9077e33a2aef7d9f.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0a448f785c1481b9077e33a2aef7d9f.jpg saved to cache
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e76969fe-0ec6-5484-abc0-249035dfac23
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e76969fe-0ec6-5484-abc0-249035dfac23 sending to next pipeline
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b9f3d091f11a4465884ae3d24b69847b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e76969fe-0ec6-5484-abc0-249035dfac23 with identifier 202512178647898
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e76969fe-0ec6-5484-abc0-249035dfac23
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c0a448f785c1481b9077e33a2aef7d9f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'LOVELY CONDITION KIA NIRO WITH 17”ALLOYS, KEYLESS ENTRY, '
                'PARKING SENSORS, PRIVACY GLASS AND A POWER TAILGATE! THIS '
                'VEHICLE IS LOVELY TO DRIVE AND COMES FITTED WITH HEATED FRONT '
                'AND REAR OUTER SEATS, VENTILATED FRONT SEATS AND A HEATED '
                'STEERING WHEEL! CALL US NOW FOR FULL DETAILS OR POP IN TO '
                'VIEW!',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': 'e76969fe-0ec6-5484-abc0-249035dfac23',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512178647898',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 34800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e76969fe-0ec6-5484-abc0-249035dfac23/e76969fe-0ec6-5484-abc0-249035dfac23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256152,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c0a448f785c1481b9077e33a2aef7d9f.jpg',
             'Width': 2048}],
 'price': 18499,
 'price_includes_vat': True,
 'registration_date': '2022-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Niro 64.8kWh 4 Auto 5dr',
 'transmission': 'automatic',
 'trim': '4',
 'year': 2022}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178647898%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512178647898: {'created_time': 1774523459.559231, 'last_price_update_time': 1774523459.559239}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512178647898') HTTP/1.1" 204 0
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5148a190>
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e9c25f3-88f9-5750-9dad-34a685f799a5/9e9c25f3-88f9-5750-9dad-34a685f799a5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc4277aca66d41a4801c6ec6be38e898.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc4277aca66d41a4801c6ec6be38e898.jpg saved to cache
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e9c25f3-88f9-5750-9dad-34a685f799a5
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e9c25f3-88f9-5750-9dad-34a685f799a5 sending to next pipeline
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d1acd0>
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16f83063-3b7e-56a4-a7bc-308841565d49/16f83063-3b7e-56a4-a7bc-308841565d49_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0ef333a9cb145ac8e61421287ca84cd.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0ef333a9cb145ac8e61421287ca84cd.jpg saved to cache
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16f83063-3b7e-56a4-a7bc-308841565d49
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16f83063-3b7e-56a4-a7bc-308841565d49 sending to next pipeline
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5a167e10>
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e52012d4-7bba-5e70-afe5-fed4c20b3d4f/e52012d4-7bba-5e70-afe5-fed4c20b3d4f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0b95a7e96edb4a18b9fb6a02953683f5.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0b95a7e96edb4a18b9fb6a02953683f5.jpg saved to cache
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e52012d4-7bba-5e70-afe5-fed4c20b3d4f
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e52012d4-7bba-5e70-afe5-fed4c20b3d4f sending to next pipeline
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c511ea150>
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1/a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd08ce856015f4a929a93c7047f0f19fa.jpg') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d08ce856015f4a929a93c7047f0f19fa.jpg saved to cache
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1
2026-03-26 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1 sending to next pipeline
2026-03-26 11:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9e9c25f3-88f9-5750-9dad-34a685f799a5 with identifier 202512178649372
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9e9c25f3-88f9-5750-9dad-34a685f799a5
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bc4277aca66d41a4801c6ec6be38e898.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2022 Volkswagen ID.3 Pro Family is an excellent example '
                'of electric motoring, offering a substantial battery maximum '
                'range of 257 miles when new. This particular model, in its '
                'Family trim, benefits from a generous 62 kWh battery '
                'capacity, ensuring you can travel further between charges. '
                'Charging is convenient, with a full charge at home taking '
                'approximately 9 hours and 30 minutes using a 7kW charger, '
                'while rapid public charging can take you from empty to 80% in '
                'as little as 37 minutes.\n'
                '\n'
                'The ID.3 Pro Family is equipped with a range of desirable '
                'features designed to enhance your driving experience. It '
                'boasts stylish 18 inch East Derry alloy wheels and a Comfort '
                'Package Plus, which includes climate control, heated seats, '
                'and a heated steering wheel for ultimate comfort in all '
                'conditions. The Design Package Plus adds striking LED '
                'headlights and an opening panoramic sunroof, flooding the '
                'cabin with light. For added safety and convenience, it '
                'features Adaptive Cruise Control with Front Assist, including '
                'city emergency braking, and an Assistance Pack that provides '
                'keyless entry and a rear parking camera. Furthermore, this '
                'electric Volkswagen offers a large boot space, making it a '
                'practical choice for families and everyday use.\n'
                '\n'
                'Call us now for further information!',
 'doors_number': 5,
 'engine_horse_power': 143,
 'fuel_type': 'Electric',
 'id': '9e9c25f3-88f9-5750-9dad-34a685f799a5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512178649372',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 23200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e9c25f3-88f9-5750-9dad-34a685f799a5/9e9c25f3-88f9-5750-9dad-34a685f799a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251106,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc4277aca66d41a4801c6ec6be38e898.jpg',
             'Width': 2048}],
 'price': 15799,
 'price_includes_vat': True,
 'registration_date': '2022-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 Pro 58kWh Family Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Family',
 'year': 2022}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178649372%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512178649372: {'created_time': 1774523459.807428, 'last_price_update_time': 1774523459.807437}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512178649372') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 16f83063-3b7e-56a4-a7bc-308841565d49 with identifier 202512238763906
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 16f83063-3b7e-56a4-a7bc-308841565d49
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b0ef333a9cb145ac8e61421287ca84cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma T Vivid Ruby Edition offers a unique '
                'blend of style and technology. This particular model is '
                'presented in the eye catching Vivid Ruby Edition trim with '
                'front and rear parking sensors, Winter Pack that provides '
                'heated seats and a heated steering wheel, B&O Premium Audio '
                'System and Ford SYNC 3 Navigation along with a wireless '
                'charging pad. \n'
                '\n'
                'Contact our friendly sales team for more information.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '16f83063-3b7e-56a4-a7bc-308841565d49',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512238763906',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 39200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16f83063-3b7e-56a4-a7bc-308841565d49/16f83063-3b7e-56a4-a7bc-308841565d49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252826,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0ef333a9cb145ac8e61421287ca84cd.jpg',
             'Width': 2048}],
 'price': 15399,
 'price_includes_vat': True,
 'registration_date': '2023-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0T EcoBoost Vivid Ruby Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Vivid Ruby Edition',
 'year': 2023}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763906%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512238763906: {'created_time': 1774523459.849928, 'last_price_update_time': 1774523459.849936}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512238763906') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e52012d4-7bba-5e70-afe5-fed4c20b3d4f with identifier 202512168616611
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e52012d4-7bba-5e70-afe5-fed4c20b3d4f
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0b95a7e96edb4a18b9fb6a02953683f5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Tesla Model 3 Long Range presents a remarkable '
                'opportunity with its exceptionally low mileage of just 34,200 '
                'miles for its age. As an electric vehicle, it boasts a Four '
                'Wheel Drive drivetrain and a substantial 78 kWh battery, '
                'offering a new vehicle range of up to 360 miles. This Model 3 '
                'comes equipped with a host of desirable features, including a '
                'heated steering wheel and 12 way power adjustable front and '
                'rear heated seats, ensuring comfort in all conditions. For '
                'added convenience and safety, it includes Blind Spot '
                'Information, keyless entry with app control, and a 2 zone '
                'climate control system.\n'
                '\n'
                'Experience impressive performance with the Tesla Model 3 Long '
                'Range, capable of accelerating from 0 to 60 mph in a swift '
                '4.2 seconds, a figure that highlights its dynamic '
                'capabilities compared to many other vehicles. Charging is '
                'convenient, with a full charge at home taking approximately '
                '12 hours using a 7kW charger, and rapid charging to 80% '
                'possible in just 26 minutes at a public station. Furthermore, '
                'this model offers generous storage with its large boot space, '
                'making it a practical choice for everyday use and longer '
                'journeys.\n'
                'For further details, please contact our sales team who will '
                'be happy to assist you!',
 'doors_number': 4,
 'engine_horse_power': 341,
 'fuel_type': 'Electric',
 'id': 'e52012d4-7bba-5e70-afe5-fed4c20b3d4f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512168616611',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 34200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e52012d4-7bba-5e70-afe5-fed4c20b3d4f/e52012d4-7bba-5e70-afe5-fed4c20b3d4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240883,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0b95a7e96edb4a18b9fb6a02953683f5.jpg',
             'Width': 2048}],
 'price': 19499,
 'price_includes_vat': True,
 'registration_date': '2021-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 (Dual Motor) Long Range Auto 4WDE 4dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2021}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168616611%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512168616611: {'created_time': 1774523459.90494, 'last_price_update_time': 1774523459.904947}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512168616611') HTTP/1.1" 204 0
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1 with identifier 202512248789895
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:10:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1
2026-03-26 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d08ce856015f4a929a93c7047f0f19fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'A sleek and compact car with comfortable part leather part '
                'suede heated seats, air conditioning, Audi smartphone '
                'interface and cruise control. \n'
                '\n'
                'Call us today to arrange a viewing and test drive.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 194,
 'fuel_type': 'Petrol',
 'id': 'a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512248789895',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 28000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1/a91dbf05-8c09-5bbc-b8a7-b7b6cd60e5b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248851,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d08ce856015f4a929a93c7047f0f19fa.jpg',
             'Width': 2048}],
 'price': 24799,
 'price_includes_vat': True,
 'registration_date': '2021-11-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI 40 Black Edition S Tronic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2021}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512248789895%27 HTTP/1.1" 200 None
2026-03-26 11:10:59 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512248789895: {'created_time': 1774523459.950434, 'last_price_update_time': 1774523459.950441}
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512248789895') HTTP/1.1" 204 0
2026-03-26 11:10:59 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 39 pages/min), scraped 214 items (at 214 items/min)
2026-03-26 11:10:59 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5a5ff510>
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089d10c8-76d0-5f01-ae0b-7ad1cf5c3745/089d10c8-76d0-5f01-ae0b-7ad1cf5c3745_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F030fb09cc7f04ebba5a07d827a8ecf9c.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/030fb09cc7f04ebba5a07d827a8ecf9c.jpg saved to cache
2026-03-26 11:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 089d10c8-76d0-5f01-ae0b-7ad1cf5c3745
2026-03-26 11:11:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 089d10c8-76d0-5f01-ae0b-7ad1cf5c3745 sending to next pipeline
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Page: 13/16, total results: 304
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268158165%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268158165: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268157994%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268157994: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268155435%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268155435: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268154334%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268154334: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268153803%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511268153803: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208026553%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511208026553: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511198004797%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511198004797: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511197997409%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511197997409: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511197997307%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511197997307: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511187975997%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511187975997: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511187962977%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511187962977: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511177941080%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511177941080: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511147891342%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511147891342: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511147891008%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511147891008: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511147890210%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511147890210: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127833975%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511127833975: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127831368%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511127831368: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107788113%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511107788113: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107774603%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511107774603: 1
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107774528%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511107774528: 1
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51440cd0>
2026-03-26 11:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d569d17-910f-53a3-832b-c26f22eea2f4/6d569d17-910f-53a3-832b-c26f22eea2f4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6825fdb7c8d5411d8691668ea735d1e3.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6825fdb7c8d5411d8691668ea735d1e3.jpg saved to cache
2026-03-26 11:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d569d17-910f-53a3-832b-c26f22eea2f4
2026-03-26 11:11:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d569d17-910f-53a3-832b-c26f22eea2f4 sending to next pipeline
2026-03-26 11:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/55aab72b29744b5e8010204d1531b7e3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 089d10c8-76d0-5f01-ae0b-7ad1cf5c3745 with identifier 202512248790303
2026-03-26 11:11:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:00 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 089d10c8-76d0-5f01-ae0b-7ad1cf5c3745
2026-03-26 11:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/030fb09cc7f04ebba5a07d827a8ecf9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Yellow',
 'currency': 'GBP',
 'description': 'A superb example of the Volvo EX30. As a fully electric '
                'vehicle, it offers a smooth and quiet driving experience, '
                'boasting a substantial battery total capacity of 69 kWh. This '
                'allows for a maximum range of 295 miles when new, making it '
                'ideal for both daily commutes and longer journeys. The EX30 '
                'Plus comes equipped with a range of desirable features, '
                'including  Adaptive Cruise Control for enhanced driving '
                'comfort, a heated steering wheel, and heated front seats for '
                "those colder days. You'll also find a Bluetooth Handsfree "
                'System for seamless connectivity and 2 Zone Electronic '
                'Climate Control with an Air Purifier to maintain a pleasant '
                'cabin environment.\n'
                '\n'
                'Contact us today for more information.',
 'doors_number': 5,
 'engine_horse_power': 268,
 'fuel_type': 'Electric',
 'id': '089d10c8-76d0-5f01-ae0b-7ad1cf5c3745',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512248790303',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'EX30',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_089d10c8-76d0-5f01-ae0b-7ad1cf5c3745/089d10c8-76d0-5f01-ae0b-7ad1cf5c3745_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251465,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/030fb09cc7f04ebba5a07d827a8ecf9c.jpg',
             'Width': 2048}],
 'price': 21799,
 'price_includes_vat': True,
 'registration_date': '2024-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo EX30 Single Motor Extended Range 69kWh Plus Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Plus',
 'year': 2024}
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512248790303%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512248790303: {'created_time': 1774523460.479272, 'last_price_update_time': 1774523460.479281}
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512248790303') HTTP/1.1" 204 0
2026-03-26 11:11:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6d569d17-910f-53a3-832b-c26f22eea2f4 with identifier 202512238763823
2026-03-26 11:11:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:00 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6d569d17-910f-53a3-832b-c26f22eea2f4
2026-03-26 11:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6825fdb7c8d5411d8691668ea735d1e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'engine_horse_power': 201,
 'fuel_type': 'Electric',
 'id': '6d569d17-910f-53a3-832b-c26f22eea2f4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512238763823',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 21000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d569d17-910f-53a3-832b-c26f22eea2f4/6d569d17-910f-53a3-832b-c26f22eea2f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262931,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6825fdb7c8d5411d8691668ea735d1e3.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 Pro Performance 58kWh Life Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512238763823%27 HTTP/1.1" 200 None
2026-03-26 11:11:00 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512238763823: {'created_time': 1774523460.993981, 'last_price_update_time': 1774523460.993988}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512238763823') HTTP/1.1" 204 0
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/290d1385af9449768f6893dee024cf2b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/499813ef36e348ffaca85dde5870374e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51056550>
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ecaff1-fbf9-5928-b72c-fe6c87b97060/f0ecaff1-fbf9-5928-b72c-fe6c87b97060_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9f3d091f11a4465884ae3d24b69847b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9f3d091f11a4465884ae3d24b69847b.jpg saved to cache
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0ecaff1-fbf9-5928-b72c-fe6c87b97060
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0ecaff1-fbf9-5928-b72c-fe6c87b97060 sending to next pipeline
2026-03-26 11:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 97421393-9262-5e2f-84c9-654730f104ee with identifier: 202512168615893
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 97421393-9262-5e2f-84c9-654730f104ee
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91315cddaaca4593a4d8029b59bf7c65.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91315cddaaca4593a4d8029b59bf7c65.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Getting next page: 14
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 14
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f0ecaff1-fbf9-5928-b72c-fe6c87b97060 with identifier 202512178646977
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f0ecaff1-fbf9-5928-b72c-fe6c87b97060
2026-03-26 11:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b9f3d091f11a4465884ae3d24b69847b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'color': 'White',
 'currency': 'GBP',
 'description': 'AUDI TTRS WITH SUBERB PERFORMANCE, HANDLING, SOUND AND THIS '
                'ONE COMES WITH THE COMFORT AND SOUND PACKAGE, FEATURING BANG '
                '& OLUFSEN SPEAKERS, REAR CAMERA AND MORE!\n'
                'INSIDE YOU HAVE FULL LEATHER UPHOLSTERY , HEATED FRONT SEATS, '
                'AUDI’S VIRTUAL COCKPIT AND AN EXHAUST SPORT BUTTON! \n'
                'COME AND TAKE A LOOK NOW OR GIVE US A CALL TO LEARN MORE!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 395,
 'fuel_type': 'Petrol',
 'id': 'f0ecaff1-fbf9-5928-b72c-fe6c87b97060',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512178646977',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'TT RS',
 'odometer': 18700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ecaff1-fbf9-5928-b72c-fe6c87b97060/f0ecaff1-fbf9-5928-b72c-fe6c87b97060_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266576,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9f3d091f11a4465884ae3d24b69847b.jpg',
             'Width': 2048}],
 'price': 42999,
 'price_includes_vat': True,
 'registration_date': '2020-10-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TT Rs 2.5 TFSI Sport Edition S Tronic quattro Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Sport Edition',
 'year': 2020}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512178646977%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512178646977: {'created_time': 1774523461.142038, 'last_price_update_time': 1774523461.142045}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512178646977') HTTP/1.1" 204 0
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 30e3d373-540c-5333-bf89-9a0a1a366211 with identifier: 202512168615642
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 30e3d373-540c-5333-bf89-9a0a1a366211
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f5813bfd36d4d5fa24d5f180e1bdffa.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f5813bfd36d4d5fa24d5f180e1bdffa.jpg not downloaded yet
2026-03-26 11:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51057ed0>
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_339c333c-1552-5ff6-8e92-86f4f8819dc3/339c333c-1552-5ff6-8e92-86f4f8819dc3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55aab72b29744b5e8010204d1531b7e3.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55aab72b29744b5e8010204d1531b7e3.jpg saved to cache
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 339c333c-1552-5ff6-8e92-86f4f8819dc3
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 339c333c-1552-5ff6-8e92-86f4f8819dc3 sending to next pipeline
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 339c333c-1552-5ff6-8e92-86f4f8819dc3 with identifier 202512168616264
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 339c333c-1552-5ff6-8e92-86f4f8819dc3
2026-03-26 11:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/55aab72b29744b5e8010204d1531b7e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 Mercedes Benz EQC 400 AMG Line is a superb example '
                'of electric luxury. As a four wheel drive electric vehicle, '
                'it offers an impressive battery capacity of 88 kWh, providing '
                'a maximum range of 245 miles when new. Charging is '
                'convenient, with a full charge at home taking approximately '
                '12 hours and 13 minutes using a 7kW charger, and a rapid '
                'charge to 80% achievable in just 45 minutes at a public '
                'charging station. This EQC comes equipped with the desirable '
                'AMG Line trim, enhancing its sporty appeal.\n'
                'It comes with Heated front seats, Keyless entry, Power '
                'tailgate, Navigation, Rear Camera, Smartphone projection and '
                'much more!\n'
                'This vehicle is in excellent condition and is available now '
                'to view! Call us for more details!',
 'doors_number': 5,
 'engine_horse_power': 402,
 'fuel_type': 'Electric',
 'id': '339c333c-1552-5ff6-8e92-86f4f8819dc3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512168616264',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'EQC',
 'odometer': 32600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_339c333c-1552-5ff6-8e92-86f4f8819dc3/339c333c-1552-5ff6-8e92-86f4f8819dc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255183,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/55aab72b29744b5e8010204d1531b7e3.jpg',
             'Width': 2048}],
 'price': 23499,
 'price_includes_vat': True,
 'registration_date': '2022-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz EQC 400 80kWh AMG Line Auto 4MATIC 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168616264%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512168616264: {'created_time': 1774523461.266497, 'last_price_update_time': 1774523461.266505}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512168616264') HTTP/1.1" 204 0
2026-03-26 11:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c0d6df15-fb9c-5446-9a98-1eb807c2caca with identifier: 202512128547245
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c0d6df15-fb9c-5446-9a98-1eb807c2caca
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0183b4138edd4dcf9779ac6c67412ba8.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0183b4138edd4dcf9779ac6c67412ba8.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f6e5e4-6c08-5b0e-841c-dce6fc663613 with identifier: 202512108498910
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5f6e5e4-6c08-5b0e-841c-dce6fc663613
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdace41e9b16246e2a0bb965a8842114c.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dace41e9b16246e2a0bb965a8842114c.jpg not downloaded yet
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5104f050>
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17e886ac-f4ba-5c3c-bdaa-23580f547ffe/17e886ac-f4ba-5c3c-bdaa-23580f547ffe_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F290d1385af9449768f6893dee024cf2b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/290d1385af9449768f6893dee024cf2b.jpg saved to cache
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17e886ac-f4ba-5c3c-bdaa-23580f547ffe
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17e886ac-f4ba-5c3c-bdaa-23580f547ffe sending to next pipeline
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121b190>
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1591bc68-4526-51bf-8e24-45afd903d10d/1591bc68-4526-51bf-8e24-45afd903d10d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F499813ef36e348ffaca85dde5870374e.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/499813ef36e348ffaca85dde5870374e.jpg saved to cache
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1591bc68-4526-51bf-8e24-45afd903d10d
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1591bc68-4526-51bf-8e24-45afd903d10d sending to next pipeline
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: df5f610a-1b11-5c43-a25b-4369829d7194 with identifier: 202512128546449
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item df5f610a-1b11-5c43-a25b-4369829d7194
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07a28c765e864563b36c1339ef18af3b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07a28c765e864563b36c1339ef18af3b.jpg not downloaded yet
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 17e886ac-f4ba-5c3c-bdaa-23580f547ffe with identifier 202512248789791
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 17e886ac-f4ba-5c3c-bdaa-23580f547ffe
2026-03-26 11:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/290d1385af9449768f6893dee024cf2b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 206,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Fresh into stock is this Audi RS3, Carbon Black.  Offering an '
                'exhilarating driving experience with its impressive '
                'performance. Loaded with the desirable Comfort and Sound '
                'Package, which includes keyless entry, B&O sound system and '
                'rear parking assistance with a camera as well as  heated '
                'front seats and dual zone electronic climate control, this '
                "won't be around for long!\n"
                '\n'
                'Contact our friendly and helpful sales team today for more '
                'information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 395,
 'fuel_type': 'Petrol',
 'id': '17e886ac-f4ba-5c3c-bdaa-23580f547ffe',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512248789791',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'RS3',
 'odometer': 33200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17e886ac-f4ba-5c3c-bdaa-23580f547ffe/17e886ac-f4ba-5c3c-bdaa-23580f547ffe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271397,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/290d1385af9449768f6893dee024cf2b.jpg',
             'Width': 2048}],
 'price': 46499,
 'price_includes_vat': True,
 'registration_date': '2023-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS3 2.5 TFSI Carbon Black Sportback S Tronic quattro Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Carbon Black',
 'year': 2023}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512248789791%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512248789791: {'created_time': 1774523461.495304, 'last_price_update_time': 1774523461.495312}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512248789791') HTTP/1.1" 204 0
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1591bc68-4526-51bf-8e24-45afd903d10d with identifier 202512168616001
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1591bc68-4526-51bf-8e24-45afd903d10d
2026-03-26 11:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/499813ef36e348ffaca85dde5870374e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2021 Audi A3 TFSI S line offers a refined driving '
                'experience with its Euro 6 compliant 1.0 litre petrol engine. '
                'As a well appointed S line model, it comes equipped with '
                'practical features such as rear parking sensors to aid '
                'manoeuvring, and a Bluetooth interface for seamless '
                'connectivity. The light and rain sensor automatically adjusts '
                'headlights, while the dual zone electronic climate control '
                'ensures comfort for all occupants.\n'
                '\n'
                'Call or email us for more information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '1591bc68-4526-51bf-8e24-45afd903d10d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512168616001',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 58700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 45,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1591bc68-4526-51bf-8e24-45afd903d10d/1591bc68-4526-51bf-8e24-45afd903d10d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211642,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/499813ef36e348ffaca85dde5870374e.jpg',
             'Width': 2048}],
 'price': 15699,
 'price_includes_vat': True,
 'registration_date': '2021-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.0 TFSI 30 S line Sportback Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'S line',
 'year': 2021}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168616001%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512168616001: {'created_time': 1774523461.541578, 'last_price_update_time': 1774523461.541585}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512168616001') HTTP/1.1" 204 0
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 16e98f84-5646-5cb3-9d28-b0b84af291f5 with identifier: 202512048384655
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 16e98f84-5646-5cb3-9d28-b0b84af291f5
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feaaf93dcbb714c54acb62bb275b32797.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eaaf93dcbb714c54acb62bb275b32797.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2 with identifier: 202512128545090
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c16a1ab0c934f50b83707dfb2ed030b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c16a1ab0c934f50b83707dfb2ed030b.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 88b3ab4a-c0c6-5d6d-b324-617097237550 with identifier: 202512048384292
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 88b3ab4a-c0c6-5d6d-b324-617097237550
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F095670d8d89b4d40954fcfba2ded5979.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/095670d8d89b4d40954fcfba2ded5979.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 60d324f1-672a-5883-9544-a81980276af0 with identifier: 202512108509590
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 60d324f1-672a-5883-9544-a81980276af0
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdeb4c5f43b624296ace1b2a10c201d6a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/deb4c5f43b624296ace1b2a10c201d6a.jpg not downloaded yet
2026-03-26 11:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/91315cddaaca4593a4d8029b59bf7c65.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1630bc-7f1a-531e-af30-56bd618deca7 with identifier: 202512048383980
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7a1630bc-7f1a-531e-af30-56bd618deca7
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd24d4262b86d49ee8da6f5e3a0f3c42d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d24d4262b86d49ee8da6f5e3a0f3c42d.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0edf35a8-56c7-50d9-a3cf-5bcde8906544 with identifier: 202512108509022
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0edf35a8-56c7-50d9-a3cf-5bcde8906544
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4fd58a523ca422484c7e5b504eee6ce.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4fd58a523ca422484c7e5b504eee6ce.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f52a32-2f60-544a-bae7-ddb2686519aa with identifier: 202512048382153
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 26f52a32-2f60-544a-bae7-ddb2686519aa
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa127175131e043efb75e804a0e6dd5b5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a127175131e043efb75e804a0e6dd5b5.jpg not downloaded yet
2026-03-26 11:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9f5813bfd36d4d5fa24d5f180e1bdffa.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0a3b35-8d6c-5f41-bee8-da1e43330443 with identifier: 202512108508040
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2a0a3b35-8d6c-5f41-bee8-da1e43330443
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8c3a557545b413081da21a7222c54e5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8c3a557545b413081da21a7222c54e5.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 35f5db64-d67a-5199-8029-232c8801e5c0 with identifier: 202512048380940
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 35f5db64-d67a-5199-8029-232c8801e5c0
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1770f937aeb2487788774555f994a8b7.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1770f937aeb2487788774555f994a8b7.jpg not downloaded yet
2026-03-26 11:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/dace41e9b16246e2a0bb965a8842114c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a19b25-c5b8-58ff-92af-9a56119b59aa with identifier: 202512108507825
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3a19b25-c5b8-58ff-92af-9a56119b59aa
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7f026ad6ea6f4be499445bcc686add0d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7f026ad6ea6f4be499445bcc686add0d.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fe8461b3-e56e-5538-b6cc-afbbe799b4f7 with identifier: 202512048380417
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fe8461b3-e56e-5538-b6cc-afbbe799b4f7
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f47d7557ed04e1083ce0899e2c4ba88.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f47d7557ed04e1083ce0899e2c4ba88.jpg not downloaded yet
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 69a8eadc-34d2-55f5-ad5e-fc01e91ed03e with identifier: 202512108503036
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69a8eadc-34d2-55f5-ad5e-fc01e91ed03e
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b6ca290a18644adb5fdc454f4b9be23.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b6ca290a18644adb5fdc454f4b9be23.jpg not downloaded yet
2026-03-26 11:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0183b4138edd4dcf9779ac6c67412ba8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f90cb5fb-5ab2-5e35-8558-02a067cdf7b1 with identifier: 202512038314585
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f90cb5fb-5ab2-5e35-8558-02a067cdf7b1
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11129ece28314db09bfcbe600b21e1bb.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11129ece28314db09bfcbe600b21e1bb.jpg not downloaded yet
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51269a50>
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97421393-9262-5e2f-84c9-654730f104ee/97421393-9262-5e2f-84c9-654730f104ee_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91315cddaaca4593a4d8029b59bf7c65.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91315cddaaca4593a4d8029b59bf7c65.jpg saved to cache
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97421393-9262-5e2f-84c9-654730f104ee
2026-03-26 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97421393-9262-5e2f-84c9-654730f104ee sending to next pipeline
2026-03-26 11:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/095670d8d89b4d40954fcfba2ded5979.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 97421393-9262-5e2f-84c9-654730f104ee with identifier 202512168615893
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 97421393-9262-5e2f-84c9-654730f104ee
2026-03-26 11:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/91315cddaaca4593a4d8029b59bf7c65.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2020 Nissan Qashqai DIG-T Tekna is a superb example of '
                'this popular family SUV, boasting a Euro 6 compliant 1.3 '
                'litre petrol engine.  As a Tekna trim, it comes equipped with '
                'a host of desirable features designed to enhance your driving '
                'experience.  Enjoy your favourite music through the Bose 8 '
                'speaker premium audio system, and navigate with ease using '
                'the Nissan Connect 7 inch touchscreen navigation system, '
                'complete with Android Auto and Apple CarPlay integration.  '
                'The Intelligent Auto Headlights ensure optimal visibility, '
                'while the Glass Roof Pack, featuring a fixed panoramic '
                'sunroof, floods the cabin with natural light.  Stay connected '
                'on the go with seamless Bluetooth connectivity and audio '
                'streaming.\n'
                '\n'
                'This Qashqai is available now for viewing, any questions '
                'please give our friendly sales team a call!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '97421393-9262-5e2f-84c9-654730f104ee',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512168615893',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 43700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97421393-9262-5e2f-84c9-654730f104ee/97421393-9262-5e2f-84c9-654730f104ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262267,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/91315cddaaca4593a4d8029b59bf7c65.jpg',
             'Width': 2048}],
 'price': 12499,
 'price_includes_vat': True,
 'registration_date': '2020-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Tekna Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2020}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168615893%27 HTTP/1.1" 200 None
2026-03-26 11:11:01 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512168615893: {'created_time': 1774523461.992834, 'last_price_update_time': 1774523461.992843}
2026-03-26 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512168615893') HTTP/1.1" 204 0
2026-03-26 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/deb4c5f43b624296ace1b2a10c201d6a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:02 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c493824-d60c-5562-868a-f360f25afe35 with identifier: 202511288198174
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1c493824-d60c-5562-868a-f360f25afe35
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F710a2f2ea7c54febbb6ee632439b82cc.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/710a2f2ea7c54febbb6ee632439b82cc.jpg not downloaded yet
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e949d0>
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30e3d373-540c-5333-bf89-9a0a1a366211/30e3d373-540c-5333-bf89-9a0a1a366211_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f5813bfd36d4d5fa24d5f180e1bdffa.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f5813bfd36d4d5fa24d5f180e1bdffa.jpg saved to cache
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30e3d373-540c-5333-bf89-9a0a1a366211
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30e3d373-540c-5333-bf89-9a0a1a366211 sending to next pipeline
2026-03-26 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/07a28c765e864563b36c1339ef18af3b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 30e3d373-540c-5333-bf89-9a0a1a366211 with identifier 202512168615642
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 30e3d373-540c-5333-bf89-9a0a1a366211
2026-03-26 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9f5813bfd36d4d5fa24d5f180e1bdffa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'GREAT CONDITION NISSAN QASHQAI WITH LOW MILEAGE, 18”ALLOYS, '
                'PARKING SENSORS, KEYLESS ENTRY, PARKING CAMERA, SMARTPHONE '
                'PROJECTION AND MUCH MORE! THIS VEHICLE HAS TONNES OF SPACE, '
                'IS COMFORTABLE TO DRIVE AND IS AVAILABLE NOW TO VIEW! CALL '
                'FOR MORE DETAILS!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 187,
 'fuel_type': 'Petrol Hybrid',
 'id': '30e3d373-540c-5333-bf89-9a0a1a366211',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512168615642',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 13000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30e3d373-540c-5333-bf89-9a0a1a366211/30e3d373-540c-5333-bf89-9a0a1a366211_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244399,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f5813bfd36d4d5fa24d5f180e1bdffa.jpg',
             'Width': 2048}],
 'price': 19999,
 'price_includes_vat': True,
 'registration_date': '2023-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 h e-POWER N-Connecta Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2023}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168615642%27 HTTP/1.1" 200 None
2026-03-26 11:11:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512168615642: {'created_time': 1774523462.105197, 'last_price_update_time': 1774523462.105205}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512168615642') HTTP/1.1" 204 0
2026-03-26 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d24d4262b86d49ee8da6f5e3a0f3c42d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/eaaf93dcbb714c54acb62bb275b32797.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:02 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cc6761ae-5d96-59d8-ac48-76a319b8322e with identifier: 202511288198053
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cc6761ae-5d96-59d8-ac48-76a319b8322e
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f377849e93b4472bf1f697b895dd8c6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f377849e93b4472bf1f697b895dd8c6.jpg not downloaded yet
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514a6950>
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f6e5e4-6c08-5b0e-841c-dce6fc663613/d5f6e5e4-6c08-5b0e-841c-dce6fc663613_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdace41e9b16246e2a0bb965a8842114c.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dace41e9b16246e2a0bb965a8842114c.jpg saved to cache
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5f6e5e4-6c08-5b0e-841c-dce6fc663613
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5f6e5e4-6c08-5b0e-841c-dce6fc663613 sending to next pipeline
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58d81990>
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0d6df15-fb9c-5446-9a98-1eb807c2caca/c0d6df15-fb9c-5446-9a98-1eb807c2caca_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0183b4138edd4dcf9779ac6c67412ba8.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0183b4138edd4dcf9779ac6c67412ba8.jpg saved to cache
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0d6df15-fb9c-5446-9a98-1eb807c2caca
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0d6df15-fb9c-5446-9a98-1eb807c2caca sending to next pipeline
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d5f6e5e4-6c08-5b0e-841c-dce6fc663613 with identifier 202512108498910
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d5f6e5e4-6c08-5b0e-841c-dce6fc663613
2026-03-26 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/dace41e9b16246e2a0bb965a8842114c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 230,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Our M3 is finished in BMW individual Oxide Grey and has been '
                'equipped with a fantastic specification including the dealer '
                'fitted M-Performance exhaust and the carbon fibre '
                'M-Performance body kit! Some of its stand out factory options '
                'include the exterior Carbon Fibre pack,  Visibility Pack, '
                'which includes advanced LED and Laser headlights for superior '
                'illumination. The Technology Plus Pack adds a suite of driver '
                'aids, such as adaptive cruise control, Parking Assistant Plus '
                'as well as a comprehensive 360 degree camera system with '
                'front and rear sensors and cameras, making parking and '
                'manoeuvring effortless. Comfort Pack, Extended Marino '
                'Bicolour leather, Drive recorder, 50 year badges and the '
                'stunning 19" front and 20" rear 825 forged alloys! \n'
                '\n'
                "It's running in service was completed and it's first service "
                'carried out by BMW in April 2024 at 8434 miles',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 503,
 'fuel_type': 'Petrol',
 'id': 'd5f6e5e4-6c08-5b0e-841c-dce6fc663613',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512108498910',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'M3',
 'odometer': 13900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 64,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f6e5e4-6c08-5b0e-841c-dce6fc663613/d5f6e5e4-6c08-5b0e-841c-dce6fc663613_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253138,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dace41e9b16246e2a0bb965a8842114c.jpg',
             'Width': 2048}],
 'price': 63999,
 'price_includes_vat': True,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW M3 3.0 BiTurbo Competition Steptronic M xDrive Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2022}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108498910%27 HTTP/1.1" 200 None
2026-03-26 11:11:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512108498910: {'created_time': 1774523462.294982, 'last_price_update_time': 1774523462.294995}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512108498910') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c0d6df15-fb9c-5446-9a98-1eb807c2caca with identifier 202512128547245
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c0d6df15-fb9c-5446-9a98-1eb807c2caca
2026-03-26 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0183b4138edd4dcf9779ac6c67412ba8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma ST-Line X offers a sophisticated driving '
                'experience with its 1.0L Petrol Hybrid engine, meeting Euro 6 '
                'emission standards. This model is equipped with the desirable '
                "ST-Line X trim, enhancing its sporty appeal. Inside, you'll "
                'find a B&O Premium Audio System integrated with Ford SYNC 3 '
                'Navigation, providing seamless connectivity through Android '
                'Auto, Apple CarPlay, and Bluetooth for your entertainment and '
                'navigation needs. The cabin also features a Wireless Charging '
                'Pad alongside Electronic Air Temperature Control (EATC) for '
                'convenient climate management and effortless phone charging.\n'
                'This vehicle is in superb condition and is now available for '
                'viewing, any more details please don’t hesitate to give us a '
                'call.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol Hybrid',
 'id': 'c0d6df15-fb9c-5446-9a98-1eb807c2caca',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512128547245',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 21800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0d6df15-fb9c-5446-9a98-1eb807c2caca/c0d6df15-fb9c-5446-9a98-1eb807c2caca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261469,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0183b4138edd4dcf9779ac6c67412ba8.jpg',
             'Width': 2048}],
 'price': 14899,
 'price_includes_vat': True,
 'registration_date': '2023-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0T EcoBoost MHEV ST-Line X Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2023}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512128547245%27 HTTP/1.1" 200 None
2026-03-26 11:11:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512128547245: {'created_time': 1774523462.349698, 'last_price_update_time': 1774523462.349711}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512128547245') HTTP/1.1" 204 0
2026-03-26 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0c16a1ab0c934f50b83707dfb2ed030b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a127175131e043efb75e804a0e6dd5b5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c511084d0>
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b3ab4a-c0c6-5d6d-b324-617097237550/88b3ab4a-c0c6-5d6d-b324-617097237550_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F095670d8d89b4d40954fcfba2ded5979.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/095670d8d89b4d40954fcfba2ded5979.jpg saved to cache
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88b3ab4a-c0c6-5d6d-b324-617097237550
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88b3ab4a-c0c6-5d6d-b324-617097237550 sending to next pipeline
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513bcc90>
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d324f1-672a-5883-9544-a81980276af0/60d324f1-672a-5883-9544-a81980276af0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdeb4c5f43b624296ace1b2a10c201d6a.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/deb4c5f43b624296ace1b2a10c201d6a.jpg saved to cache
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60d324f1-672a-5883-9544-a81980276af0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60d324f1-672a-5883-9544-a81980276af0 sending to next pipeline
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513adf90>
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df5f610a-1b11-5c43-a25b-4369829d7194/df5f610a-1b11-5c43-a25b-4369829d7194_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07a28c765e864563b36c1339ef18af3b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07a28c765e864563b36c1339ef18af3b.jpg saved to cache
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df5f610a-1b11-5c43-a25b-4369829d7194
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df5f610a-1b11-5c43-a25b-4369829d7194 sending to next pipeline
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5136a450>
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a1630bc-7f1a-531e-af30-56bd618deca7/7a1630bc-7f1a-531e-af30-56bd618deca7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd24d4262b86d49ee8da6f5e3a0f3c42d.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d24d4262b86d49ee8da6f5e3a0f3c42d.jpg saved to cache
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a1630bc-7f1a-531e-af30-56bd618deca7
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a1630bc-7f1a-531e-af30-56bd618deca7 sending to next pipeline
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512d6a50>
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16e98f84-5646-5cb3-9d28-b0b84af291f5/16e98f84-5646-5cb3-9d28-b0b84af291f5_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feaaf93dcbb714c54acb62bb275b32797.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eaaf93dcbb714c54acb62bb275b32797.jpg saved to cache
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16e98f84-5646-5cb3-9d28-b0b84af291f5
2026-03-26 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16e98f84-5646-5cb3-9d28-b0b84af291f5 sending to next pipeline
2026-03-26 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d4fd58a523ca422484c7e5b504eee6ce.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1770f937aeb2487788774555f994a8b7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 88b3ab4a-c0c6-5d6d-b324-617097237550 with identifier 202512048384292
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 88b3ab4a-c0c6-5d6d-b324-617097237550
2026-03-26 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/095670d8d89b4d40954fcfba2ded5979.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2021 Audi A1 TFSI Black Edition offers a superb blend of '
                'style and practicality, making it an excellent choice for '
                'those seeking a premium compact car. The Black Edition trim '
                'enhances its sporty appeal, while practical features such as '
                'rear parking sensors and manual air conditioning ensure '
                'comfort and convenience on every journey.\n'
                '\n'
                'Contact us today to arrange a viewing!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '88b3ab4a-c0c6-5d6d-b324-617097237550',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048384292',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b3ab4a-c0c6-5d6d-b324-617097237550/88b3ab4a-c0c6-5d6d-b324-617097237550_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208314,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/095670d8d89b4d40954fcfba2ded5979.jpg',
             'Width': 2048}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2021-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 1.0 TFSI 30 Black Edition Sportback Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2021}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048384292%27 HTTP/1.1" 200 None
2026-03-26 11:11:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048384292: {'created_time': 1774523462.864087, 'last_price_update_time': 1774523462.864096}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048384292') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 60d324f1-672a-5883-9544-a81980276af0 with identifier 202512108509590
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 60d324f1-672a-5883-9544-a81980276af0
2026-03-26 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/deb4c5f43b624296ace1b2a10c201d6a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2020 Ford Fiesta ST-Line Edition boasts exceptionally '
                'low mileage for its age, having covered just 31,300 miles. '
                'This popular hatchback is equipped with a responsive 1.0L '
                'petrol engine and meets Euro 6 emissions standards. Inside, '
                "you'll find the convenient Ford Navigation System with Ford "
                'SYNC 3, offering seamless integration with Apple CarPlay and '
                'Android Auto. The FordPass Connect embedded modem further '
                'enhances connectivity, providing Bluetooth and access to '
                'these smartphone mirroring services. For ease of parking, '
                'rear parking distance sensors are included, and the cabin is '
                'kept comfortable with manual air conditioning.\n'
                '\n'
                'This vehicle is nice to drive, great condition and available '
                'now to view! Please give us a call to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '60d324f1-672a-5883-9544-a81980276af0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512108509590',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 31300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d324f1-672a-5883-9544-a81980276af0/60d324f1-672a-5883-9544-a81980276af0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256119,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/deb4c5f43b624296ace1b2a10c201d6a.jpg',
             'Width': 2048}],
 'price': 10999,
 'price_includes_vat': True,
 'registration_date': '2020-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost ST-Line Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line Edition',
 'year': 2020}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108509590%27 HTTP/1.1" 200 None
2026-03-26 11:11:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512108509590: {'created_time': 1774523462.90608, 'last_price_update_time': 1774523462.906086}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512108509590') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: df5f610a-1b11-5c43-a25b-4369829d7194 with identifier 202512128546449
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item df5f610a-1b11-5c43-a25b-4369829d7194
2026-03-26 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/07a28c765e864563b36c1339ef18af3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Discover this exceptional 2022 Ford Fiesta T ST Line, '
                'boasting remarkably low mileage for its year at just 16,100 '
                'miles. This stylish hatchback is powered by an efficient 1.0L '
                'petrol engine, meeting Euro 6 emission standards and '
                "contributing to its low CO2 emissions. Inside, you'll find "
                'the user friendly SYNC 3 system, complete with navigation and '
                'seamless integration for both Android Auto and Apple CarPlay, '
                'ensuring your journeys are always connected and informed. '
                'Practicality is enhanced with rear parking distance sensors '
                'and a manual air conditioning system to keep you comfortable '
                'in all conditions, while automatic headlights provide added '
                'convenience and safety.\n'
                '\n'
                'Call our sales team now to learn more or please come in to '
                'view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': 'df5f610a-1b11-5c43-a25b-4369829d7194',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512128546449',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 16100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df5f610a-1b11-5c43-a25b-4369829d7194/df5f610a-1b11-5c43-a25b-4369829d7194_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262406,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/07a28c765e864563b36c1339ef18af3b.jpg',
             'Width': 2048}],
 'price': 12799,
 'price_includes_vat': True,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost ST-Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512128546449%27 HTTP/1.1" 200 None
2026-03-26 11:11:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512128546449: {'created_time': 1774523462.94872, 'last_price_update_time': 1774523462.948727}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512128546449') HTTP/1.1" 204 0
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7a1630bc-7f1a-531e-af30-56bd618deca7 with identifier 202512048383980
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7a1630bc-7f1a-531e-af30-56bd618deca7
2026-03-26 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d24d4262b86d49ee8da6f5e3a0f3c42d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 Tesla Model 3 Standard Range Plus presents an '
                'exceptional opportunity with its remarkably low mileage of '
                'just 23,600 miles for its age. As an electric vehicle, it '
                'boasts a 53 kWh battery offering a maximum range of 278 miles '
                'when new. Charging is convenient, with a full charge at home '
                'taking approximately 7 hours and 10 minutes using a 7kW '
                'charger, while rapid public charging can take you from empty '
                'to 80% in as little as 29 minutes. This particular model is '
                'equipped with stylish 19 inch Silver Sports alloy wheels, '
                'dual zone climate control, air conditioning, front parking '
                'sensors for easier manoeuvring, and blind spot information to '
                'enhance safety.\n'
                '\n'
                'Call our sales team now to learn more or please pop in to '
                'view!',
 'doors_number': 4,
 'engine_horse_power': 241,
 'fuel_type': 'Electric',
 'id': '7a1630bc-7f1a-531e-af30-56bd618deca7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048383980',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 23600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a1630bc-7f1a-531e-af30-56bd618deca7/7a1630bc-7f1a-531e-af30-56bd618deca7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259201,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d24d4262b86d49ee8da6f5e3a0f3c42d.jpg',
             'Width': 2048}],
 'price': 17999,
 'price_includes_vat': True,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus Auto RWD 4dr',
 'transmission': 'automatic',
 'trim': 'Standard Range Plus',
 'year': 2021}
2026-03-26 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048383980%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048383980: {'created_time': 1774523463.002765, 'last_price_update_time': 1774523463.002772}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048383980') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 16e98f84-5646-5cb3-9d28-b0b84af291f5 with identifier 202512048384655
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 16e98f84-5646-5cb3-9d28-b0b84af291f5
2026-03-26 11:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/eaaf93dcbb714c54acb62bb275b32797.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'THIS BMW FEATURES THE M-SPORT + PACKAGE, 20”ALLOY WHEEL '
                'UPGRADE, HARMAN KARDON SPEAKERS SYSTEM AND BLACK DAKOTA '
                'LEATHER SEATS WITH EXCLUSIVE STITCHING! THIS VEHICLE IS IN '
                'LOVELY CONDITION AND IS EXTREMELY COMFORTABLE! AVAILABLE NOW '
                'TO VIEW, PLEASE CALL US FOR FURTHER INFORMATION!',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 335,
 'fuel_type': 'Petrol',
 'id': '16e98f84-5646-5cb3-9d28-b0b84af291f5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048384655',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '5 Series',
 'odometer': 44600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16e98f84-5646-5cb3-9d28-b0b84af291f5/16e98f84-5646-5cb3-9d28-b0b84af291f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250897,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/eaaf93dcbb714c54acb62bb275b32797.jpg',
             'Width': 2048}],
 'price': 25999,
 'price_includes_vat': True,
 'registration_date': '2019-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 Series 3.0 540i GPF M Sport Auto xDrive Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048384655%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048384655: {'created_time': 1774523463.050262, 'last_price_update_time': 1774523463.050271}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048384655') HTTP/1.1" 204 0
2026-03-26 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a8c3a557545b413081da21a7222c54e5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7f026ad6ea6f4be499445bcc686add0d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513b9dd0>
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2/c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c16a1ab0c934f50b83707dfb2ed030b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c16a1ab0c934f50b83707dfb2ed030b.jpg saved to cache
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2 sending to next pipeline
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512eb610>
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26f52a32-2f60-544a-bae7-ddb2686519aa/26f52a32-2f60-544a-bae7-ddb2686519aa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa127175131e043efb75e804a0e6dd5b5.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a127175131e043efb75e804a0e6dd5b5.jpg saved to cache
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26f52a32-2f60-544a-bae7-ddb2686519aa
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26f52a32-2f60-544a-bae7-ddb2686519aa sending to next pipeline
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51ec77d0>
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0edf35a8-56c7-50d9-a3cf-5bcde8906544/0edf35a8-56c7-50d9-a3cf-5bcde8906544_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4fd58a523ca422484c7e5b504eee6ce.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4fd58a523ca422484c7e5b504eee6ce.jpg saved to cache
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0edf35a8-56c7-50d9-a3cf-5bcde8906544
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0edf35a8-56c7-50d9-a3cf-5bcde8906544 sending to next pipeline
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51df0150>
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35f5db64-d67a-5199-8029-232c8801e5c0/35f5db64-d67a-5199-8029-232c8801e5c0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1770f937aeb2487788774555f994a8b7.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1770f937aeb2487788774555f994a8b7.jpg saved to cache
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35f5db64-d67a-5199-8029-232c8801e5c0
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35f5db64-d67a-5199-8029-232c8801e5c0 sending to next pipeline
2026-03-26 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3f47d7557ed04e1083ce0899e2c4ba88.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2 with identifier 202512128545090
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2
2026-03-26 11:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0c16a1ab0c934f50b83707dfb2ed030b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'THIS BLACK EDITION AUDI TT LOOKS REALLY NICE, GREAT '
                'CONDITION, NICE FEATURES AND ALSO COMES WITH THE COMFORT AND '
                'SOUND PACK AND THE TECHNOLOGY PACKAGE! \n'
                'IF YOU WOULD LIKE MORE DETAILS ABOUT THIS VEHICLE PLEASE GIVE '
                'US A CALL OR FEEL FREE TO COME AND TAKE A LOOK!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 316,
 'fuel_type': 'Petrol',
 'id': 'c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512128545090',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'TTS',
 'odometer': 21800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2/c6d1bae3-2ad5-5f2e-94b3-e1f81791a9b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264572,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c16a1ab0c934f50b83707dfb2ed030b.jpg',
             'Width': 2048}],
 'price': 32499,
 'price_includes_vat': True,
 'registration_date': '2021-06-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi TTS 2.0 TFSI Black Edition S Tronic quattro Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2021}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512128545090%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512128545090: {'created_time': 1774523463.344575, 'last_price_update_time': 1774523463.344583}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512128545090') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 26f52a32-2f60-544a-bae7-ddb2686519aa with identifier 202512048382153
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 26f52a32-2f60-544a-bae7-ddb2686519aa
2026-03-26 11:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a127175131e043efb75e804a0e6dd5b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 Tesla Model 3 Standard Range Plus offers an '
                'impressive electric driving experience with a substantial '
                'battery capacity of 53 kWh, providing a maximum range of 278 '
                'miles when new. This electric vehicle is equipped with a '
                'fixed panoramic glass roof, complete with a panoramic '
                'sunroof, and benefits from a Bluetooth connection for '
                'seamless audio and calls. Comfort is prioritised with 12 way '
                'power adjustable front and rear heated seats, ensuring a '
                'pleasant journey in all conditions, while the 2 zone climate '
                'control allows for personalised cabin temperatures. Parking '
                'is made easier with rear parking sensors, and the generous '
                'boot space offers ample room for luggage and shopping.\n'
                '\n'
                'Call us now to learn more or please come in to view!',
 'doors_number': 4,
 'engine_horse_power': 241,
 'fuel_type': 'Electric',
 'id': '26f52a32-2f60-544a-bae7-ddb2686519aa',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048382153',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 52000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26f52a32-2f60-544a-bae7-ddb2686519aa/26f52a32-2f60-544a-bae7-ddb2686519aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249894,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a127175131e043efb75e804a0e6dd5b5.jpg',
             'Width': 2048}],
 'price': 15699,
 'price_includes_vat': True,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus Auto RWD 4dr',
 'transmission': 'automatic',
 'trim': 'Standard Range Plus',
 'year': 2021}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048382153%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048382153: {'created_time': 1774523463.392418, 'last_price_update_time': 1774523463.392426}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048382153') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0edf35a8-56c7-50d9-a3cf-5bcde8906544 with identifier 202512108509022
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0edf35a8-56c7-50d9-a3cf-5bcde8906544
2026-03-26 11:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d4fd58a523ca422484c7e5b504eee6ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 Ford Fiesta ST-Line X offers a compelling blend of '
                'sporty design and advanced technology. Powered by an '
                'efficient 1.0L petrol engine and meeting Euro 6 emissions '
                'standards, this model is equipped with the desirable ST-Line '
                "X trim. Inside, you'll find the intuitive SYNC 3 system with "
                'navigation, seamlessly integrating Android Auto and Apple '
                'CarPlay for your convenience. The Ford Key Free System allows '
                'for effortless keyless entry and start, while the Electronic '
                'Automatic Temperature Control ensures a comfortable cabin '
                'environment. For added ease, a rear view camera provides '
                'parking assistance, and the Winter Pack includes heated seats '
                'and a heated steering wheel, perfect for colder journeys.\n'
                'This vehicle is in great condition and is nice to drive! '
                'Don’t wait to view it! Call us now with any questions!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '0edf35a8-56c7-50d9-a3cf-5bcde8906544',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512108509022',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 22900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0edf35a8-56c7-50d9-a3cf-5bcde8906544/0edf35a8-56c7-50d9-a3cf-5bcde8906544_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262191,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d4fd58a523ca422484c7e5b504eee6ce.jpg',
             'Width': 2048}],
 'price': 13999,
 'price_includes_vat': True,
 'registration_date': '2022-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost ST-Line X Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108509022%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512108509022: {'created_time': 1774523463.434894, 'last_price_update_time': 1774523463.434902}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512108509022') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 35f5db64-d67a-5199-8029-232c8801e5c0 with identifier 202512048380940
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 35f5db64-d67a-5199-8029-232c8801e5c0
2026-03-26 11:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1770f937aeb2487788774555f994a8b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 Tesla Model 3 Standard Range Plus presents an '
                'exceptional opportunity with its remarkably low mileage of '
                'just 28,800 miles. As an electric vehicle, it boasts a 53 kWh '
                'battery offering a maximum range of 278 miles when new. '
                'Charging is convenient, taking approximately 7 hours and 10 '
                'minutes at home with a 7kW charger, while rapid public '
                'charging can achieve 80% capacity in as little as 29 minutes. '
                'This Model 3 also comes equipped with a fixed panoramic glass '
                'roof, rear parking sensors with assistance, blind spot '
                'information system, and inductive charging mats for two '
                'smartphones. Adaptive cruise control further enhances the '
                'driving experience.\n'
                'Please give us a call if you would like to learn more about '
                'this vehicle, alternatively please pop in and see us!',
 'doors_number': 4,
 'engine_horse_power': 241,
 'fuel_type': 'Electric',
 'id': '35f5db64-d67a-5199-8029-232c8801e5c0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048380940',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 28800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35f5db64-d67a-5199-8029-232c8801e5c0/35f5db64-d67a-5199-8029-232c8801e5c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248418,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1770f937aeb2487788774555f994a8b7.jpg',
             'Width': 2048}],
 'price': 17499,
 'price_includes_vat': True,
 'registration_date': '2021-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus Auto RWD 4dr',
 'transmission': 'automatic',
 'trim': 'Standard Range Plus',
 'year': 2021}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048380940%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048380940: {'created_time': 1774523463.477447, 'last_price_update_time': 1774523463.477453}
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048380940') HTTP/1.1" 204 0
2026-03-26 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/11129ece28314db09bfcbe600b21e1bb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6b6ca290a18644adb5fdc454f4b9be23.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/710a2f2ea7c54febbb6ee632439b82cc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51df31d0>
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a0a3b35-8d6c-5f41-bee8-da1e43330443/2a0a3b35-8d6c-5f41-bee8-da1e43330443_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8c3a557545b413081da21a7222c54e5.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8c3a557545b413081da21a7222c54e5.jpg saved to cache
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a0a3b35-8d6c-5f41-bee8-da1e43330443
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a0a3b35-8d6c-5f41-bee8-da1e43330443 sending to next pipeline
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Page: 14/16, total results: 304
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107774474%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511107774474: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107774424%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511107774424: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511077740601%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511077740601: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511077740486%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511077740486: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511067692150%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511067692150: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511067692082%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511067692082: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511067691588%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511067691588: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510307538512%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510307538512: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510287469626%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510287469626: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510287468420%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510287468420: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247391091%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510247391091: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247389520%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510247389520: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247389257%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510247389257: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247388541%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510247388541: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247387976%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510247387976: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247387851%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510247387851: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247387521%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510247387521: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510026831892%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510026831892: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306742763%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509306742763: 1
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509196467734%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509196467734: 1
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:11:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c2c2bf-9dd1-56f4-a987-7b32fa147d13 with identifier: 202511268158165
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f6c2c2bf-9dd1-56f4-a987-7b32fa147d13
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24c2be9798634ae0bd5bbd42758bcc3b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24c2be9798634ae0bd5bbd42758bcc3b.jpg not downloaded yet
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514a9e50>
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3a19b25-c5b8-58ff-92af-9a56119b59aa/e3a19b25-c5b8-58ff-92af-9a56119b59aa_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7f026ad6ea6f4be499445bcc686add0d.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7f026ad6ea6f4be499445bcc686add0d.jpg saved to cache
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3a19b25-c5b8-58ff-92af-9a56119b59aa
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3a19b25-c5b8-58ff-92af-9a56119b59aa sending to next pipeline
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2a0a3b35-8d6c-5f41-bee8-da1e43330443 with identifier 202512108508040
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2a0a3b35-8d6c-5f41-bee8-da1e43330443
2026-03-26 11:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a8c3a557545b413081da21a7222c54e5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'White',
 'currency': 'GBP',
 'description': 'THIS FORD PUMA HAS JUST ARRIVED AND COMES WITH 19”ALLOYS, THE '
                'DRIVERS ASSISTANCE PACKAGE AND THE SYNC3 MEDIA SYSTEM WITH '
                'BANG & OLUFSEN SPEAKERS! THIS VEHICLE IS IN GOOD CONDITION '
                'AND FUN TO DRIVE! CALL OUR SALES TEAM NOW FOR MORE '
                'INFORMATION!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': '2a0a3b35-8d6c-5f41-bee8-da1e43330443',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512108508040',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 48500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0a3b35-8d6c-5f41-bee8-da1e43330443/2a0a3b35-8d6c-5f41-bee8-da1e43330443_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262246,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a8c3a557545b413081da21a7222c54e5.jpg',
             'Width': 2048}],
 'price': 15299,
 'price_includes_vat': True,
 'registration_date': '2021-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2021}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108508040%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512108508040: {'created_time': 1774523464.050097, 'last_price_update_time': 1774523464.050108}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512108508040') HTTP/1.1" 204 0
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e3a19b25-c5b8-58ff-92af-9a56119b59aa with identifier 202512108507825
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e3a19b25-c5b8-58ff-92af-9a56119b59aa
2026-03-26 11:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7f026ad6ea6f4be499445bcc686add0d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2022 Tesla Model Y Long Range offers an exceptional '
                'electric driving experience with its impressive 331 mile '
                'maximum range. As a Four Wheel Drive electric vehicle, it '
                'combines efficiency with performance. This model comes '
                'equipped with 20 inch Induction alloy wheels, keyless entry '
                'and driving, heated front and rear seats, and a heated '
                'steering wheel, ensuring comfort in all conditions.\n'
                '\n'
                'The Model Y Long Range stands out with its remarkable '
                'acceleration, achieving 0 to 60 miles per hour in just 4.8 '
                'seconds, demonstrating its dynamic capabilities. Its 85 kWh '
                'battery can be fully charged at home in approximately 12 '
                'hours using a 7kW charger, or rapidly charged to 80% in as '
                'little as 25 minutes at a public charging station. '
                'Furthermore, this vehicle boasts a generous boot space, '
                'making it a practical choice for everyday use and longer '
                'journeys.\n'
                '\n'
                'Call our sales team now for more information!',
 'doors_number': 5,
 'engine_horse_power': 384,
 'fuel_type': 'Electric',
 'id': 'e3a19b25-c5b8-58ff-92af-9a56119b59aa',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512108507825',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 54600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3a19b25-c5b8-58ff-92af-9a56119b59aa/e3a19b25-c5b8-58ff-92af-9a56119b59aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270036,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7f026ad6ea6f4be499445bcc686add0d.jpg',
             'Width': 2048}],
 'price': 22499,
 'price_includes_vat': True,
 'registration_date': '2022-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y (Dual Motor) Long Range Auto 4WDE 5dr',
 'transmission': 'automatic',
 'trim': 'Long Range',
 'year': 2022}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108507825%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512108507825: {'created_time': 1774523464.448568, 'last_price_update_time': 1774523464.448576}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512108507825') HTTP/1.1" 204 0
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e56d0a28-6557-5299-a079-fe8a78f6472b with identifier: 202511268157994
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e56d0a28-6557-5299-a079-fe8a78f6472b
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2fb2045b0d24384a05a271a430d6927.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2fb2045b0d24384a05a271a430d6927.jpg not downloaded yet
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e96490>
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe8461b3-e56e-5538-b6cc-afbbe799b4f7/fe8461b3-e56e-5538-b6cc-afbbe799b4f7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3f47d7557ed04e1083ce0899e2c4ba88.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3f47d7557ed04e1083ce0899e2c4ba88.jpg saved to cache
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe8461b3-e56e-5538-b6cc-afbbe799b4f7
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe8461b3-e56e-5538-b6cc-afbbe799b4f7 sending to next pipeline
2026-03-26 11:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9f377849e93b4472bf1f697b895dd8c6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fe8461b3-e56e-5538-b6cc-afbbe799b4f7 with identifier 202512048380417
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fe8461b3-e56e-5538-b6cc-afbbe799b4f7
2026-03-26 11:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3f47d7557ed04e1083ce0899e2c4ba88.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 Kia EV6 GT Line presents an exceptional opportunity '
                'with remarkably low mileage for its age, having covered just '
                '20,000 miles. As a fully electric vehicle, it boasts a '
                'substantial 77 kWh battery, offering a maximum range of 328 '
                'miles when new. This GT Line trim level comes equipped with a '
                'suite of desirable features, including front parking sensors '
                'with parking assistance, a heated steering wheel for added '
                "comfort, and a driver's power adjustable seat with memory "
                'function, complemented by a front passenger power seat with '
                'electric lumbar support. The convenience continues with '
                'automatic headlight control and a reversing camera system '
                'featuring dynamic guidelines for easier parking.\n'
                'Great condition and available now for your viewing! Please '
                'call us to learn more!',
 'doors_number': 5,
 'engine_horse_power': 225,
 'fuel_type': 'Electric',
 'id': 'fe8461b3-e56e-5538-b6cc-afbbe799b4f7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512048380417',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 20000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe8461b3-e56e-5538-b6cc-afbbe799b4f7/fe8461b3-e56e-5538-b6cc-afbbe799b4f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256860,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3f47d7557ed04e1083ce0899e2c4ba88.jpg',
             'Width': 2048}],
 'price': 22999,
 'price_includes_vat': True,
 'registration_date': '2022-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA EV6 77.4kWh GT-Line Auto 5dr',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2022}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512048380417%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512048380417: {'created_time': 1774523464.593431, 'last_price_update_time': 1774523464.593438}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512048380417') HTTP/1.1" 204 0
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Getting next page: 15
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 15
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b28595-d271-5c54-8620-f0e85045207e with identifier: 202511268155435
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b3b28595-d271-5c54-8620-f0e85045207e
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49af276fa7584d938ddd3febbb00495b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49af276fa7584d938ddd3febbb00495b.jpg not downloaded yet
2026-03-26 11:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e7fcd0>
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f90cb5fb-5ab2-5e35-8558-02a067cdf7b1/f90cb5fb-5ab2-5e35-8558-02a067cdf7b1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11129ece28314db09bfcbe600b21e1bb.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11129ece28314db09bfcbe600b21e1bb.jpg saved to cache
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f90cb5fb-5ab2-5e35-8558-02a067cdf7b1
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f90cb5fb-5ab2-5e35-8558-02a067cdf7b1 sending to next pipeline
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f2ad10>
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a8eadc-34d2-55f5-ad5e-fc01e91ed03e/69a8eadc-34d2-55f5-ad5e-fc01e91ed03e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b6ca290a18644adb5fdc454f4b9be23.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b6ca290a18644adb5fdc454f4b9be23.jpg saved to cache
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69a8eadc-34d2-55f5-ad5e-fc01e91ed03e
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69a8eadc-34d2-55f5-ad5e-fc01e91ed03e sending to next pipeline
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121dcd0>
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c493824-d60c-5562-868a-f360f25afe35/1c493824-d60c-5562-868a-f360f25afe35_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F710a2f2ea7c54febbb6ee632439b82cc.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/710a2f2ea7c54febbb6ee632439b82cc.jpg saved to cache
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c493824-d60c-5562-868a-f360f25afe35
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c493824-d60c-5562-868a-f360f25afe35 sending to next pipeline
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13 with identifier: 202511268154334
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F41785ae2381d41a3945e570e2f39a019.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/41785ae2381d41a3945e570e2f39a019.jpg not downloaded yet
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f90cb5fb-5ab2-5e35-8558-02a067cdf7b1 with identifier 202512038314585
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f90cb5fb-5ab2-5e35-8558-02a067cdf7b1
2026-03-26 11:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/11129ece28314db09bfcbe600b21e1bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2023 Ford Focus T Active offers a superb blend of style '
                'and practicality, making it an excellent choice for any '
                'driver.  As a Euro 6 compliant model, it features a '
                'responsive 1.0 litre petrol engine and benefits from the '
                'Active trim level, enhancing its already impressive design.  '
                "You'll appreciate the convenience of automatic on-off "
                'headlights and the ease of parking with front and rear '
                'sensors.  Inside, the DEATC dual-zone electronic automatic '
                'temperature control ensures comfort for everyone, while the '
                'Ford SYNC4 navigation system with its 13.2 inch touchscreen '
                'seamlessly integrates Android Auto and Apple CarPlay.  The '
                'Ford Key Free system allows for effortless keyless entry and '
                'start, adding to the overall user-friendly experience.\n'
                '\n'
                'The Ford Focus T Active stands out with its generous boot '
                'space, providing ample room for shopping, luggage, or sports '
                'equipment. Its performance is equally noteworthy, achieving '
                '0-62mph in just 10.2 seconds, demonstrating a lively '
                'acceleration that makes driving enjoyable. These highlights, '
                'combined with its advanced technology and comfortable '
                'interior, position this Focus T Active as a superior option '
                'compared to other vehicles in its class, offering a well '
                'rounded and satisfying ownership experience.\n'
                '\n'
                'Call our sales team now to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': 'f90cb5fb-5ab2-5e35-8558-02a067cdf7b1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512038314585',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 20000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90cb5fb-5ab2-5e35-8558-02a067cdf7b1/f90cb5fb-5ab2-5e35-8558-02a067cdf7b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263444,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/11129ece28314db09bfcbe600b21e1bb.jpg',
             'Width': 2048}],
 'price': 15299,
 'price_includes_vat': True,
 'registration_date': '2023-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0T EcoBoost Active Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2023}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512038314585%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512038314585: {'created_time': 1774523464.837267, 'last_price_update_time': 1774523464.837275}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512038314585') HTTP/1.1" 204 0
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 69a8eadc-34d2-55f5-ad5e-fc01e91ed03e with identifier 202512108503036
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 69a8eadc-34d2-55f5-ad5e-fc01e91ed03e
2026-03-26 11:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6b6ca290a18644adb5fdc454f4b9be23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'INCREDIBLE BMW X5 JUST ARRIVED WITH SOME FANTASTIC OPTIONS '
                'INCLUDING THE SKY LOUNGE PANORAMIC ROOF, 22” ALLOY WHEEL '
                'UPGRADE, COMFORT PACK, M-SPORT PRO PACK AND FULL VERNASCA '
                'LEATHER SEATS WITH HEATED FRONT AND OUTER REAR AND A HEATED '
                'STEERING WHEEL! GIVE US A CALL NOW TO LEARN MORE!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 282,
 'fuel_type': 'Diesel Hybrid',
 'id': '69a8eadc-34d2-55f5-ad5e-fc01e91ed03e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512108503036',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 27800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a8eadc-34d2-55f5-ad5e-fc01e91ed03e/69a8eadc-34d2-55f5-ad5e-fc01e91ed03e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237338,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b6ca290a18644adb5fdc454f4b9be23.jpg',
             'Width': 2048}],
 'price': 47999,
 'price_includes_vat': True,
 'registration_date': '2022-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0 30d MHT M Sport Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512108503036%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512108503036: {'created_time': 1774523464.885909, 'last_price_update_time': 1774523464.885916}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512108503036') HTTP/1.1" 204 0
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1c493824-d60c-5562-868a-f360f25afe35 with identifier 202511288198174
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1c493824-d60c-5562-868a-f360f25afe35
2026-03-26 11:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/710a2f2ea7c54febbb6ee632439b82cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma ST offers an exhilarating driving '
                'experience with its potent 1.5L EcoBoost petrol engine, '
                'capable of reaching 0-62mph in a swift 6.7 seconds. As a Euro '
                '6 compliant vehicle, it meets stringent emission standards. '
                'This ST trim model comes equipped with a suite of advanced '
                "features designed for both convenience and comfort. You'll "
                'find front and rear parking sensors to aid manoeuvrability, '
                'complemented by a parking assistance system. Inside, the '
                'cabin boasts a wireless charging pad and electronic air '
                'temperature control for effortless device charging and '
                'personalised climate settings. Entertainment and connectivity '
                'are elevated by the B&O Premium Audio System and Ford SYNC 3 '
                'Navigation, which includes Android Auto, Apple CarPlay, and '
                'Bluetooth for seamless integration of your digital life.\n'
                '\n'
                'The Winter Pack ensures comfort in colder conditions with '
                'heated seats and a heated steering wheel. These carefully '
                'selected features demonstrate how this Ford Puma ST stands '
                'out from similar vehicles, offering a superior blend of '
                'performance, technology, and driver focused amenities. Its '
                'dynamic capabilities, combined with the premium sound system '
                'and advanced navigation, make every journey engaging and '
                'enjoyable.\n'
                '\n'
                'Call us now to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': '1c493824-d60c-5562-868a-f360f25afe35',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511288198174',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 18700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c493824-d60c-5562-868a-f360f25afe35/1c493824-d60c-5562-868a-f360f25afe35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251816,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/710a2f2ea7c54febbb6ee632439b82cc.jpg',
             'Width': 2048}],
 'price': 18499,
 'price_includes_vat': True,
 'registration_date': '2023-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2023}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511288198174%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511288198174: {'created_time': 1774523464.933059, 'last_price_update_time': 1774523464.933066}
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511288198174') HTTP/1.1" 204 0
2026-03-26 11:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 75b31c8d-8478-5498-b1ef-f1e57be02afc with identifier: 202511268153803
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 75b31c8d-8478-5498-b1ef-f1e57be02afc
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b1e51a71ca248848d4bbc2eb9651a52.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b1e51a71ca248848d4bbc2eb9651a52.jpg not downloaded yet
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58180c50>
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6761ae-5d96-59d8-ac48-76a319b8322e/cc6761ae-5d96-59d8-ac48-76a319b8322e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f377849e93b4472bf1f697b895dd8c6.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f377849e93b4472bf1f697b895dd8c6.jpg saved to cache
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc6761ae-5d96-59d8-ac48-76a319b8322e
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc6761ae-5d96-59d8-ac48-76a319b8322e sending to next pipeline
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:05 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e08a63d0-5d79-5386-8523-3728f5624ba1 with identifier: 202511208026553
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e08a63d0-5d79-5386-8523-3728f5624ba1
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0cfcdc9eb394ad69b7409a422b14cbe.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0cfcdc9eb394ad69b7409a422b14cbe.jpg not downloaded yet
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cc6761ae-5d96-59d8-ac48-76a319b8322e with identifier 202511288198053
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cc6761ae-5d96-59d8-ac48-76a319b8322e
2026-03-26 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9f377849e93b4472bf1f697b895dd8c6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'White',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': 'cc6761ae-5d96-59d8-ac48-76a319b8322e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511288198053',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 22300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6761ae-5d96-59d8-ac48-76a319b8322e/cc6761ae-5d96-59d8-ac48-76a319b8322e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278808,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f377849e93b4472bf1f697b895dd8c6.jpg',
             'Width': 2048}],
 'price': 18499,
 'price_includes_vat': True,
 'registration_date': '2020-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBlue ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2020}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511288198053%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511288198053: {'created_time': 1774523465.153333, 'last_price_update_time': 1774523465.153347}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511288198053') HTTP/1.1" 204 0
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/24c2be9798634ae0bd5bbd42758bcc3b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:05 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c6cbd967-0320-5e9f-b291-d390199b47e8 with identifier: 202511198004797
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c6cbd967-0320-5e9f-b291-d390199b47e8
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84eac832d53640d2afcb980b252cd2c5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84eac832d53640d2afcb980b252cd2c5.jpg not downloaded yet
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f2fb2045b0d24384a05a271a430d6927.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:05 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4 with identifier: 202511197997409
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97f7fc460a7f4c6bba6433330e668bcb.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97f7fc460a7f4c6bba6433330e668bcb.jpg not downloaded yet
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/49af276fa7584d938ddd3febbb00495b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:05 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 80a6e274-8415-5e4a-b0da-2f9b6e8e3601 with identifier: 202511197997307
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 80a6e274-8415-5e4a-b0da-2f9b6e8e3601
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9bf19caa8e448b483596319a419a595.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9bf19caa8e448b483596319a419a595.jpg not downloaded yet
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:05 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8 with identifier: 202511187975997
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F993f60b9cc0649d8b4258a7085e0f7a5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/993f60b9cc0649d8b4258a7085e0f7a5.jpg not downloaded yet
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58dc0690>
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6c2c2bf-9dd1-56f4-a987-7b32fa147d13/f6c2c2bf-9dd1-56f4-a987-7b32fa147d13_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24c2be9798634ae0bd5bbd42758bcc3b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24c2be9798634ae0bd5bbd42758bcc3b.jpg saved to cache
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6c2c2bf-9dd1-56f4-a987-7b32fa147d13
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6c2c2bf-9dd1-56f4-a987-7b32fa147d13 sending to next pipeline
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f6c2c2bf-9dd1-56f4-a987-7b32fa147d13 with identifier 202511268158165
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f6c2c2bf-9dd1-56f4-a987-7b32fa147d13
2026-03-26 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/24c2be9798634ae0bd5bbd42758bcc3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Mercedes Benz CLA180 AMG Line (Premium 2) offers a '
                'refined driving experience with its 1.3 litre petrol engine '
                'and Euro 6 emissions class. As an AMG Line model, it boasts a '
                'sporty aesthetic and comes equipped with THERMOTRONIC luxury '
                'automatic climate control for personalised comfort, keyless '
                'entry for effortless access, and automatic headlamp '
                'activation for convenience. The Parking Package, including '
                'front and rear sensors along with a rear camera, makes '
                'manoeuvring simple, while heated front seats ensure a warm '
                'welcome on colder days.\n'
                '\n'
                'Call us now to arrange your viewing!',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': 'f6c2c2bf-9dd1-56f4-a987-7b32fa147d13',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268158165',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'CLA',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6c2c2bf-9dd1-56f4-a987-7b32fa147d13/f6c2c2bf-9dd1-56f4-a987-7b32fa147d13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264502,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/24c2be9798634ae0bd5bbd42758bcc3b.jpg',
             'Width': 2048}],
 'price': 18799,
 'price_includes_vat': True,
 'registration_date': '2021-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA 1.3 CLA180 AMG Line (Premium 2) Coupe 7G-DCT Euro '
          '6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268158165%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268158165: {'created_time': 1774523465.38945, 'last_price_update_time': 1774523465.389458}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268158165') HTTP/1.1" 204 0
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6b1e51a71ca248848d4bbc2eb9651a52.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5148dc50>
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56d0a28-6557-5299-a079-fe8a78f6472b/e56d0a28-6557-5299-a079-fe8a78f6472b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff2fb2045b0d24384a05a271a430d6927.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f2fb2045b0d24384a05a271a430d6927.jpg saved to cache
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e56d0a28-6557-5299-a079-fe8a78f6472b
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e56d0a28-6557-5299-a079-fe8a78f6472b sending to next pipeline
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51299610>
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b28595-d271-5c54-8620-f0e85045207e/b3b28595-d271-5c54-8620-f0e85045207e_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F49af276fa7584d938ddd3febbb00495b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/49af276fa7584d938ddd3febbb00495b.jpg saved to cache
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3b28595-d271-5c54-8620-f0e85045207e
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3b28595-d271-5c54-8620-f0e85045207e sending to next pipeline
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f9bf19caa8e448b483596319a419a595.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e56d0a28-6557-5299-a079-fe8a78f6472b with identifier 202511268157994
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e56d0a28-6557-5299-a079-fe8a78f6472b
2026-03-26 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f2fb2045b0d24384a05a271a430d6927.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gold',
 'currency': 'GBP',
 'description': 'Discover this 2021 Hyundai IONIQ 5 Ultimate, an electric '
                'vehicle designed for modern driving. This model boasts a '
                'substantial 73 kWh battery, offering a maximum range of 280 '
                'miles when new, ensuring you can travel further on a single '
                'charge. Enjoy the convenience of home charging, with a full '
                'charge taking approximately 10 hours and 53 minutes using a '
                '7kW charger. For rapid top ups, this IONIQ 5 can reach 80% '
                'charge in as little as 17 minutes at a compatible public '
                "charging station. Inside, you'll find a host of premium "
                'features including heated front seats, a heated steering '
                'wheel for those colder days, and dual zone climate control '
                'for personalised comfort. Stay connected and entertained with '
                'Bluetooth connectivity and voice recognition, while the Head '
                'Up Display keeps essential information clearly visible.\n'
                '\n'
                'The Hyundai IONIQ 5 Ultimate stands out with its impressive '
                'performance, accelerating from 0 to 62mph in just 7.4 '
                'seconds, demonstrating its responsive power. This electric '
                'car also offers generous practicality, highlighted by its '
                'large boot space, perfect for luggage or shopping. The 280 '
                'mile range at new is a significant advantage, providing peace '
                'of mind for longer journeys and reducing the need for '
                'frequent charging stops compared to many other electric '
                'vehicles.\n'
                '\n'
                'Available now to view, please call us to learn more!',
 'doors_number': 5,
 'engine_horse_power': 214,
 'fuel_type': 'Electric',
 'id': 'e56d0a28-6557-5299-a079-fe8a78f6472b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268157994',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'IONIQ 5',
 'odometer': 33900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56d0a28-6557-5299-a079-fe8a78f6472b/e56d0a28-6557-5299-a079-fe8a78f6472b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241408,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f2fb2045b0d24384a05a271a430d6927.jpg',
             'Width': 2048}],
 'price': 18499,
 'price_includes_vat': True,
 'registration_date': '2021-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai IONIQ 5 73kWh Ultimate Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2021}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268157994%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268157994: {'created_time': 1774523465.585754, 'last_price_update_time': 1774523465.585763}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268157994') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b3b28595-d271-5c54-8620-f0e85045207e with identifier 202511268155435
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b3b28595-d271-5c54-8620-f0e85045207e
2026-03-26 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/49af276fa7584d938ddd3febbb00495b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2019 MINI Convertible John Cooper Works is a rare find, '
                'boasting exceptionally low mileage for its age at just 17,900 '
                'miles. This particular example is a Euro 6 compliant 2.0 '
                'litre petrol model, finished in the sporty John Cooper Works '
                'trim. It comes equipped with the desirable Navigation Plus '
                'Pack, which includes Apple CarPlay for seamless smartphone '
                'integration, and a MINI Head Up Display to keep essential '
                'information in your line of sight. Comfort is also a '
                'priority, thanks to the Comfort Plus Pack, offering climate '
                'control, heated seats, and comprehensive parking assistance '
                'with front and rear sensors, as well as a rear camera. The '
                'Adaptive Suspension ensures a refined driving experience, '
                'further enhanced by the standard rear Park Distance Control.\n'
                '\n'
                'Experience exhilarating performance with this MINI '
                'Convertible, capable of accelerating from 0 to 62 miles per '
                'hour in a swift 6.5 seconds, demonstrating its sporty '
                'credentials. Its low CO2 emissions are a notable advantage, '
                'indicating a more environmentally conscious choice compared '
                'to many similar vehicles. This combination of thrilling '
                'performance, advanced technology, and thoughtful comfort '
                'features makes this 2019 MINI Convertible John Cooper Works a '
                'compelling option for those seeking a stylish and engaging '
                'driving experience.\n'
                '\n'
                'On site and available to view! Call for more details!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 228,
 'fuel_type': 'Petrol',
 'id': 'b3b28595-d271-5c54-8620-f0e85045207e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268155435',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Convertible',
 'odometer': 17900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b28595-d271-5c54-8620-f0e85045207e/b3b28595-d271-5c54-8620-f0e85045207e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 266048,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/49af276fa7584d938ddd3febbb00495b.jpg',
             'Width': 2048}],
 'price': 20499,
 'price_includes_vat': True,
 'registration_date': '2019-12-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Convertible 2.0 John Cooper Works Steptronic Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'John Cooper Works',
 'year': 2019}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268155435%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268155435: {'created_time': 1774523465.628289, 'last_price_update_time': 1774523465.628296}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268155435') HTTP/1.1" 204 0
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e0cfcdc9eb394ad69b7409a422b14cbe.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/993f60b9cc0649d8b4258a7085e0f7a5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/41785ae2381d41a3945e570e2f39a019.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/97f7fc460a7f4c6bba6433330e668bcb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/84eac832d53640d2afcb980b252cd2c5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5129a010>
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75b31c8d-8478-5498-b1ef-f1e57be02afc/75b31c8d-8478-5498-b1ef-f1e57be02afc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6b1e51a71ca248848d4bbc2eb9651a52.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6b1e51a71ca248848d4bbc2eb9651a52.jpg saved to cache
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75b31c8d-8478-5498-b1ef-f1e57be02afc
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75b31c8d-8478-5498-b1ef-f1e57be02afc sending to next pipeline
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 75b31c8d-8478-5498-b1ef-f1e57be02afc with identifier 202511268153803
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 75b31c8d-8478-5498-b1ef-f1e57be02afc
2026-03-26 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6b1e51a71ca248848d4bbc2eb9651a52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Huge spec including Sky Lounge Panoramic roof, 22" Alloys, M '
                'Sport Pro pack, Tech pack, Comfort pack, Visibility pack, '
                'Laser lights, Perforated leather and Sun Protection Glazing!\n'
                '\n'
                'This vehicle is loaded with options and in excellent '
                'condition! \n'
                'If you want comfort, space and luxury, this vehicle is for '
                'you! Call our sales team now to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 282,
 'fuel_type': 'Diesel Hybrid',
 'id': '75b31c8d-8478-5498-b1ef-f1e57be02afc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268153803',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 41300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75b31c8d-8478-5498-b1ef-f1e57be02afc/75b31c8d-8478-5498-b1ef-f1e57be02afc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237839,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6b1e51a71ca248848d4bbc2eb9651a52.jpg',
             'Width': 2048}],
 'price': 42299,
 'price_includes_vat': True,
 'registration_date': '2020-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0 30d MHT M Sport Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268153803%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268153803: {'created_time': 1774523465.716683, 'last_price_update_time': 1774523465.716692}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268153803') HTTP/1.1" 204 0
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51df6ed0>
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80a6e274-8415-5e4a-b0da-2f9b6e8e3601/80a6e274-8415-5e4a-b0da-2f9b6e8e3601_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9bf19caa8e448b483596319a419a595.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9bf19caa8e448b483596319a419a595.jpg saved to cache
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80a6e274-8415-5e4a-b0da-2f9b6e8e3601
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80a6e274-8415-5e4a-b0da-2f9b6e8e3601 sending to next pipeline
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 80a6e274-8415-5e4a-b0da-2f9b6e8e3601 with identifier 202511197997307
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 80a6e274-8415-5e4a-b0da-2f9b6e8e3601
2026-03-26 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f9bf19caa8e448b483596319a419a595.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 Audi A3 TFSI S line boasts exceptionally low '
                'mileage for its age, having covered just 16,800 miles. This '
                'premium hatchback features a 1.0 litre petrol engine and '
                "meets Euro 6 emissions standards. Inside, you'll find the S "
                'line trim offering a refined experience, enhanced by Dual '
                'Zone Electronic Climate Control for personalised comfort. '
                'Navigating and staying connected is effortless with the Audi '
                'Smartphone Interface, which includes Apple CarPlay, and the '
                'Bluetooth Interface for seamless phone integration. For '
                'convenience and safety, it is equipped with a Light and Rain '
                'Sensor that automatically activates the headlights, and Rear '
                'Parking Sensors to assist with manoeuvring.\n'
                '\n'
                'The Audi A3 TFSI S line offers impressive efficiency, '
                'achieving a fuel economy of 52 miles per gallon, which is a '
                'notable advantage over many similar vehicles. Its '
                'acceleration from 0 to 62 miles per hour in 10.6 seconds '
                'provides a responsive driving experience. Furthermore, this '
                'model provides generous boot space, making it a practical '
                'choice for everyday use and longer journeys. These highlights '
                'demonstrate how this particular Audi A3 stands out, offering '
                'a compelling combination of performance, economy, and '
                'practicality.\n'
                '\n'
                'This vehicle is in great condition and is available now for '
                'viewing, call us to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '80a6e274-8415-5e4a-b0da-2f9b6e8e3601',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511197997307',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 16800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80a6e274-8415-5e4a-b0da-2f9b6e8e3601/80a6e274-8415-5e4a-b0da-2f9b6e8e3601_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265762,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9bf19caa8e448b483596319a419a595.jpg',
             'Width': 2048}],
 'price': 19999,
 'price_includes_vat': True,
 'registration_date': '2021-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.0 TFSI 30 S line Sportback S Tronic Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511197997307%27 HTTP/1.1" 200 None
2026-03-26 11:11:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511197997307: {'created_time': 1774523465.811161, 'last_price_update_time': 1774523465.811169}
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511197997307') HTTP/1.1" 204 0
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d90d10>
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e08a63d0-5d79-5386-8523-3728f5624ba1/e08a63d0-5d79-5386-8523-3728f5624ba1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0cfcdc9eb394ad69b7409a422b14cbe.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0cfcdc9eb394ad69b7409a422b14cbe.jpg saved to cache
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e08a63d0-5d79-5386-8523-3728f5624ba1
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e08a63d0-5d79-5386-8523-3728f5624ba1 sending to next pipeline
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52fd9050>
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8/137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F993f60b9cc0649d8b4258a7085e0f7a5.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/993f60b9cc0649d8b4258a7085e0f7a5.jpg saved to cache
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8
2026-03-26 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8 sending to next pipeline
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121d9d0>
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13/c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F41785ae2381d41a3945e570e2f39a019.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/41785ae2381d41a3945e570e2f39a019.jpg saved to cache
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13 sending to next pipeline
2026-03-26 11:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51422fd0>
2026-03-26 11:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4/a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F97f7fc460a7f4c6bba6433330e668bcb.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/97f7fc460a7f4c6bba6433330e668bcb.jpg saved to cache
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4 sending to next pipeline
2026-03-26 11:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5128a3d0>
2026-03-26 11:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6cbd967-0320-5e9f-b291-d390199b47e8/c6cbd967-0320-5e9f-b291-d390199b47e8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84eac832d53640d2afcb980b252cd2c5.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84eac832d53640d2afcb980b252cd2c5.jpg saved to cache
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6cbd967-0320-5e9f-b291-d390199b47e8
2026-03-26 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6cbd967-0320-5e9f-b291-d390199b47e8 sending to next pipeline
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e08a63d0-5d79-5386-8523-3728f5624ba1 with identifier 202511208026553
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e08a63d0-5d79-5386-8523-3728f5624ba1
2026-03-26 11:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e0cfcdc9eb394ad69b7409a422b14cbe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2021 BMW 3 Series 330e M Sport Pro Edition boasts '
                'exceptionally low mileage for its age, having covered just '
                '50,000 miles. This four wheel drive plug in hybrid model '
                'features a 2.0 litre petrol engine and meets Euro 6 emissions '
                'standards. It comes equipped with Park Distance Control for '
                'both the front and rear, along with a Parking Assistant that '
                'includes front and rear sensors and a rear camera, making '
                "manoeuvring effortless. Inside, you'll find automatic three "
                'zone air conditioning for personalised comfort, and seamless '
                'connectivity is provided through Bluetooth hands free with '
                'USB audio interface, supporting both Android Auto and Apple '
                'CarPlay via the BMW Connected Package Professional.\n'
                '\n'
                'Experience impressive performance with this 330e M Sport Pro '
                'Edition, capable of accelerating from 0 to 62 miles per hour '
                'in a swift 5.9 seconds. This rapid acceleration, combined '
                'with its plug in hybrid technology and four wheel drive '
                'system, sets it apart from many other vehicles in its class. '
                'The M Sport Pro Edition trim signifies a higher '
                'specification, offering a more engaging driving experience '
                'and enhanced features that contribute to its superior appeal.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 288,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'e08a63d0-5d79-5386-8523-3728f5624ba1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511208026553',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '3 Series',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e08a63d0-5d79-5386-8523-3728f5624ba1/e08a63d0-5d79-5386-8523-3728f5624ba1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251269,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0cfcdc9eb394ad69b7409a422b14cbe.jpg',
             'Width': 2048}],
 'price': 23699,
 'price_includes_vat': True,
 'registration_date': '2021-01-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 Series 2.0 330e 12kWh M Sport Pro Edition Touring Auto xDrive '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport Pro Edition',
 'year': 2021}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208026553%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511208026553: {'created_time': 1774523466.259739, 'last_price_update_time': 1774523466.259749}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511208026553') HTTP/1.1" 204 0
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8 with identifier 202511187975997
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8
2026-03-26 11:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/993f60b9cc0649d8b4258a7085e0f7a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 305,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2025 Ford Transit presents an exceptional opportunity '
                'with an incredibly low mileage of just 1600 miles, making it '
                'virtually as new. This 2.0 410 EcoBlue Limited RWD L3 H2 Euro '
                '6 (s/s) 5dr model, featuring a powerful 163 bhp 2.0 litre '
                'diesel engine, has had only one owner since its registration. '
                'The Limited trim level ensures a refined experience, '
                'complemented by desirable features such as 16 inch alloy '
                'wheels and automatic air conditioning with climate control, '
                'all meeting the Euro 6 emission standards.\n'
                '\n'
                'The Transit 410 Limited stands out due to its remarkably low '
                'mileage for a vehicle of its age, indicating it has been used '
                'sparingly and maintained with care. Its low insurance group '
                'rating further enhances its appeal, suggesting lower running '
                'costs compared to similar vehicles. This combination of '
                'minimal use, single ownership, and practical features makes '
                'this Ford Transit a highly attractive and sensible choice for '
                'discerning buyers.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 163,
 'fuel_type': 'Diesel',
 'id': '137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511187975997',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 1600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 33,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8/137ef3c3-3b37-510c-ba96-dcf7ef0eb0e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 431880,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/993f60b9cc0649d8b4258a7085e0f7a5.jpg',
             'Width': 2048}],
 'price': 39599,
 'price_includes_vat': True,
 'registration_date': '2025-05-14',
 'seats_number': 15,
 'seller_name': None,
 'title': 'Ford Transit 2.0 410 EcoBlue Limited Minibus Double Cab 5dr Diesel '
          'Manual RWD L3 H2 Euro 6 (s/s) (14 Seat) (165 ps)',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2025}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511187975997%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511187975997: {'created_time': 1774523466.302286, 'last_price_update_time': 1774523466.302295}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511187975997') HTTP/1.1" 204 0
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13 with identifier 202511268154334
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13
2026-03-26 11:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/41785ae2381d41a3945e570e2f39a019.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'Discover this exceptional 2021 Nissan Juke DIG-T Tekna, '
                'boasting remarkably low mileage for its age at just 15,000 '
                'miles. This stylish Tekna trim Juke is powered by an '
                'efficient 1.0L Euro 6 petrol engine, offering a compelling '
                'blend of performance and economy. It comes equipped with '
                'Intelligent Key featuring a Start Push Button for effortless '
                'entry and ignition, alongside seamless integration for your '
                'smartphone with Android Auto and Apple CarPlay.\n'
                '\n'
                'Experience superior sound with the Bose Personal Plus Audio '
                'System, designed to immerse you in your favourite music. '
                'Maneuvering is made simple with front parking sensors, and '
                'you can maintain your ideal cabin temperature with the '
                'automatic air conditioning. This Juke also stands out with '
                'its impressive fuel economy, achieving up to 46 miles per '
                'gallon, and benefits from low CO2 emissions, indicating it is '
                'a more environmentally conscious choice compared to many '
                'similar vehicles.\n'
                '\n'
                'Call us now to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 112,
 'fuel_type': 'Petrol',
 'id': 'c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511268154334',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13/c1ed0937-b7f5-5d66-ac51-b7ef5a6dfd13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264809,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/41785ae2381d41a3945e570e2f39a019.jpg',
             'Width': 2048}],
 'price': 13799,
 'price_includes_vat': True,
 'registration_date': '2021-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T Tekna Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2021}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511268154334%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511268154334: {'created_time': 1774523466.348126, 'last_price_update_time': 1774523466.348133}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511268154334') HTTP/1.1" 204 0
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4 with identifier 202511197997409
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4
2026-03-26 11:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/97f7fc460a7f4c6bba6433330e668bcb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'Silver',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 242,
 'fuel_type': 'Diesel',
 'id': 'a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511197997409',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'GLC',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4/a4ce45d9-e2d2-5e3e-adca-d7206d56d8d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258822,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/97f7fc460a7f4c6bba6433330e668bcb.jpg',
             'Width': 2048}],
 'price': 23999,
 'price_includes_vat': True,
 'registration_date': '2020-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC 2.0 GLC300d AMG Line (Premium) G-Tronic+ 4MATIC '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511197997409%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511197997409: {'created_time': 1774523466.390162, 'last_price_update_time': 1774523466.390169}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511197997409') HTTP/1.1" 204 0
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c6cbd967-0320-5e9f-b291-d390199b47e8 with identifier 202511198004797
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c6cbd967-0320-5e9f-b291-d390199b47e8
2026-03-26 11:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/84eac832d53640d2afcb980b252cd2c5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'Discover this 2023 Skoda Octavia TDI vRS, a sophisticated '
                'vehicle offering an impressive blend of performance and '
                'practicality. This Euro 6 compliant model boasts a powerful '
                '2.0 litre diesel engine, delivering a swift 0-60mph '
                'acceleration in just 7.2 seconds. Experience the open road '
                'with the expansive panoramic sunroof, and enjoy seamless '
                'connectivity through Smartlink, which includes Android Auto '
                'and MirrorLink, alongside Wireless Smartlink for Apple '
                'CarPlay. The convenience of keyless entry and start stop, '
                'extending to the rear doors, enhances your driving '
                'experience, while the full Matrix LED headlights with '
                'Adaptive Front Light System ensure excellent visibility in '
                'all conditions.\n'
                '\n'
                'This Octavia vRS stands out with its exceptionally large boot '
                'space, providing ample room for all your luggage and shopping '
                'needs. The combination of its dynamic acceleration, advanced '
                'lighting technology, and integrated smart connectivity '
                'features demonstrates how this vehicle offers a superior '
                'driving experience compared to others in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 242,
 'fuel_type': 'Diesel',
 'id': 'c6cbd967-0320-5e9f-b291-d390199b47e8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511198004797',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 41400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6cbd967-0320-5e9f-b291-d390199b47e8/c6cbd967-0320-5e9f-b291-d390199b47e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259986,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/84eac832d53640d2afcb980b252cd2c5.jpg',
             'Width': 2048}],
 'price': 24999,
 'price_includes_vat': True,
 'registration_date': '2023-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Octavia 2.0 TDI vRS Estate 5dr Diesel DSG Euro 6 (s/s) (200 '
          'ps)',
 'transmission': 'automatic',
 'trim': 'vRS',
 'year': 2023}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511198004797%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511198004797: {'created_time': 1774523466.442421, 'last_price_update_time': 1774523466.442429}
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511198004797') HTTP/1.1" 204 0
2026-03-26 11:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Page: 15/16, total results: 304
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116245202%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509116245202: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116244569%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509116244569: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509086139119%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509086139119: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509056069302%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509056069302: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509036011291%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509036011291: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509036010711%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509036010711: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509036009529%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509036009529: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509015942475%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509015942475: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508275782157%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508275782157: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508265760554%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508265760554: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508215632964%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508215632964: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508075225289%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508075225289: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508075215738%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508075215738: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508015050524%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508015050524: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507024081007%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202507024081007: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506304004357%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506304004357: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506303996691%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506303996691: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506253847597%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506253847597: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506233778379%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506233778379: 1
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506173586080%27 HTTP/1.1" 200 None
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506173586080: 1
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-26 11:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Getting next page: 16
2026-03-26 11:11:06 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 247, page: 16
2026-03-26 11:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 62966234-b4d3-52e5-9ee0-dd4c8e4209dc with identifier: 202510247391091
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62966234-b4d3-52e5-9ee0-dd4c8e4209dc
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F527f1e53eb374119b57797167014074e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/527f1e53eb374119b57797167014074e.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d3a5007f-078b-5d94-9963-3fceed8863b7 with identifier: 202510247389520
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d3a5007f-078b-5d94-9963-3fceed8863b7
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F241e325ac85d4b88a2eb6ac5989c8076.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/241e325ac85d4b88a2eb6ac5989c8076.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 42d174a5-14b8-5125-8894-9d17a89a99ab with identifier: 202510247389257
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 42d174a5-14b8-5125-8894-9d17a89a99ab
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb557f4f04b344d2e826a5fa9f7abb887.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b557f4f04b344d2e826a5fa9f7abb887.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ebe4f92-8eaf-5708-ba51-fed8d481ff47 with identifier: 202511107774474
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2ebe4f92-8eaf-5708-ba51-fed8d481ff47
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdeef505a84a4ffbb86c119361088ac7.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdeef505a84a4ffbb86c119361088ac7.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c8778c-cff5-5ade-bdc8-e87db96edf35 with identifier: 202510247388541
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 62c8778c-cff5-5ade-bdc8-e87db96edf35
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39d5aacc1804459583037b30d184a13f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39d5aacc1804459583037b30d184a13f.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 63e39497-a850-56d5-ba44-4db8211af119 with identifier: 202511107774424
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 63e39497-a850-56d5-ba44-4db8211af119
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5984d5bb84674feca99cfb82622bbe24.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5984d5bb84674feca99cfb82622bbe24.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ef6069d1-e1f1-52d6-9600-2263a11fa742 with identifier: 202511187962977
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ef6069d1-e1f1-52d6-9600-2263a11fa742
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3c15fb8a6384e5895b6ef1be0dd2302.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3c15fb8a6384e5895b6ef1be0dd2302.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 229986ce-dea8-53c9-993a-3a1b908b4670 with identifier: 202510247387976
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 229986ce-dea8-53c9-993a-3a1b908b4670
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27de6ae2a4354dc29f56f5a40a93201a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27de6ae2a4354dc29f56f5a40a93201a.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b5bf228-a80d-511c-888d-2e3583ddaf72 with identifier: 202511077740601
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0b5bf228-a80d-511c-888d-2e3583ddaf72
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff140334743434be48c413ecb09660a16.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f140334743434be48c413ecb09660a16.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e8a0b27-aa3c-5e1f-a757-7132f80074f3 with identifier: 202511177941080
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5e8a0b27-aa3c-5e1f-a757-7132f80074f3
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f1a36945b3b4cc48a1c6b0e99fb7ee3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f1a36945b3b4cc48a1c6b0e99fb7ee3.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: db86055e-6410-51c2-823c-d6254a0a35d2 with identifier: 202510247387851
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item db86055e-6410-51c2-823c-d6254a0a35d2
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa10a1c296871445ea7f5b622635dd799.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a10a1c296871445ea7f5b622635dd799.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd6ea44-8b3c-538a-9d90-2e64a7f497ef with identifier: 202511077740486
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3fd6ea44-8b3c-538a-9d90-2e64a7f497ef
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F326a7183e781411ab561121cdfd8b8c0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/326a7183e781411ab561121cdfd8b8c0.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 645acca5-30ea-50b8-806c-294482d0fba4 with identifier: 202511147891342
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 645acca5-30ea-50b8-806c-294482d0fba4
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F17845e887bb5433aa96f0c7873245f05.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/17845e887bb5433aa96f0c7873245f05.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 966c9b5c-5db4-5ce2-ae14-76016b96c0d8 with identifier: 202510247387521
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 966c9b5c-5db4-5ce2-ae14-76016b96c0d8
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F691893ce851647589e11a712512b09ae.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/691893ce851647589e11a712512b09ae.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b with identifier: 202511067692150
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe536f60fce7749f0a444b68bb972c753.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e536f60fce7749f0a444b68bb972c753.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 30eeee64-d759-59ac-967c-22ae2b0980ce with identifier: 202511147891008
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 30eeee64-d759-59ac-967c-22ae2b0980ce
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa7005aa7b314048b26e335c2963679b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa7005aa7b314048b26e335c2963679b.jpg not downloaded yet
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/241e325ac85d4b88a2eb6ac5989c8076.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f105845d-f992-59b2-83d9-486d1dcc3f65 with identifier: 202510026831892
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f105845d-f992-59b2-83d9-486d1dcc3f65
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90afcd5828b44a758347f85b7904bbf0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90afcd5828b44a758347f85b7904bbf0.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e28279e-98c1-524b-87d7-721d0a647668 with identifier: 202511067692082
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e28279e-98c1-524b-87d7-721d0a647668
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffd342a7c8ee645a3bc8459ca1e970691.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fd342a7c8ee645a3bc8459ca1e970691.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 957a3f63-ef27-5ed2-87b0-46874fac7e92 with identifier: 202511147890210
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 957a3f63-ef27-5ed2-87b0-46874fac7e92
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F585d718f13154295b1b0eb046a8d90db.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/585d718f13154295b1b0eb046a8d90db.jpg not downloaded yet
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cdeef505a84a4ffbb86c119361088ac7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/527f1e53eb374119b57797167014074e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/39d5aacc1804459583037b30d184a13f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0665c9a2-d844-57e2-b543-476bc840a643 with identifier: 202509306742763
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0665c9a2-d844-57e2-b543-476bc840a643
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b311a4849b24b6b96c1c5abc89ad94f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b311a4849b24b6b96c1c5abc89ad94f.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 656c10bb-9f48-5f1f-945f-d9402c0a2608 with identifier: 202511067691588
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 656c10bb-9f48-5f1f-945f-d9402c0a2608
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F977b64e8267b4f5ea2cc5057d6483532.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/977b64e8267b4f5ea2cc5057d6483532.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1178fb50-d654-5c5b-9b27-77b6505a44fb with identifier: 202511127833975
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1178fb50-d654-5c5b-9b27-77b6505a44fb
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8d8ca4ac59304d648c5d06ba7e961f2d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8d8ca4ac59304d648c5d06ba7e961f2d.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 56ef0fb1-3b6a-57dd-b894-6fca60254f2d with identifier: 202509196467734
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 56ef0fb1-3b6a-57dd-b894-6fca60254f2d
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4c2acbdf4d03478eb53b09c0717ca51b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4c2acbdf4d03478eb53b09c0717ca51b.jpg not downloaded yet
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b557f4f04b344d2e826a5fa9f7abb887.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 38fa708c-50fc-5cbe-bf04-060fcb67a51d with identifier: 202510307538512
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 38fa708c-50fc-5cbe-bf04-060fcb67a51d
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60ae8df310b24051a8911ab199d6947e.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60ae8df310b24051a8911ab199d6947e.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f67a98d-dd3a-55e6-9d41-8dc112f1c459 with identifier: 202511127831368
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3f67a98d-dd3a-55e6-9d41-8dc112f1c459
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85b28cfa54c84e9ea5caee74b6b7617a.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85b28cfa54c84e9ea5caee74b6b7617a.jpg not downloaded yet
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/27de6ae2a4354dc29f56f5a40a93201a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5984d5bb84674feca99cfb82622bbe24.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f78212e4-187e-5fd5-91b5-69f59868d23f with identifier: 202510287469626
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f78212e4-187e-5fd5-91b5-69f59868d23f
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fabb3dd07beeb476ab76eec12b4ee0bad.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/abb3dd07beeb476ab76eec12b4ee0bad.jpg not downloaded yet
2026-03-26 11:11:07 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc49845-c31c-56f6-a889-03737f81f473 with identifier: 202511107788113
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffc49845-c31c-56f6-a889-03737f81f473
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a9bea2d83134478b617014d83c9527c.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a9bea2d83134478b617014d83c9527c.jpg not downloaded yet
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5121f6d0>
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3a5007f-078b-5d94-9963-3fceed8863b7/d3a5007f-078b-5d94-9963-3fceed8863b7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F241e325ac85d4b88a2eb6ac5989c8076.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/241e325ac85d4b88a2eb6ac5989c8076.jpg saved to cache
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3a5007f-078b-5d94-9963-3fceed8863b7
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3a5007f-078b-5d94-9963-3fceed8863b7 sending to next pipeline
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58dcc750>
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ebe4f92-8eaf-5708-ba51-fed8d481ff47/2ebe4f92-8eaf-5708-ba51-fed8d481ff47_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdeef505a84a4ffbb86c119361088ac7.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdeef505a84a4ffbb86c119361088ac7.jpg saved to cache
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ebe4f92-8eaf-5708-ba51-fed8d481ff47
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ebe4f92-8eaf-5708-ba51-fed8d481ff47 sending to next pipeline
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51ebff50>
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62966234-b4d3-52e5-9ee0-dd4c8e4209dc/62966234-b4d3-52e5-9ee0-dd4c8e4209dc_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F527f1e53eb374119b57797167014074e.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/527f1e53eb374119b57797167014074e.jpg saved to cache
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62966234-b4d3-52e5-9ee0-dd4c8e4209dc
2026-03-26 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62966234-b4d3-52e5-9ee0-dd4c8e4209dc sending to next pipeline
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f3cd50>
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_62c8778c-cff5-5ade-bdc8-e87db96edf35/62c8778c-cff5-5ade-bdc8-e87db96edf35_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39d5aacc1804459583037b30d184a13f.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39d5aacc1804459583037b30d184a13f.jpg saved to cache
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 62c8778c-cff5-5ade-bdc8-e87db96edf35
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 62c8778c-cff5-5ade-bdc8-e87db96edf35 sending to next pipeline
2026-03-26 11:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f3c15fb8a6384e5895b6ef1be0dd2302.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8f1a36945b3b4cc48a1c6b0e99fb7ee3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d3a5007f-078b-5d94-9963-3fceed8863b7 with identifier 202510247389520
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d3a5007f-078b-5d94-9963-3fceed8863b7
2026-03-26 11:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/241e325ac85d4b88a2eb6ac5989c8076.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2021 MINI Hatch Cooper S Exclusive is a superb example '
                'of this popular model, offering a blend of sporty performance '
                'and premium comfort. Powered by a responsive 2.0 litre petrol '
                'engine, this Euro 6 compliant vehicle delivers an '
                'exhilarating 0-62mph sprint in just 6.6 seconds. The Cooper S '
                'Exclusive trim level ensures a high specification, enhanced '
                'further by the desirable Comfort Pack, which includes climate '
                'control for perfect cabin temperature, keyless entry for '
                'effortless access, and heated seats for those cooler '
                'journeys. Navigation is also a breeze thanks to the '
                'integrated Navigation Pack, while automatic headlight '
                'activation ensures you always have optimal visibility.\n'
                '\n'
                'Further enhancing the driving experience, this MINI Hatch '
                'features Bluetooth connectivity for seamless mobile phone '
                'integration and audio streaming, allowing you to enjoy your '
                'favourite music on the go. Parking is made simple with the '
                'rear Park Distance Control, providing audible alerts to help '
                'you manoeuvre with confidence. These features collectively '
                'demonstrate how this MINI Hatch Cooper S Exclusive offers a '
                'more refined and convenient ownership experience compared to '
                'other vehicles in its class.\n'
                '\n'
                'SERVICE HISTORY: one recorded at 32,000 miles.\n'
                '\n'
                'Visit our showroom now to come and take a look or feel free '
                'to call us for more details!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 176,
 'fuel_type': 'Petrol',
 'id': 'd3a5007f-078b-5d94-9963-3fceed8863b7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510247389520',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 36000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3a5007f-078b-5d94-9963-3fceed8863b7/d3a5007f-078b-5d94-9963-3fceed8863b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248631,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/241e325ac85d4b88a2eb6ac5989c8076.jpg',
             'Width': 2048}],
 'price': 17599,
 'price_includes_vat': True,
 'registration_date': '2021-11-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 Cooper S Exclusive Steptronic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Cooper S Exclusive',
 'year': 2021}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247389520%27 HTTP/1.1" 200 None
2026-03-26 11:11:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510247389520: {'created_time': 1774523468.067407, 'last_price_update_time': 1774523468.067415}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510247389520') HTTP/1.1" 204 0
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2ebe4f92-8eaf-5708-ba51-fed8d481ff47 with identifier 202511107774474
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2ebe4f92-8eaf-5708-ba51-fed8d481ff47
2026-03-26 11:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cdeef505a84a4ffbb86c119361088ac7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2022 BMW 5 Series 520d M Sport presents an exceptional '
                'opportunity with its remarkably low mileage of just 21,200 '
                'miles. As a Euro 6 compliant model, it features a '
                'sophisticated 2.0L Diesel Hybrid engine, offering an '
                'efficient and powerful driving experience. The M Sport trim '
                'level is further enhanced by the M Sport Pro Package, '
                "ensuring a dynamic aesthetic and performance. Inside, you'll "
                'find comfort and convenience with front seat heating, while '
                'the BMW Live Cockpit Professional, complete with Bluetooth '
                'connectivity, keeps you informed and entertained. Seamless '
                'smartphone integration is guaranteed thanks to BMW Connected '
                'Package Professional, supporting both Android Auto and Apple '
                'CarPlay.\n'
                '\n'
                'Navigating tight spaces is made effortless with the '
                'comprehensive Parking Assistant, which includes front and '
                'rear sensors, as well as a rear camera. This 5 Series also '
                'boasts a generously sized boot, providing ample space for '
                'luggage or shopping. The combination of its advanced '
                'technology, practical features, and the desirable M Sport '
                'enhancements, alongside its outstanding provenance, clearly '
                'sets this BMW 520d M Sport apart from other vehicles in its '
                'class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel Hybrid',
 'id': '2ebe4f92-8eaf-5708-ba51-fed8d481ff47',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511107774474',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '5 Series',
 'odometer': 21200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ebe4f92-8eaf-5708-ba51-fed8d481ff47/2ebe4f92-8eaf-5708-ba51-fed8d481ff47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247984,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cdeef505a84a4ffbb86c119361088ac7.jpg',
             'Width': 2048}],
 'price': 29799,
 'price_includes_vat': True,
 'registration_date': '2022-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 Series 2.0 520d MHT M Sport Touring Steptronic Euro 6 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107774474%27 HTTP/1.1" 200 None
2026-03-26 11:11:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511107774474: {'created_time': 1774523468.568729, 'last_price_update_time': 1774523468.568737}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511107774474') HTTP/1.1" 204 0
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 62966234-b4d3-52e5-9ee0-dd4c8e4209dc with identifier 202510247391091
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 62966234-b4d3-52e5-9ee0-dd4c8e4209dc
2026-03-26 11:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/527f1e53eb374119b57797167014074e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2021 MINI Hatch Cooper Sport presents an exceptional '
                'opportunity with its remarkably low mileage of just 14,200 '
                'miles. This stylish hatchback is powered by a responsive 1.5 '
                'litre petrol engine, meeting Euro 6 emissions standards. The '
                'Cooper Sport trim level ensures a well equipped driving '
                'experience, enhanced by the Comfort Pack which includes '
                'climate control for your ideal cabin temperature, keyless '
                'entry for effortless access, and heated seats for those '
                'cooler days. Further adding to its practicality and appeal '
                'are the black bonnet stripes, rear park distance control for '
                'easier manoeuvring, automatic headlights that activate when '
                'needed, and Bluetooth connectivity with audio streaming for '
                'your compatible mobile phone.\n'
                '\n'
                'SERVICE HISTORY: one service on iDRIVE at 10,000 miles\n'
                '\n'
                'Available now, please call us for further details!',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '62966234-b4d3-52e5-9ee0-dd4c8e4209dc',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510247391091',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 14200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62966234-b4d3-52e5-9ee0-dd4c8e4209dc/62966234-b4d3-52e5-9ee0-dd4c8e4209dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 256786,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/527f1e53eb374119b57797167014074e.jpg',
             'Width': 2048}],
 'price': 18999,
 'price_includes_vat': True,
 'registration_date': '2021-12-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Hatch 1.5 Cooper Sport Steptronic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Cooper Sport',
 'year': 2021}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247391091%27 HTTP/1.1" 200 None
2026-03-26 11:11:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510247391091: {'created_time': 1774523468.615807, 'last_price_update_time': 1774523468.615817}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510247391091') HTTP/1.1" 204 0
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 62c8778c-cff5-5ade-bdc8-e87db96edf35 with identifier 202510247388541
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 62c8778c-cff5-5ade-bdc8-e87db96edf35
2026-03-26 11:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/39d5aacc1804459583037b30d184a13f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2022 Ford Puma ST Line T offers a compelling blend of '
                'style and efficiency, featuring a 1.0L Petrol Hybrid engine '
                'that delivers an impressive 51 miles per gallon. As a Euro 6 '
                'compliant vehicle, it also boasts low CO2 emissions, making '
                "it an environmentally conscious choice. Inside, you'll find "
                'the user friendly Ford SYNC 3 Navigation system, complete '
                'with Android Auto and Apple CarPlay for seamless smartphone '
                'integration, alongside Bluetooth connectivity. For added '
                'convenience, this model includes manual air conditioning and '
                'rear parking sensors to assist with manoeuvring.\n'
                '\n'
                'The performance of this Ford Puma is equally noteworthy, '
                'achieving 0 to 62 miles per hour in just 8.9 seconds. These '
                'highlights demonstrate how this particular Puma ST Line T '
                'stands out from other vehicles in its class, offering a '
                'dynamic driving experience combined with advanced technology '
                'and excellent fuel economy.\n'
                '\n'
                'SERVICE HISTORY: two services, last at 34,000 miles.\n'
                '\n'
                'Come and take a look now or call our sales team for more '
                'information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 153,
 'fuel_type': 'Petrol Hybrid',
 'id': '62c8778c-cff5-5ade-bdc8-e87db96edf35',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510247388541',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 38100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c8778c-cff5-5ade-bdc8-e87db96edf35/62c8778c-cff5-5ade-bdc8-e87db96edf35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257170,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/39d5aacc1804459583037b30d184a13f.jpg',
             'Width': 2048}],
 'price': 13299,
 'price_includes_vat': True,
 'registration_date': '2022-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0T EcoBoost MHEV ST-Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247388541%27 HTTP/1.1" 200 None
2026-03-26 11:11:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510247388541: {'created_time': 1774523468.661331, 'last_price_update_time': 1774523468.661338}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510247388541') HTTP/1.1" 204 0
2026-03-26 11:11:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 49bad858-4715-5ed3-b909-cdeab7b4981c with identifier: 202510287468420
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 49bad858-4715-5ed3-b909-cdeab7b4981c
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c857eaa41834b5caf24f89fa478ad81.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c857eaa41834b5caf24f89fa478ad81.jpg not downloaded yet
2026-03-26 11:11:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 69a92f25-bae0-547a-bd4d-9150153cd920 with identifier: 202511107774603
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 69a92f25-bae0-547a-bd4d-9150153cd920
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F440198efa7254f59831ccdfae02cbb60.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/440198efa7254f59831ccdfae02cbb60.jpg not downloaded yet
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d84350>
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42d174a5-14b8-5125-8894-9d17a89a99ab/42d174a5-14b8-5125-8894-9d17a89a99ab_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb557f4f04b344d2e826a5fa9f7abb887.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b557f4f04b344d2e826a5fa9f7abb887.jpg saved to cache
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42d174a5-14b8-5125-8894-9d17a89a99ab
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42d174a5-14b8-5125-8894-9d17a89a99ab sending to next pipeline
2026-03-26 11:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/17845e887bb5433aa96f0c7873245f05.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f140334743434be48c413ecb09660a16.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 42d174a5-14b8-5125-8894-9d17a89a99ab with identifier 202510247389257
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 42d174a5-14b8-5125-8894-9d17a89a99ab
2026-03-26 11:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b557f4f04b344d2e826a5fa9f7abb887.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2021 BMW Z4 30i M Sport offers a superb driving '
                'experience with its Euro 6 compliant 2.0L petrol engine. As a '
                '30i M Sport variant with the M Sport trim, it benefits from '
                'the M Sport Pro Package, enhancing its sporty appeal. Inside, '
                "you'll find the BMW Connected Package Professional, which "
                'includes Apple CarPlay for seamless smartphone integration, '
                'and front heated seats for added comfort. The cabin also '
                'features automatic two zone air conditioning, ensuring a '
                'pleasant environment for all occupants. For convenience, '
                'there is a Bluetooth hands free system with a USB audio '
                'interface.\n'
                '\n'
                'This Z4 is designed to impress, achieving 0-62mph in a swift '
                '5.4 seconds, demonstrating its impressive acceleration '
                'compared to other vehicles in its class. It also boasts a '
                'fuel economy of 40 mpg, making it an efficient choice for its '
                'performance. Furthermore, this model offers generous boot '
                'space, providing practicality for your journeys.\n'
                '\n'
                'SERVICE HISTORY: 3 services on iDRIVE (2 oil), last at 29,000 '
                'miles.\n'
                '\n'
                'Available now! Call for details!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 254,
 'fuel_type': 'Petrol',
 'id': '42d174a5-14b8-5125-8894-9d17a89a99ab',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510247389257',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 29500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 45,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42d174a5-14b8-5125-8894-9d17a89a99ab/42d174a5-14b8-5125-8894-9d17a89a99ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247511,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b557f4f04b344d2e826a5fa9f7abb887.jpg',
             'Width': 2048}],
 'price': 28299,
 'price_includes_vat': True,
 'registration_date': '2021-09-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z4 2.0 30i M Sport Auto sDrive Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247389257%27 HTTP/1.1" 200 None
2026-03-26 11:11:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510247389257: {'created_time': 1774523468.799458, 'last_price_update_time': 1774523468.799468}
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510247389257') HTTP/1.1" 204 0
2026-03-26 11:11:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fc0799-21b5-51bf-8832-14444a26ada7 with identifier: 202511107774528
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 84fc0799-21b5-51bf-8832-14444a26ada7
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a2569aa16bb4484852ae08f2bd6b224.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a2569aa16bb4484852ae08f2bd6b224.jpg not downloaded yet
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58dcd210>
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_229986ce-dea8-53c9-993a-3a1b908b4670/229986ce-dea8-53c9-993a-3a1b908b4670_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27de6ae2a4354dc29f56f5a40a93201a.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27de6ae2a4354dc29f56f5a40a93201a.jpg saved to cache
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 229986ce-dea8-53c9-993a-3a1b908b4670
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 229986ce-dea8-53c9-993a-3a1b908b4670 sending to next pipeline
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51494c10>
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63e39497-a850-56d5-ba44-4db8211af119/63e39497-a850-56d5-ba44-4db8211af119_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5984d5bb84674feca99cfb82622bbe24.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5984d5bb84674feca99cfb82622bbe24.jpg saved to cache
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63e39497-a850-56d5-ba44-4db8211af119
2026-03-26 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63e39497-a850-56d5-ba44-4db8211af119 sending to next pipeline
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f0be50>
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef6069d1-e1f1-52d6-9600-2263a11fa742/ef6069d1-e1f1-52d6-9600-2263a11fa742_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff3c15fb8a6384e5895b6ef1be0dd2302.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f3c15fb8a6384e5895b6ef1be0dd2302.jpg saved to cache
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef6069d1-e1f1-52d6-9600-2263a11fa742
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef6069d1-e1f1-52d6-9600-2263a11fa742 sending to next pipeline
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51494c50>
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e8a0b27-aa3c-5e1f-a757-7132f80074f3/5e8a0b27-aa3c-5e1f-a757-7132f80074f3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f1a36945b3b4cc48a1c6b0e99fb7ee3.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f1a36945b3b4cc48a1c6b0e99fb7ee3.jpg saved to cache
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e8a0b27-aa3c-5e1f-a757-7132f80074f3
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e8a0b27-aa3c-5e1f-a757-7132f80074f3 sending to next pipeline
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a10a1c296871445ea7f5b622635dd799.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 229986ce-dea8-53c9-993a-3a1b908b4670 with identifier 202510247387976
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 229986ce-dea8-53c9-993a-3a1b908b4670
2026-03-26 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/27de6ae2a4354dc29f56f5a40a93201a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2024 Vauxhall Astra Turbo GS offers an exceptional blend '
                'of style and practicality, boasting a 1.2L Euro 6 petrol '
                'engine for efficient performance. As a GS trim model, it '
                'comes equipped with advanced features designed to enhance '
                'your driving experience. Enjoy the convenience of Dual Zone '
                'Electronic Climate Control, ensuring comfort for all '
                'occupants, and navigate tight spaces with ease thanks to the '
                'Front and Rear Parking Distance Sensors. The Adaptive Cruise '
                'Control system takes the stress out of longer journeys, while '
                'Keyless Entry and Start provide seamless access. Inside, the '
                'Pure Panel Pro Navigation system integrates seamlessly with '
                'your smartphone via Android Auto and Apple CarPlay, and '
                'offers Bluetooth connectivity for calls and music.\n'
                '\n'
                'SERVICE HISTORY: one main dealer stamp at 11,000 miles.\n'
                '\n'
                'Call us now to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': '229986ce-dea8-53c9-993a-3a1b908b4670',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510247387976',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Astra',
 'odometer': 16100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_229986ce-dea8-53c9-993a-3a1b908b4670/229986ce-dea8-53c9-993a-3a1b908b4670_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239750,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/27de6ae2a4354dc29f56f5a40a93201a.jpg',
             'Width': 2048}],
 'price': 16799,
 'price_includes_vat': True,
 'registration_date': '2024-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Astra 1.2 Turbo GS Sports Tourer Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2024}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247387976%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510247387976: {'created_time': 1774523469.121401, 'last_price_update_time': 1774523469.121408}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510247387976') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 63e39497-a850-56d5-ba44-4db8211af119 with identifier 202511107774424
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 63e39497-a850-56d5-ba44-4db8211af119
2026-03-26 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5984d5bb84674feca99cfb82622bbe24.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2022 Volkswagen ID.3 Pro Life is an excellent example of '
                'electric motoring, offering a substantial new battery range '
                'of up to 260 miles. As a Life trim model, this electric '
                'vehicle is equipped with a 62 kWh battery, providing a '
                'convenient and efficient driving experience. Notable features '
                'include stylish 18in East Derry alloy wheels, a 1 Zone '
                'Climatronic system for personalised cabin comfort, and an '
                'Adaptive Cruise Control system that enhances safety and ease '
                'on longer journeys. The All LED Headlights with Reflector '
                'Technology ensure excellent visibility, while front and rear '
                'parking sensors make manoeuvring in tight spaces '
                'straightforward.\n'
                '\n'
                'The ID.3 Pro Life stands out with its impressive 260 mile '
                'maximum range from new, demonstrating its capability for both '
                'daily commutes and longer trips. Charging is also a key '
                'consideration, with a full charge at home using a 7kW charger '
                'taking approximately 9 hours and 30 minutes, and rapid public '
                'charging capable of taking the battery from empty to 80% in '
                'just 37 minutes. Furthermore, this model boasts a large boot '
                'space, offering ample practicality for shopping or luggage, '
                'making it a versatile choice for many drivers.',
 'doors_number': 5,
 'engine_horse_power': 143,
 'fuel_type': 'Electric',
 'id': '63e39497-a850-56d5-ba44-4db8211af119',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511107774424',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 24700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63e39497-a850-56d5-ba44-4db8211af119/63e39497-a850-56d5-ba44-4db8211af119_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250593,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5984d5bb84674feca99cfb82622bbe24.jpg',
             'Width': 2048}],
 'price': 14199,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 Pro 58kWh Life Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107774424%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511107774424: {'created_time': 1774523469.162964, 'last_price_update_time': 1774523469.16297}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511107774424') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ef6069d1-e1f1-52d6-9600-2263a11fa742 with identifier 202511187962977
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ef6069d1-e1f1-52d6-9600-2263a11fa742
2026-03-26 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f3c15fb8a6384e5895b6ef1be0dd2302.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Kia EV6 GT Line offers an impressive electric '
                'driving experience with a substantial 77 kWh battery, '
                'providing a maximum range of 328 miles when new. This model '
                'benefits from keyless entry and a smart start system, '
                'alongside the convenience of Bluetooth with voice recognition '
                'for seamless connectivity. For added comfort and ease, it '
                'features a heated steering wheel and automatic headlights, '
                'while rear parking sensors assist with manoeuvring.\n'
                '\n'
                'The Kia EV6 GT Line excels with its rapid acceleration, '
                'achieving 0-62mph in just 7.3 seconds, demonstrating its '
                'dynamic performance. Charging is efficient, with a full '
                'charge at home taking approximately 12 hours and 30 minutes '
                'using a 7kW charger, and a rapid charge to 80% possible in as '
                'little as 20 minutes at a public charging station. This '
                'electric vehicle also boasts a large boot space, making it a '
                'practical choice for everyday use and longer journeys, '
                'further enhancing its appeal over similar vehicles.',
 'doors_number': 5,
 'engine_horse_power': 225,
 'fuel_type': 'Electric',
 'id': 'ef6069d1-e1f1-52d6-9600-2263a11fa742',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511187962977',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 22600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef6069d1-e1f1-52d6-9600-2263a11fa742/ef6069d1-e1f1-52d6-9600-2263a11fa742_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250878,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f3c15fb8a6384e5895b6ef1be0dd2302.jpg',
             'Width': 2048}],
 'price': 23499,
 'price_includes_vat': True,
 'registration_date': '2023-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA EV6 77.4kWh GT-Line Auto 5dr',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2023}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511187962977%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511187962977: {'created_time': 1774523469.204592, 'last_price_update_time': 1774523469.204599}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511187962977') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5e8a0b27-aa3c-5e1f-a757-7132f80074f3 with identifier 202511177941080
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5e8a0b27-aa3c-5e1f-a757-7132f80074f3
2026-03-26 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8f1a36945b3b4cc48a1c6b0e99fb7ee3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2017 Mercedes Benz C Class C220d AMG Line (Premium) '
                'boasts exceptionally low mileage for its age, having covered '
                'just 63,500 miles. Finished in the desirable AMG Line trim, '
                'this Euro 6 compliant 2.1L diesel model offers a compelling '
                'blend of style and performance. It comes equipped with '
                'striking 19in AMG Multi-Spoke Design alloy wheels in a '
                'bi-colour finish, and the Premium Package enhances '
                'convenience with Keyless Entry and a panoramic sunroof. For '
                'enhanced visibility and a distinctive look, it features LED '
                'High Performance headlamps with integrated LED daytime '
                'running lights, while heated front seats ensure comfort in '
                'all conditions.\n'
                '\n'
                'The driving experience is further elevated by the Active '
                'Parking Assist system, complete with front and rear sensors, '
                'making manoeuvring effortless. This C220d AMG Line '
                'demonstrates its dynamic capabilities with an impressive '
                '0-62mph acceleration time of just 7.5 seconds, indicating a '
                'superior performance compared to many vehicles in its class. '
                'The combination of its refined Mercedes Benz engineering, '
                'sporty AMG Line styling, and thoughtful premium features '
                'makes this C Class a truly appealing choice.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 168,
 'fuel_type': 'Diesel',
 'id': '5e8a0b27-aa3c-5e1f-a757-7132f80074f3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511177941080',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'C Class',
 'odometer': 63500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e8a0b27-aa3c-5e1f-a757-7132f80074f3/5e8a0b27-aa3c-5e1f-a757-7132f80074f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257926,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f1a36945b3b4cc48a1c6b0e99fb7ee3.jpg',
             'Width': 2048}],
 'price': 14999,
 'price_includes_vat': True,
 'registration_date': '2017-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C Class 2.1 C220d AMG Line (Premium) G-Tronic+ Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511177941080%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511177941080: {'created_time': 1774523469.246193, 'last_price_update_time': 1774523469.246199}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511177941080') HTTP/1.1" 204 0
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/326a7183e781411ab561121cdfd8b8c0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/aa7005aa7b314048b26e335c2963679b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/585d718f13154295b1b0eb046a8d90db.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5816e490>
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_645acca5-30ea-50b8-806c-294482d0fba4/645acca5-30ea-50b8-806c-294482d0fba4_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F17845e887bb5433aa96f0c7873245f05.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/17845e887bb5433aa96f0c7873245f05.jpg saved to cache
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 645acca5-30ea-50b8-806c-294482d0fba4
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 645acca5-30ea-50b8-806c-294482d0fba4 sending to next pipeline
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5134ff50>
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b5bf228-a80d-511c-888d-2e3583ddaf72/0b5bf228-a80d-511c-888d-2e3583ddaf72_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff140334743434be48c413ecb09660a16.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f140334743434be48c413ecb09660a16.jpg saved to cache
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b5bf228-a80d-511c-888d-2e3583ddaf72
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b5bf228-a80d-511c-888d-2e3583ddaf72 sending to next pipeline
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 645acca5-30ea-50b8-806c-294482d0fba4 with identifier 202511147891342
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 645acca5-30ea-50b8-806c-294482d0fba4
2026-03-26 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/17845e887bb5433aa96f0c7873245f05.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma ST is a superb example, having had only '
                'one owner since new.  It boasts a powerful 1.5L petrol engine '
                "and meets Euro 6 emission standards.  Inside, you'll find "
                'luxurious heated front seats and a heated steering wheel as '
                'part of the Winter Pack, ensuring comfort in all conditions.  '
                'The Ford KeyFree System allows for convenient keyless entry, '
                'and rear parking sensors make manoeuvring easier.  '
                'Entertainment and navigation are handled by the B&O Premium '
                'Audio System and Ford SYNC 3, which includes Android Auto, '
                'Apple CarPlay, and Bluetooth connectivity.\n'
                'This vehicle is available now to view, please call our sales '
                'team for further information.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': '645acca5-30ea-50b8-806c-294482d0fba4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511147891342',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_645acca5-30ea-50b8-806c-294482d0fba4/645acca5-30ea-50b8-806c-294482d0fba4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254369,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/17845e887bb5433aa96f0c7873245f05.jpg',
             'Width': 2048}],
 'price': 17499,
 'price_includes_vat': True,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2023}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511147891342%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511147891342: {'created_time': 1774523469.479318, 'last_price_update_time': 1774523469.479327}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511147891342') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0b5bf228-a80d-511c-888d-2e3583ddaf72 with identifier 202511077740601
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0b5bf228-a80d-511c-888d-2e3583ddaf72
2026-03-26 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f140334743434be48c413ecb09660a16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma T Vivid Ruby Edition presents an '
                'exceptional ownership proposition with its remarkably low '
                'mileage of just 12,600 miles. As a single owner vehicle, it '
                'has been meticulously maintained and comes equipped with the '
                "desirable Vivid Ruby Edition trim. Under the bonnet, you'll "
                'find an efficient 1.0L Petrol Hybrid engine, meeting Euro 6 '
                'emission standards. This stylish SUV boasts a range of '
                'premium features, including a B&O Premium Audio System '
                'integrated with Ford SYNC 3 Navigation, offering seamless '
                'connectivity through Android Auto, Apple CarPlay, and '
                'Bluetooth. The Winter Pack ensures comfort with heated seats '
                'and a heated steering wheel, while the Wireless Charging Pad '
                'with Electronic Air Temperature Control provides convenient '
                'charging and climate management. Further enhancing the '
                'driving experience are Fixed LED Signature Headlamps for '
                'superior visibility and a Handsfree Power Tailgate with '
                'Keyless Entry for effortless access.\n'
                '\n'
                'The Ford Puma T Vivid Ruby Edition stands out with its '
                'impressive fuel economy, achieving a highlight of 52 mpg, '
                'which indicates its superior efficiency compared to similar '
                'vehicles. Its low CO2 emissions also contribute to its '
                'appeal, making it a more environmentally conscious choice. '
                'This combination of advanced technology, comfort features, '
                'and excellent running costs makes this particular 2023 Ford '
                'Puma a compelling option for any discerning driver.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol Hybrid',
 'id': '0b5bf228-a80d-511c-888d-2e3583ddaf72',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511077740601',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 12400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b5bf228-a80d-511c-888d-2e3583ddaf72/0b5bf228-a80d-511c-888d-2e3583ddaf72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245717,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f140334743434be48c413ecb09660a16.jpg',
             'Width': 2048}],
 'price': 17999,
 'price_includes_vat': True,
 'registration_date': '2023-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0T EcoBoost MHEV Vivid Ruby Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Vivid Ruby Edition',
 'year': 2023}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511077740601%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511077740601: {'created_time': 1774523469.531277, 'last_price_update_time': 1774523469.531284}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511077740601') HTTP/1.1" 204 0
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fd342a7c8ee645a3bc8459ca1e970691.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51eee210>
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db86055e-6410-51c2-823c-d6254a0a35d2/db86055e-6410-51c2-823c-d6254a0a35d2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa10a1c296871445ea7f5b622635dd799.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a10a1c296871445ea7f5b622635dd799.jpg saved to cache
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db86055e-6410-51c2-823c-d6254a0a35d2
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db86055e-6410-51c2-823c-d6254a0a35d2 sending to next pipeline
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Page: 16/16, total results: 304
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505212638945%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202505212638945: 1
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202504171439093%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202504171439093: 1
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202503270634105%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202503270634105: 1
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202412167329061%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202412167329061: 1
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 4 detail requests (batch 1)
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/90afcd5828b44a758347f85b7904bbf0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8d8ca4ac59304d648c5d06ba7e961f2d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: db86055e-6410-51c2-823c-d6254a0a35d2 with identifier 202510247387851
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item db86055e-6410-51c2-823c-d6254a0a35d2
2026-03-26 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a10a1c296871445ea7f5b622635dd799.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2024 Peugeot 408 GT offers a refined driving experience '
                'with its Euro 6 compliant 1.2 litre petrol engine. As a GT '
                'trim, it comes equipped with a multifunction full grain '
                'leather steering wheel featuring distinctive Admite Green '
                'stitching, chrome detailing, and GT badging, which is also '
                'heated for added comfort. The Visibility Pack ensures optimal '
                'illumination with automatic headlights, while the automatic '
                'air conditioning with AQS 3 maintains a pleasant cabin '
                'environment. Parking is made simpler with Visio Park 1, '
                'including a rear camera, and front and rear parking sensors.\n'
                '\n'
                'SERVICE HISTORY: one service recorded.\n'
                '\n'
                'Lovely colour, great condition and available now to view! '
                'Call for more details!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 129,
 'fuel_type': 'Petrol',
 'id': 'db86055e-6410-51c2-823c-d6254a0a35d2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510247387851',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Peugeot',
 'model': '408',
 'odometer': 20000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db86055e-6410-51c2-823c-d6254a0a35d2/db86055e-6410-51c2-823c-d6254a0a35d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250948,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a10a1c296871445ea7f5b622635dd799.jpg',
             'Width': 2048}],
 'price': 18499,
 'price_includes_vat': True,
 'registration_date': '2024-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 408 1.2 PureTech GT Fastback EAT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2024}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247387851%27 HTTP/1.1" 200 None
2026-03-26 11:11:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510247387851: {'created_time': 1774523469.730294, 'last_price_update_time': 1774523469.730302}
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510247387851') HTTP/1.1" 204 0
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51166190>
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd6ea44-8b3c-538a-9d90-2e64a7f497ef/3fd6ea44-8b3c-538a-9d90-2e64a7f497ef_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F326a7183e781411ab561121cdfd8b8c0.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/326a7183e781411ab561121cdfd8b8c0.jpg saved to cache
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fd6ea44-8b3c-538a-9d90-2e64a7f497ef
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fd6ea44-8b3c-538a-9d90-2e64a7f497ef sending to next pipeline
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58150310>
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30eeee64-d759-59ac-967c-22ae2b0980ce/30eeee64-d759-59ac-967c-22ae2b0980ce_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faa7005aa7b314048b26e335c2963679b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aa7005aa7b314048b26e335c2963679b.jpg saved to cache
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30eeee64-d759-59ac-967c-22ae2b0980ce
2026-03-26 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30eeee64-d759-59ac-967c-22ae2b0980ce sending to next pipeline
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514a4c90>
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_957a3f63-ef27-5ed2-87b0-46874fac7e92/957a3f63-ef27-5ed2-87b0-46874fac7e92_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F585d718f13154295b1b0eb046a8d90db.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/585d718f13154295b1b0eb046a8d90db.jpg saved to cache
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 957a3f63-ef27-5ed2-87b0-46874fac7e92
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 957a3f63-ef27-5ed2-87b0-46874fac7e92 sending to next pipeline
2026-03-26 11:11:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fb73a5dd-d571-5c13-89ad-1188b7ef445f with identifier: 202508215632964
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fb73a5dd-d571-5c13-89ad-1188b7ef445f
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb476df1e3c4b455aafdd28c645e80037.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b476df1e3c4b455aafdd28c645e80037.jpg not downloaded yet
2026-03-26 11:11:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e1d25bda-928a-54b4-abc4-3fb4706d836f with identifier: 202509116245202
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1d25bda-928a-54b4-abc4-3fb4706d836f
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb202aa2bdb144ca39d6381573065ba57.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b202aa2bdb144ca39d6381573065ba57.jpg not downloaded yet
2026-03-26 11:11:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-26 11:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/85b28cfa54c84e9ea5caee74b6b7617a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/60ae8df310b24051a8911ab199d6947e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3fd6ea44-8b3c-538a-9d90-2e64a7f497ef with identifier 202511077740486
2026-03-26 11:11:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3fd6ea44-8b3c-538a-9d90-2e64a7f497ef
2026-03-26 11:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/326a7183e781411ab561121cdfd8b8c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Gold',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'engine_horse_power': 214,
 'fuel_type': 'Electric',
 'id': '3fd6ea44-8b3c-538a-9d90-2e64a7f497ef',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511077740486',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'IONIQ 5',
 'odometer': 18100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd6ea44-8b3c-538a-9d90-2e64a7f497ef/3fd6ea44-8b3c-538a-9d90-2e64a7f497ef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272704,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/326a7183e781411ab561121cdfd8b8c0.jpg',
             'Width': 2048}],
 'price': 19499,
 'price_includes_vat': True,
 'registration_date': '2021-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai IONIQ 5 73kWh Ultimate Auto 5dr',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2021}
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511077740486%27 HTTP/1.1" 200 None
2026-03-26 11:11:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511077740486: {'created_time': 1774523470.155742, 'last_price_update_time': 1774523470.155749}
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511077740486') HTTP/1.1" 204 0
2026-03-26 11:11:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 30eeee64-d759-59ac-967c-22ae2b0980ce with identifier 202511147891008
2026-03-26 11:11:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 30eeee64-d759-59ac-967c-22ae2b0980ce
2026-03-26 11:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/aa7005aa7b314048b26e335c2963679b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma ST offers exceptional value with '
                'remarkably low mileage for its age, having covered just '
                '14,800 miles. This sporty 1.5 litre petrol model, finished in '
                'the ST trim, is Euro 6 compliant and boasts a range of '
                'desirable features. Included is the Driver Assistance Pack, '
                'which incorporates both front and rear parking sensors along '
                "with a rear camera for effortless manoeuvring. Inside, you'll "
                'find the B&O Premium Audio System paired with Ford SYNC 3 '
                'Navigation, offering seamless connectivity through Android '
                'Auto, Apple CarPlay, and Bluetooth, all delivered through a '
                'luxury branded sound system. For added comfort during colder '
                'journeys, the steering wheel is also heated.\n'
                '\n'
                'The performance of this Ford Puma ST is truly a standout, '
                'with an impressive 0-62mph acceleration time of just 6.7 '
                'seconds, demonstrating its dynamic capabilities. This swift '
                'acceleration highlights how this particular vehicle offers a '
                'more engaging driving experience compared to many other '
                'similar models on the market. Combined with its comprehensive '
                'feature set and excellent provenance, this 2023 Ford Puma ST '
                'presents a compelling choice for those seeking a stylish and '
                'spirited compact car.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': '30eeee64-d759-59ac-967c-22ae2b0980ce',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511147891008',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 14800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30eeee64-d759-59ac-967c-22ae2b0980ce/30eeee64-d759-59ac-967c-22ae2b0980ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257623,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/aa7005aa7b314048b26e335c2963679b.jpg',
             'Width': 2048}],
 'price': 18999,
 'price_includes_vat': True,
 'registration_date': '2023-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2023}
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511147891008%27 HTTP/1.1" 200 None
2026-03-26 11:11:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511147891008: {'created_time': 1774523470.503099, 'last_price_update_time': 1774523470.503109}
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511147891008') HTTP/1.1" 204 0
2026-03-26 11:11:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 957a3f63-ef27-5ed2-87b0-46874fac7e92 with identifier 202511147890210
2026-03-26 11:11:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 957a3f63-ef27-5ed2-87b0-46874fac7e92
2026-03-26 11:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/585d718f13154295b1b0eb046a8d90db.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Blue',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol Hybrid',
 'id': '957a3f63-ef27-5ed2-87b0-46874fac7e92',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511147890210',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 37600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_957a3f63-ef27-5ed2-87b0-46874fac7e92/957a3f63-ef27-5ed2-87b0-46874fac7e92_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257771,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/585d718f13154295b1b0eb046a8d90db.jpg',
             'Width': 2048}],
 'price': 12699,
 'price_includes_vat': True,
 'registration_date': '2022-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.0 T-GDi MHEV Ultimate Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Ultimate',
 'year': 2022}
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511147890210%27 HTTP/1.1" 200 None
2026-03-26 11:11:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511147890210: {'created_time': 1774523470.714341, 'last_price_update_time': 1774523470.714351}
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511147890210') HTTP/1.1" 204 0
2026-03-26 11:11:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 74778f00-e0cb-52a6-8501-66b63aef4623 with identifier: 202508075225289
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 74778f00-e0cb-52a6-8501-66b63aef4623
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19fd723d04d54cc3a41e1d6318468d80.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19fd723d04d54cc3a41e1d6318468d80.jpg not downloaded yet
2026-03-26 11:11:10 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d72ea532-0cb1-5a65-a01d-953858fec299 with identifier: 202509116244569
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d72ea532-0cb1-5a65-a01d-953858fec299
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F545d3116049f473b9f0f53247d1511a1.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/545d3116049f473b9f0f53247d1511a1.jpg not downloaded yet
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51477050>
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28279e-98c1-524b-87d7-721d0a647668/2e28279e-98c1-524b-87d7-721d0a647668_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffd342a7c8ee645a3bc8459ca1e970691.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fd342a7c8ee645a3bc8459ca1e970691.jpg saved to cache
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e28279e-98c1-524b-87d7-721d0a647668
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e28279e-98c1-524b-87d7-721d0a647668 sending to next pipeline
2026-03-26 11:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/abb3dd07beeb476ab76eec12b4ee0bad.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6a9bea2d83134478b617014d83c9527c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/440198efa7254f59831ccdfae02cbb60.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2e28279e-98c1-524b-87d7-721d0a647668 with identifier 202511067692082
2026-03-26 11:11:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2e28279e-98c1-524b-87d7-721d0a647668
2026-03-26 11:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fd342a7c8ee645a3bc8459ca1e970691.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'This 2021 Ford Puma ST offers an exhilarating driving '
                'experience with its impressive 1.5L petrol engine, capable of '
                'accelerating from 0 to 62mph in just 6.7 seconds. This Euro 6 '
                'compliant model is equipped with a range of desirable '
                'features, including an openable panorama roof that floods the '
                'cabin with light, and heated front seats and a heated '
                'steering wheel for ultimate comfort during colder journeys. '
                'For added convenience, it also boasts rear parking sensors '
                'and electronic air temperature control, ensuring a pleasant '
                'environment no matter the weather.\n'
                '\n'
                'The performance of this Ford Puma ST is a clear indicator of '
                'its superior engineering. Its rapid acceleration sets it '
                'apart from many other vehicles in its class, providing a '
                'dynamic and engaging drive. Combined with the premium comfort '
                'features and the sporty ST trim, this 2021 Puma ST represents '
                'a compelling choice for those seeking both excitement and '
                'refinement in their next car.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': '2e28279e-98c1-524b-87d7-721d0a647668',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511067692082',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 47900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e28279e-98c1-524b-87d7-721d0a647668/2e28279e-98c1-524b-87d7-721d0a647668_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 252992,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fd342a7c8ee645a3bc8459ca1e970691.jpg',
             'Width': 2048}],
 'price': 15799,
 'price_includes_vat': True,
 'registration_date': '2021-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2021}
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511067692082%27 HTTP/1.1" 200 None
2026-03-26 11:11:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511067692082: {'created_time': 1774523470.85188, 'last_price_update_time': 1774523470.851887}
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511067692082') HTTP/1.1" 204 0
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51256ed0>
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f105845d-f992-59b2-83d9-486d1dcc3f65/f105845d-f992-59b2-83d9-486d1dcc3f65_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90afcd5828b44a758347f85b7904bbf0.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90afcd5828b44a758347f85b7904bbf0.jpg saved to cache
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f105845d-f992-59b2-83d9-486d1dcc3f65
2026-03-26 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f105845d-f992-59b2-83d9-486d1dcc3f65 sending to next pipeline
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5138bc10>
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1178fb50-d654-5c5b-9b27-77b6505a44fb/1178fb50-d654-5c5b-9b27-77b6505a44fb_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8d8ca4ac59304d648c5d06ba7e961f2d.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8d8ca4ac59304d648c5d06ba7e961f2d.jpg saved to cache
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1178fb50-d654-5c5b-9b27-77b6505a44fb
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1178fb50-d654-5c5b-9b27-77b6505a44fb sending to next pipeline
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e3066a1b-091f-58c5-8d28-f71e69e359c8 with identifier: 202508075215738
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e3066a1b-091f-58c5-8d28-f71e69e359c8
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2bfba102054d48b8bf78d95a8e3c7976.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2bfba102054d48b8bf78d95a8e3c7976.jpg not downloaded yet
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ccf860-0b7d-5e5c-9883-7af0e659cf30 with identifier: 202509086139119
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2ccf860-0b7d-5e5c-9883-7af0e659cf30
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29acdd08ab604e26b978c78fd4b52bc0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29acdd08ab604e26b978c78fd4b52bc0.jpg not downloaded yet
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f105845d-f992-59b2-83d9-486d1dcc3f65 with identifier 202510026831892
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f105845d-f992-59b2-83d9-486d1dcc3f65
2026-03-26 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/90afcd5828b44a758347f85b7904bbf0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma ST offers an exhilarating driving '
                'experience and is equipped with a host of premium features. '
                'B&O Premium Audio System and Ford SYNC 3 Navigation, which '
                'seamlessly integrates Android Auto and Apple CarPlay for your '
                'convenience. Wireless charging pad,  Electronic Air '
                'Temperature Control and The Winter Pack ensures comfort in '
                'colder months with heated seats and a heated steering wheel, '
                'while front parking sensors provide added assistance when '
                'manoeuvring.\n'
                '\n'
                'SERVICE HISTORY: two main dealer services, last at 17,000 '
                'miles.\n'
                '\n'
                'Available now to view, call us for further details!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': 'f105845d-f992-59b2-83d9-486d1dcc3f65',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510026831892',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 19700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f105845d-f992-59b2-83d9-486d1dcc3f65/f105845d-f992-59b2-83d9-486d1dcc3f65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 265471,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/90afcd5828b44a758347f85b7904bbf0.jpg',
             'Width': 2048}],
 'price': 18499,
 'price_includes_vat': True,
 'registration_date': '2023-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2023}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510026831892%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510026831892: {'created_time': 1774523471.069116, 'last_price_update_time': 1774523471.069127}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510026831892') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1178fb50-d654-5c5b-9b27-77b6505a44fb with identifier 202511127833975
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1178fb50-d654-5c5b-9b27-77b6505a44fb
2026-03-26 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8d8ca4ac59304d648c5d06ba7e961f2d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 BMW 3 Series M340d offers an exceptional blend of '
                'performance and efficiency, boasting a powerful 3.0L Diesel '
                'Hybrid engine and a sophisticated Four Wheel Drive system. As '
                'a Euro 6 compliant vehicle, it meets stringent emission '
                'standards. This particular model comes equipped with the '
                'desirable Technology Package, which includes a Head Up '
                'Display for enhanced driver focus and a Premium Branded Sound '
                'System. Further elevating the in car experience is the '
                'Loudspeaker System from Harman Kardon, also providing a '
                'premium audio experience. The Comfort Pack ensures a pleasant '
                'drive, featuring a Heated Steering Wheel, while the '
                'Shadowline Plus Pack adds a touch of sporty styling.\n'
                '\n'
                'The M340d variant stands out with its impressive '
                'acceleration, achieving 0-62mph in a mere 4.6 seconds, '
                'demonstrating its dynamic capabilities. This performance is '
                'matched by its surprisingly low insurance group, making it a '
                'more accessible option for many drivers. These highlights '
                'indicate that this BMW 3 Series M340d offers a superior '
                'driving experience compared to other vehicles in its class, '
                'combining exhilarating speed with advanced technology and '
                'comfort features.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 335,
 'fuel_type': 'Diesel Hybrid',
 'id': '1178fb50-d654-5c5b-9b27-77b6505a44fb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511127833975',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '3 Series',
 'odometer': 51800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1178fb50-d654-5c5b-9b27-77b6505a44fb/1178fb50-d654-5c5b-9b27-77b6505a44fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253625,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8d8ca4ac59304d648c5d06ba7e961f2d.jpg',
             'Width': 2048}],
 'price': 29999,
 'price_includes_vat': True,
 'registration_date': '2021-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 Series 3.0 M340d MHT Auto xDrive Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'year': 2021}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127833975%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511127833975: {'created_time': 1774523471.112402, 'last_price_update_time': 1774523471.112414}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511127833975') HTTP/1.1" 204 0
2026-03-26 11:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5c857eaa41834b5caf24f89fa478ad81.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513bebd0>
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f67a98d-dd3a-55e6-9d41-8dc112f1c459/3f67a98d-dd3a-55e6-9d41-8dc112f1c459_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85b28cfa54c84e9ea5caee74b6b7617a.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85b28cfa54c84e9ea5caee74b6b7617a.jpg saved to cache
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f67a98d-dd3a-55e6-9d41-8dc112f1c459
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f67a98d-dd3a-55e6-9d41-8dc112f1c459 sending to next pipeline
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513bfad0>
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38fa708c-50fc-5cbe-bf04-060fcb67a51d/38fa708c-50fc-5cbe-bf04-060fcb67a51d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60ae8df310b24051a8911ab199d6947e.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60ae8df310b24051a8911ab199d6947e.jpg saved to cache
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38fa708c-50fc-5cbe-bf04-060fcb67a51d
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38fa708c-50fc-5cbe-bf04-060fcb67a51d sending to next pipeline
2026-03-26 11:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4c2acbdf4d03478eb53b09c0717ca51b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e78cf565-a882-5219-8a0c-0232dbd9444a with identifier: 202508015050524
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e78cf565-a882-5219-8a0c-0232dbd9444a
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7d21bcf509b84e28872588a805ed18e0.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7d21bcf509b84e28872588a805ed18e0.jpg not downloaded yet
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f9e7235f-1ad7-51e0-a069-a5a074c98773 with identifier: 202509056069302
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f9e7235f-1ad7-51e0-a069-a5a074c98773
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd9ad9804d7dd4b4fb45a94c11338f4f5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d9ad9804d7dd4b4fb45a94c11338f4f5.jpg not downloaded yet
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3f67a98d-dd3a-55e6-9d41-8dc112f1c459 with identifier 202511127831368
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3f67a98d-dd3a-55e6-9d41-8dc112f1c459
2026-03-26 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/85b28cfa54c84e9ea5caee74b6b7617a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2021 Ford Puma ST-Line X offers exceptional value with '
                'its remarkably low mileage of just 19,200 miles. This stylish '
                'compact SUV is powered by an efficient 1.0 litre petrol '
                "engine, meeting Euro 6 emissions standards. Inside, you'll "
                'find a host of premium features designed for comfort and '
                'convenience, including Electronic Air Temperature Control for '
                'effortless climate management. Entertainment is elevated by '
                'the B&O Premium Audio System, seamlessly integrated with Ford '
                'SYNC 3 Navigation, which supports Android Auto, Apple '
                'CarPlay, and Bluetooth connectivity. For added convenience, '
                'the vehicle includes wireless phone charging and rear parking '
                'sensors to assist with manoeuvring.\n'
                '\n'
                'Experience impressive performance with this Ford Puma, '
                'accelerating from 0 to 62 miles per hour in just 8.9 seconds. '
                'Its fuel economy is a standout feature, achieving an '
                'excellent 51 miles per gallon, and it also boasts low CO2 '
                'emissions, indicating a more environmentally conscious drive '
                'compared to many similar vehicles. These highlights '
                'demonstrate how this particular Puma ST-Line X provides a '
                'compelling blend of dynamic driving, advanced technology, and '
                'cost effective motoring.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 153,
 'fuel_type': 'Petrol',
 'id': '3f67a98d-dd3a-55e6-9d41-8dc112f1c459',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511127831368',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 19200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f67a98d-dd3a-55e6-9d41-8dc112f1c459/3f67a98d-dd3a-55e6-9d41-8dc112f1c459_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260164,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/85b28cfa54c84e9ea5caee74b6b7617a.jpg',
             'Width': 2048}],
 'price': 14499,
 'price_includes_vat': True,
 'registration_date': '2021-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0T EcoBoost MHEV ST-Line X Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127831368%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511127831368: {'created_time': 1774523471.34878, 'last_price_update_time': 1774523471.348788}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511127831368') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 38fa708c-50fc-5cbe-bf04-060fcb67a51d with identifier 202510307538512
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 38fa708c-50fc-5cbe-bf04-060fcb67a51d
2026-03-26 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/60ae8df310b24051a8911ab199d6947e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Discover this 2020 Mazda CX-5 SKYACTIV-G Sport with '
                'exceptionally low mileage, having covered just 22900 miles. '
                'This Euro 6 compliant model boasts a 2.0 litre petrol engine '
                'and comes equipped with front and rear parking sensors, '
                'complete with an audible warning and a reversing camera to '
                'aid your parking manoeuvres. Enjoy the convenience of the '
                'integrated Bluetooth system for seamless connectivity and the '
                'advanced Colour Active Driving Display, which projects key '
                "information onto the windscreen. Inside, you'll find the "
                'comfort of heated front seats with three stage settings, '
                'ensuring a pleasant drive in any weather.\n'
                '\n'
                'This Mazda CX-5 Sport offers significant advantages over '
                'similar vehicles. Its very low mileage for its age indicates '
                'less wear and tear, suggesting a well preserved example. '
                'Furthermore, its low insurance group rating means potentially '
                'lower running costs for owners. Practicality is also a strong '
                'point, with large boot space providing ample room for '
                'luggage, shopping, or equipment, making it a versatile choice '
                'for families and individuals alike.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 163,
 'fuel_type': 'Petrol',
 'id': '38fa708c-50fc-5cbe-bf04-060fcb67a51d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510307538512',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 22900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38fa708c-50fc-5cbe-bf04-060fcb67a51d/38fa708c-50fc-5cbe-bf04-060fcb67a51d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247056,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/60ae8df310b24051a8911ab199d6947e.jpg',
             'Width': 2048}],
 'price': 19299,
 'price_includes_vat': True,
 'registration_date': '2020-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 SKYACTIV-G Sport Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510307538512%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510307538512: {'created_time': 1774523471.392777, 'last_price_update_time': 1774523471.392786}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510307538512') HTTP/1.1" 204 0
2026-03-26 11:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0a2569aa16bb4484852ae08f2bd6b224.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4b311a4849b24b6b96c1c5abc89ad94f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51e5e010>
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f78212e4-187e-5fd5-91b5-69f59868d23f/f78212e4-187e-5fd5-91b5-69f59868d23f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fabb3dd07beeb476ab76eec12b4ee0bad.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/abb3dd07beeb476ab76eec12b4ee0bad.jpg saved to cache
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f78212e4-187e-5fd5-91b5-69f59868d23f
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f78212e4-187e-5fd5-91b5-69f59868d23f sending to next pipeline
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51148e50>
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc49845-c31c-56f6-a889-03737f81f473/ffc49845-c31c-56f6-a889-03737f81f473_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6a9bea2d83134478b617014d83c9527c.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6a9bea2d83134478b617014d83c9527c.jpg saved to cache
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffc49845-c31c-56f6-a889-03737f81f473
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffc49845-c31c-56f6-a889-03737f81f473 sending to next pipeline
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c581c0fd0>
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a92f25-bae0-547a-bd4d-9150153cd920/69a92f25-bae0-547a-bd4d-9150153cd920_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F440198efa7254f59831ccdfae02cbb60.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/440198efa7254f59831ccdfae02cbb60.jpg saved to cache
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69a92f25-bae0-547a-bd4d-9150153cd920
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69a92f25-bae0-547a-bd4d-9150153cd920 sending to next pipeline
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d5bb024f-6c75-5925-9851-9b5943fc5144 with identifier: 202507024081007
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d5bb024f-6c75-5925-9851-9b5943fc5144
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7492a5f79de417388000ce409cb12df.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7492a5f79de417388000ce409cb12df.jpg not downloaded yet
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fb87b6ee-25d8-5c89-9a77-7823f24a1822 with identifier: 202509036011291
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fb87b6ee-25d8-5c89-9a77-7823f24a1822
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9f4cf4f6a0c45619836fcb33f3f9f75.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9f4cf4f6a0c45619836fcb33f3f9f75.jpg not downloaded yet
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f78212e4-187e-5fd5-91b5-69f59868d23f with identifier 202510287469626
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f78212e4-187e-5fd5-91b5-69f59868d23f
2026-03-26 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/abb3dd07beeb476ab76eec12b4ee0bad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2019 Volkswagen Polo TSI Beats is a superb example of a '
                'well maintained compact car.  It features a responsive 1.0 '
                'litre petrol engine and meets Euro 6 emission standards.  '
                "Inside, you'll find the Composition Media system with "
                'Bluetooth connectivity, allowing for seamless audio streaming '
                'and calls.  Enjoy your favourite music with the branded beats '
                'Audio sound system, and stay connected on the go with Car Net '
                'App Connect, which includes both Android Auto and Apple '
                'CarPlay.  Manual air conditioning ensures a comfortable cabin '
                'temperature whatever the weather.\n'
                '\n'
                'SERVICE HISTORY: one main dealer service recorded at 25,000 '
                'miles. This vehicle will be serviced prior to sale.\n'
                '\n'
                'This vehicle is in lovely condition and is available to view '
                'now! Call for more details!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 94,
 'fuel_type': 'Petrol',
 'id': 'f78212e4-187e-5fd5-91b5-69f59868d23f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510287469626',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 43100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f78212e4-187e-5fd5-91b5-69f59868d23f/f78212e4-187e-5fd5-91b5-69f59868d23f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258360,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/abb3dd07beeb476ab76eec12b4ee0bad.jpg',
             'Width': 2048}],
 'price': 11799,
 'price_includes_vat': True,
 'registration_date': '2019-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI beats Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'beats',
 'year': 2019}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510287469626%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510287469626: {'created_time': 1774523471.792595, 'last_price_update_time': 1774523471.792606}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510287469626') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ffc49845-c31c-56f6-a889-03737f81f473 with identifier 202511107788113
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ffc49845-c31c-56f6-a889-03737f81f473
2026-03-26 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6a9bea2d83134478b617014d83c9527c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2017 Ford Focus RS is a remarkable example, boasting '
                'exceptionally low mileage for its age at just 29,400 miles. '
                'This performance focused model features a potent 2.3L petrol '
                'engine paired with a sophisticated Four Wheel Drive system, '
                'ensuring dynamic handling and exhilarating performance. As a '
                'Euro 6 compliant vehicle, it meets modern emissions '
                'standards. The RS trim is further enhanced by a suite of '
                'desirable features, including the Ford SYNC3 Navigation '
                'System complete with a rear camera for parking assistance. '
                'The Luxury Pack adds convenience with keyless entry and rear '
                'parking sensors, while the dual zone electronic automatic '
                'climate control ensures comfort for all occupants. '
                'Practicality is also considered with door edge protectors, '
                'and the striking 19 inch forged black alloy wheels complete '
                'the aggressive stance.\n'
                '\n'
                'The performance of this Ford Focus RS is truly exceptional, '
                'highlighted by its rapid 0-62mph acceleration in just 4.7 '
                'seconds. This impressive figure demonstrates its superior '
                'performance capabilities when compared to many other vehicles '
                'in its class. The combination of its powerful engine, '
                'advanced Four Wheel Drive, and low mileage makes this '
                'particular RS a standout choice for any enthusiast seeking a '
                'thrilling and well maintained driving experience.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.3L',
 'engine_horse_power': 345,
 'fuel_type': 'Petrol',
 'id': 'ffc49845-c31c-56f6-a889-03737f81f473',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511107788113',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 29400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 58,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc49845-c31c-56f6-a889-03737f81f473/ffc49845-c31c-56f6-a889-03737f81f473_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251278,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6a9bea2d83134478b617014d83c9527c.jpg',
             'Width': 2048}],
 'price': 29799,
 'price_includes_vat': True,
 'registration_date': '2017-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.3T EcoBoost RS AWD Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2017}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107788113%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511107788113: {'created_time': 1774523471.8373, 'last_price_update_time': 1774523471.83731}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511107788113') HTTP/1.1" 204 0
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 69a92f25-bae0-547a-bd4d-9150153cd920 with identifier 202511107774603
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 69a92f25-bae0-547a-bd4d-9150153cd920
2026-03-26 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/440198efa7254f59831ccdfae02cbb60.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Black',
 'currency': 'GBP',
 'description': '12 to 36 month  Autoprotect Warranties available and Ceramic '
                'Coating.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 228,
 'fuel_type': 'Petrol',
 'id': '69a92f25-bae0-547a-bd4d-9150153cd920',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511107774603',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 16800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a92f25-bae0-547a-bd4d-9150153cd920/69a92f25-bae0-547a-bd4d-9150153cd920_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255644,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/440198efa7254f59831ccdfae02cbb60.jpg',
             'Width': 2048}],
 'price': 21999,
 'price_includes_vat': True,
 'registration_date': '2021-10-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 John Cooper Works Steptronic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'John Cooper Works',
 'year': 2021}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107774603%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511107774603: {'created_time': 1774523471.882117, 'last_price_update_time': 1774523471.882125}
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511107774603') HTTP/1.1" 204 0
2026-03-26 11:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/977b64e8267b4f5ea2cc5057d6483532.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e536f60fce7749f0a444b68bb972c753.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/691893ce851647589e11a712512b09ae.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f4ab681-e075-5fc5-bd2a-7309bd5b8e97 with identifier: 202506304004357
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6f4ab681-e075-5fc5-bd2a-7309bd5b8e97
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27e6b47c5cac4865bad45814032b8356.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27e6b47c5cac4865bad45814032b8356.jpg not downloaded yet
2026-03-26 11:11:11 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 139aa15e-c669-5c0a-9e9e-9abc535420c3 with identifier: 202509036010711
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 139aa15e-c669-5c0a-9e9e-9abc535420c3
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73dff440c8e04ac6bce0aef576df44c2.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73dff440c8e04ac6bce0aef576df44c2.jpg not downloaded yet
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513918d0>
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49bad858-4715-5ed3-b909-cdeab7b4981c/49bad858-4715-5ed3-b909-cdeab7b4981c_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5c857eaa41834b5caf24f89fa478ad81.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5c857eaa41834b5caf24f89fa478ad81.jpg saved to cache
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49bad858-4715-5ed3-b909-cdeab7b4981c
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49bad858-4715-5ed3-b909-cdeab7b4981c sending to next pipeline
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c511be190>
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56ef0fb1-3b6a-57dd-b894-6fca60254f2d/56ef0fb1-3b6a-57dd-b894-6fca60254f2d_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4c2acbdf4d03478eb53b09c0717ca51b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4c2acbdf4d03478eb53b09c0717ca51b.jpg saved to cache
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56ef0fb1-3b6a-57dd-b894-6fca60254f2d
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56ef0fb1-3b6a-57dd-b894-6fca60254f2d sending to next pipeline
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5140a550>
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84fc0799-21b5-51bf-8832-14444a26ada7/84fc0799-21b5-51bf-8832-14444a26ada7_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a2569aa16bb4484852ae08f2bd6b224.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a2569aa16bb4484852ae08f2bd6b224.jpg saved to cache
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84fc0799-21b5-51bf-8832-14444a26ada7
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84fc0799-21b5-51bf-8832-14444a26ada7 sending to next pipeline
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c511bd1d0>
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0665c9a2-d844-57e2-b543-476bc840a643/0665c9a2-d844-57e2-b543-476bc840a643_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b311a4849b24b6b96c1c5abc89ad94f.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b311a4849b24b6b96c1c5abc89ad94f.jpg saved to cache
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0665c9a2-d844-57e2-b543-476bc840a643
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0665c9a2-d844-57e2-b543-476bc840a643 sending to next pipeline
2026-03-26 11:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b202aa2bdb144ca39d6381573065ba57.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 49bad858-4715-5ed3-b909-cdeab7b4981c with identifier 202510287468420
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 49bad858-4715-5ed3-b909-cdeab7b4981c
2026-03-26 11:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5c857eaa41834b5caf24f89fa478ad81.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2021 CUPRA Formentor eHybrid V2 presents a remarkable '
                'opportunity with its exceptionally low mileage of just 33,300 '
                'miles for its age. This Euro 6 compliant plug in hybrid '
                'combines a 1.4 litre petrol engine with electric power, '
                'offering an efficient and dynamic driving experience.  The V2 '
                'trim level ensures a host of desirable features are included '
                'as standard, such as Kessy keyless entry and start for '
                'effortless access and ignition, alongside a rear view camera '
                'to aid with parking manoeuvres.\n'
                '\n'
                'Further enhancing your comfort and convenience, this '
                'Formentor boasts a heated leather multi function steering '
                'wheel complete with gear shift paddles for engaging control. '
                'You and your passengers will appreciate the three zone '
                'climate control, allowing personalised temperature settings '
                'for everyone, with a dedicated control panel in the rear. '
                'Connectivity is seamless with wireless Apple CarPlay, keeping '
                'your essential apps accessible on the go. These features '
                'collectively demonstrate the superior level of specification '
                'and thoughtful design found in this CUPRA Formentor compared '
                'to other vehicles in its class.\n'
                '\n'
                'Available now for viewing! Please call us to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 201,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '49bad858-4715-5ed3-b909-cdeab7b4981c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510287468420',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'CUPRA',
 'model': 'Formentor',
 'odometer': 33300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49bad858-4715-5ed3-b909-cdeab7b4981c/49bad858-4715-5ed3-b909-cdeab7b4981c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 259712,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5c857eaa41834b5caf24f89fa478ad81.jpg',
             'Width': 2048}],
 'price': 18799,
 'price_includes_vat': True,
 'registration_date': '2021-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'CUPRA Formentor 1.4 eHybrid 12.8kWh V2 DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'V2',
 'year': 2021}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510287468420%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510287468420: {'created_time': 1774523472.24664, 'last_price_update_time': 1774523472.246649}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510287468420') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 56ef0fb1-3b6a-57dd-b894-6fca60254f2d with identifier 202509196467734
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 56ef0fb1-3b6a-57dd-b894-6fca60254f2d
2026-03-26 11:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4c2acbdf4d03478eb53b09c0717ca51b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2018 Mercedes Benz E Class E220d AMG Line (Premium) '
                'presents an exceptional opportunity with its remarkably low '
                'mileage of just 52,600 miles for its age. This Euro 6 '
                'compliant model boasts a powerful yet efficient 2.0L diesel '
                'engine, paired with the sophisticated AMG Line trim. The '
                'Premium Package enhances the driving experience, including '
                'convenient memory seats and automatic two zone climate '
                'control to ensure comfort for all occupants. Navigating tight '
                'spaces is made effortless thanks to the Parking Pilot system, '
                'complete with front and rear parking sensors and a reversing '
                'camera, all designed to assist you.\n'
                '\n'
                'The generous boot space offers practicality for everyday '
                'needs and longer journeys alike. The heated front seats '
                'provide an added touch of luxury, especially during colder '
                'months. These carefully selected features, combined with the '
                "vehicle's excellent provenance, demonstrate a superior level "
                'of comfort, convenience, and advanced technology compared to '
                'other vehicles in its class. This E Class is a testament to '
                "Mercedes Benz's commitment to quality and driver focused "
                'design.\n'
                '\n'
                'SERVICE HISTORY: 4 services, last at 47,000 miles.\n'
                '\n'
                'Give us a call now to learn more!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 191,
 'fuel_type': 'Diesel',
 'id': '56ef0fb1-3b6a-57dd-b894-6fca60254f2d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509196467734',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'E Class',
 'odometer': 52600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56ef0fb1-3b6a-57dd-b894-6fca60254f2d/56ef0fb1-3b6a-57dd-b894-6fca60254f2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250754,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4c2acbdf4d03478eb53b09c0717ca51b.jpg',
             'Width': 2048}],
 'price': 18999,
 'price_includes_vat': True,
 'registration_date': '2018-08-13',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E Class 2.0 E220d AMG Line (Premium) G-Tronic+ Euro 6 '
          '(s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509196467734%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509196467734: {'created_time': 1774523472.291273, 'last_price_update_time': 1774523472.291281}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509196467734') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 84fc0799-21b5-51bf-8832-14444a26ada7 with identifier 202511107774528
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 84fc0799-21b5-51bf-8832-14444a26ada7
2026-03-26 11:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0a2569aa16bb4484852ae08f2bd6b224.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 69,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2020 Volvo XC90 h T8 R Design is a remarkable example, '
                'boasting exceptionally low mileage for its age at just 49,800 '
                'miles. This premium seven seater SUV is equipped with a '
                'powerful 2.0 litre petrol plug in hybrid engine and Four '
                'Wheel Drive, ensuring a dynamic and efficient driving '
                'experience. Its Euro 6 emission class reflects its modern '
                'environmental credentials, and it offers a substantial towing '
                'weight of 2400 kg. The R Design trim level is further '
                'enhanced by striking 22 inch alloy wheels in a five double '
                'spoke diamond cut matt black finish, and a power glass tilt '
                'and slide panoramic sunroof with a sun curtain, creating an '
                'airy and sophisticated cabin.\n'
                '\n'
                "Experience exhilarating performance with the XC90's "
                'impressive 0 to 60 mph acceleration in just 5.5 seconds, a '
                'testament to its advanced hybrid technology and a clear '
                'indicator of its superior performance compared to many other '
                'vehicles in its class. The Lounge Pack further elevates '
                'comfort and convenience, complementing the already generous '
                'specification. Practicality is also a key consideration, with '
                'the inclusion of wireless inductive mobile phone charging and '
                'the Driver Assist package, which features Blind Spot '
                'Assistance, providing added peace of mind on every journey.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 385,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '84fc0799-21b5-51bf-8832-14444a26ada7',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511107774528',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 49800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84fc0799-21b5-51bf-8832-14444a26ada7/84fc0799-21b5-51bf-8832-14444a26ada7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269376,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a2569aa16bb4484852ae08f2bd6b224.jpg',
             'Width': 2048}],
 'price': 32499,
 'price_includes_vat': True,
 'registration_date': '2020-12-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.0h T8 Twin Engine Recharge 11.6kWh R-Design Auto 4WD '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2020}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107774528%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511107774528: {'created_time': 1774523472.334853, 'last_price_update_time': 1774523472.334862}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511107774528') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0665c9a2-d844-57e2-b543-476bc840a643 with identifier 202509306742763
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0665c9a2-d844-57e2-b543-476bc840a643
2026-03-26 11:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4b311a4849b24b6b96c1c5abc89ad94f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2021 Citroen C1 VTi Shine is an exceptional find, '
                'boasting remarkably low mileage for its age at just 12,300 '
                'miles. This particular model, finished in the desirable Shine '
                'trim, is powered by an efficient 1.0L petrol engine and meets '
                "the Euro 6 emission standards. Inside, you'll discover a "
                'wealth of modern technology, including a 7in Touch Drive '
                'Interface that seamlessly integrates with both Android Auto '
                'and Apple CarPlay, allowing for easy access to your favourite '
                'apps and navigation. For added convenience and safety, it '
                'features a reversing camera and a comprehensive audio system '
                'complete with DAB digital radio, MP3 playback, four speakers, '
                'Bluetooth handsfree connectivity, a USB socket, and steering '
                'mounted controls.\n'
                '\n'
                'SERVICE HISTORY: one recorded. This vehicle will be serviced '
                'prior to sale.\n'
                '\n'
                'Come and take a look now!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 71,
 'fuel_type': 'Petrol',
 'id': '0665c9a2-d844-57e2-b543-476bc840a643',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509306742763',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 12300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0665c9a2-d844-57e2-b543-476bc840a643/0665c9a2-d844-57e2-b543-476bc840a643_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245266,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b311a4849b24b6b96c1c5abc89ad94f.jpg',
             'Width': 2048}],
 'price': 9399,
 'price_includes_vat': True,
 'registration_date': '2021-11-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Shine Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2021}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509306742763%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509306742763: {'created_time': 1774523472.381446, 'last_price_update_time': 1774523472.381454}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509306742763') HTTP/1.1" 204 0
2026-03-26 11:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b476df1e3c4b455aafdd28c645e80037.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4defca1a-2c31-5786-a2fc-f2c7112317f2 with identifier: 202506303996691
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4defca1a-2c31-5786-a2fc-f2c7112317f2
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4f46ece891f4476b99acfb5ea38b8e6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4f46ece891f4476b99acfb5ea38b8e6.jpg not downloaded yet
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e6f4f8c-7310-5777-b7c3-03c3db5e7a53 with identifier: 202509036009529
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4e6f4f8c-7310-5777-b7c3-03c3db5e7a53
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F975df304c61f49ea9a787b91fa4f5da5.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/975df304c61f49ea9a787b91fa4f5da5.jpg not downloaded yet
2026-03-26 11:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/19fd723d04d54cc3a41e1d6318468d80.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/545d3116049f473b9f0f53247d1511a1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a8edf125-f3d1-5489-b245-0753cdefaa97 with identifier: 202506253847597
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a8edf125-f3d1-5489-b245-0753cdefaa97
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ccc43c350ec48e2b692a1fac37e2958.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ccc43c350ec48e2b692a1fac37e2958.jpg not downloaded yet
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:12 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd22cbf-c6fb-5c59-9415-95a9d17d0b07 with identifier: 202509015942475
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0fd22cbf-c6fb-5c59-9415-95a9d17d0b07
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F802c7c3e33ff4877931eaf6c1a2e356d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/802c7c3e33ff4877931eaf6c1a2e356d.jpg not downloaded yet
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5127bed0>
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_656c10bb-9f48-5f1f-945f-d9402c0a2608/656c10bb-9f48-5f1f-945f-d9402c0a2608_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F977b64e8267b4f5ea2cc5057d6483532.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/977b64e8267b4f5ea2cc5057d6483532.jpg saved to cache
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 656c10bb-9f48-5f1f-945f-d9402c0a2608
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 656c10bb-9f48-5f1f-945f-d9402c0a2608 sending to next pipeline
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f38090>
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b/cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe536f60fce7749f0a444b68bb972c753.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e536f60fce7749f0a444b68bb972c753.jpg saved to cache
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b sending to next pipeline
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5a57f750>
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_966c9b5c-5db4-5ce2-ae14-76016b96c0d8/966c9b5c-5db4-5ce2-ae14-76016b96c0d8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F691893ce851647589e11a712512b09ae.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/691893ce851647589e11a712512b09ae.jpg saved to cache
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 966c9b5c-5db4-5ce2-ae14-76016b96c0d8
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 966c9b5c-5db4-5ce2-ae14-76016b96c0d8 sending to next pipeline
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51279a90>
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1d25bda-928a-54b4-abc4-3fb4706d836f/e1d25bda-928a-54b4-abc4-3fb4706d836f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb202aa2bdb144ca39d6381573065ba57.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b202aa2bdb144ca39d6381573065ba57.jpg saved to cache
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1d25bda-928a-54b4-abc4-3fb4706d836f
2026-03-26 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1d25bda-928a-54b4-abc4-3fb4706d836f sending to next pipeline
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 656c10bb-9f48-5f1f-945f-d9402c0a2608 with identifier 202511067691588
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 656c10bb-9f48-5f1f-945f-d9402c0a2608
2026-03-26 11:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/977b64e8267b4f5ea2cc5057d6483532.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2020 Ford Puma T Titanium is a remarkable find, boasting '
                'exceptionally low mileage for its age at just 17,900 miles. '
                'This stylish compact SUV is powered by an efficient 1.0L '
                'petrol engine, meeting Euro 6 emissions standards. Inside, '
                "you'll appreciate the comfort provided by Electronic Air "
                'Temperature Control, which includes climate control, and the '
                'convenience of rear parking sensors for easier manoeuvring. '
                'Stay connected and entertained with the Ford SYNC 3 '
                'Navigation system, offering seamless integration with Android '
                'Auto and Apple CarPlay, alongside Bluetooth connectivity. '
                'Plus, keep your compatible phone topped up with the '
                'integrated wireless charging pad.\n'
                '\n'
                'The Ford Puma T Titanium stands out with its impressive fuel '
                'economy, achieving up to 49 miles per gallon, which indicates '
                'it is more economical than many similar vehicles. '
                'Furthermore, its low insurance group rating suggests that '
                'running costs will be more affordable. The vehicle also '
                'benefits from low CO2 emissions, highlighting its '
                'environmental consideration compared to other cars in its '
                'class. This combination of efficiency, technology, and '
                'practicality makes this Puma a compelling choice.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '656c10bb-9f48-5f1f-945f-d9402c0a2608',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511067691588',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 17900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_656c10bb-9f48-5f1f-945f-d9402c0a2608/656c10bb-9f48-5f1f-945f-d9402c0a2608_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261252,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/977b64e8267b4f5ea2cc5057d6483532.jpg',
             'Width': 2048}],
 'price': 12999,
 'price_includes_vat': True,
 'registration_date': '2020-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0T EcoBoost Titanium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511067691588%27 HTTP/1.1" 200 None
2026-03-26 11:11:12 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511067691588: {'created_time': 1774523472.980141, 'last_price_update_time': 1774523472.98015}
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511067691588') HTTP/1.1" 204 0
2026-03-26 11:11:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b with identifier 202511067692150
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e536f60fce7749f0a444b68bb972c753.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2019 Land Rover Range Rover Velar D300 R Dynamic HSE '
                'boasts exceptionally low mileage for its age, having covered '
                'just 43,500 miles. This premium SUV features a powerful 3.0L '
                'diesel engine paired with a Four Wheel Drive system, ensuring '
                'confident performance in all conditions. As a Euro 6 '
                'compliant vehicle, it meets stringent emission standards. The '
                'R Dynamic HSE trim level signifies a high specification, '
                'enhanced by a sliding panoramic roof that floods the cabin '
                'with light.\n'
                '\n'
                'Experience effortless driving and superior comfort with this '
                'Range Rover Velar. Its impressive acceleration, reaching '
                '0-60mph in just 6.3 seconds, demonstrates its dynamic '
                'capability. The Meridian Surround Sound System provides an '
                'immersive audio experience, while the 360 Degree Parking Aid '
                'and Park Assist, complete with front and rear sensors, make '
                'manoeuvring in tight spaces remarkably simple. With a '
                'substantial towing weight of 2500 kg and generous boot space, '
                'this Velar is as practical as it is refined, offering a '
                'distinguished driving experience that sets it apart.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': 'cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511067692150',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 43500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b/cb2636f9-b9c7-537c-b71f-57a1bfb2aa4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249826,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e536f60fce7749f0a444b68bb972c753.jpg',
             'Width': 2048}],
 'price': 29499,
 'price_includes_vat': True,
 'registration_date': '2019-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 D300 R-Dynamic HSE Auto 4WD Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE',
 'year': 2019}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511067692150%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511067692150: {'created_time': 1774523473.024052, 'last_price_update_time': 1774523473.024061}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511067692150') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 966c9b5c-5db4-5ce2-ae14-76016b96c0d8 with identifier 202510247387521
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 966c9b5c-5db4-5ce2-ae14-76016b96c0d8
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/691893ce851647589e11a712512b09ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2024 Vauxhall Astra Turbo GS offers a Euro 6 compliant '
                '1.2L petrol engine, ensuring efficient performance for your '
                'journeys. This model comes equipped with the Pure Panel Pro '
                'Navigation system, seamlessly integrating Android Auto, Apple '
                'CarPlay, and Bluetooth for your connectivity needs. Enjoy '
                'enhanced comfort with heated front seats and a heated '
                'steering wheel, perfect for colder days. The convenience of '
                'keyless entry and start, along with front and rear parking '
                'distance sensors, makes every drive and manoeuvre simpler and '
                'more secure.\n'
                '\n'
                'The Vauxhall Astra Turbo GS stands out with its impressive '
                'fuel economy, achieving up to 49 miles per gallon, which is '
                'better than many other vehicles in its class. Its low CO2 '
                'emissions also contribute to a more environmentally conscious '
                'drive. Furthermore, the generous boot space provides ample '
                'room for luggage, shopping, or equipment, making it a '
                'practical choice for families and individuals alike.\n'
                '\n'
                'SERVICE HISTORY: this vehicle will be serviced prior to '
                'sale.\n'
                '\n'
                'Available now to view, call us for more information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': '966c9b5c-5db4-5ce2-ae14-76016b96c0d8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510247387521',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Vauxhall',
 'model': 'Astra',
 'odometer': 10000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_966c9b5c-5db4-5ce2-ae14-76016b96c0d8/966c9b5c-5db4-5ce2-ae14-76016b96c0d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241178,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/691893ce851647589e11a712512b09ae.jpg',
             'Width': 2048}],
 'price': 17799,
 'price_includes_vat': True,
 'registration_date': '2024-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Astra 1.2 Turbo GS Sports Tourer Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510247387521%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510247387521: {'created_time': 1774523473.075204, 'last_price_update_time': 1774523473.075215}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510247387521') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e1d25bda-928a-54b4-abc4-3fb4706d836f with identifier 202509116245202
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e1d25bda-928a-54b4-abc4-3fb4706d836f
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b202aa2bdb144ca39d6381573065ba57.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma ST offers an exhilarating driving '
                'experience with its impressive 1.5L EcoBoost petrol engine, '
                'capable of accelerating from 0 to 62mph in a mere 6.7 '
                'seconds. As a Euro 6 compliant vehicle, it meets stringent '
                'emission standards. This model comes equipped with a Ford '
                'KeyFree System for effortless keyless entry, ensuring '
                'convenience from the moment you approach. For enhanced '
                'comfort and ease, it features heated front seats and a heated '
                'steering wheel, perfect for those colder mornings. Parking is '
                'made simpler with both front and rear parking sensors, '
                'further supported by parking assistance technology.\n'
                '\n'
                'The performance credentials of this Ford Puma ST are truly '
                'noteworthy, setting it apart from many other vehicles in its '
                'class. The rapid acceleration highlights its sporty nature, '
                'while the inclusion of front and rear parking sensors with '
                'assistance demonstrates a commitment to practical usability. '
                'The heated front seats and heated steering wheel offer a '
                'touch of luxury and comfort, making every journey more '
                'enjoyable. Combined with the advanced Ford KeyFree System, '
                'this Puma ST is designed to impress with both its dynamic '
                'capabilities and its thoughtful features.\n'
                '\n'
                'SERVICE HISTORY: one main dealer service recorded. This '
                'vehicle will be serviced prior to sale.\n'
                '\n'
                'This Puma is available for viewing, please give us a call to '
                'learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': 'e1d25bda-928a-54b4-abc4-3fb4706d836f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509116245202',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 23200,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1d25bda-928a-54b4-abc4-3fb4706d836f/e1d25bda-928a-54b4-abc4-3fb4706d836f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267071,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b202aa2bdb144ca39d6381573065ba57.jpg',
             'Width': 2048}],
 'price': 18299,
 'price_includes_vat': True,
 'registration_date': '2023-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2023}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116245202%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509116245202: {'created_time': 1774523473.123234, 'last_price_update_time': 1774523473.123247}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509116245202') HTTP/1.1" 204 0
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7d21bcf509b84e28872588a805ed18e0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2bfba102054d48b8bf78d95a8e3c7976.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d9ad9804d7dd4b4fb45a94c11338f4f5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a9b9f08-4ac7-5a41-8d72-66d796c19808 with identifier: 202506233778379
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0a9b9f08-4ac7-5a41-8d72-66d796c19808
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe49fc3ce2e4d435eb61e6ba978f4c13b.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e49fc3ce2e4d435eb61e6ba978f4c13b.jpg not downloaded yet
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0 with identifier: 202508275782157
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6af1bbac3fcb4f1881bd9453b35f523f.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6af1bbac3fcb4f1881bd9453b35f523f.jpg not downloaded yet
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51256490>
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb73a5dd-d571-5c13-89ad-1188b7ef445f/fb73a5dd-d571-5c13-89ad-1188b7ef445f_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb476df1e3c4b455aafdd28c645e80037.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b476df1e3c4b455aafdd28c645e80037.jpg saved to cache
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb73a5dd-d571-5c13-89ad-1188b7ef445f
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb73a5dd-d571-5c13-89ad-1188b7ef445f sending to next pipeline
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51ed4250>
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74778f00-e0cb-52a6-8501-66b63aef4623/74778f00-e0cb-52a6-8501-66b63aef4623_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19fd723d04d54cc3a41e1d6318468d80.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19fd723d04d54cc3a41e1d6318468d80.jpg saved to cache
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74778f00-e0cb-52a6-8501-66b63aef4623
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74778f00-e0cb-52a6-8501-66b63aef4623 sending to next pipeline
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513b0910>
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d72ea532-0cb1-5a65-a01d-953858fec299/d72ea532-0cb1-5a65-a01d-953858fec299_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F545d3116049f473b9f0f53247d1511a1.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/545d3116049f473b9f0f53247d1511a1.jpg saved to cache
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d72ea532-0cb1-5a65-a01d-953858fec299
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d72ea532-0cb1-5a65-a01d-953858fec299 sending to next pipeline
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/29acdd08ab604e26b978c78fd4b52bc0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: da61703a-ad49-5e2e-8a1c-7bb0ffc1d285 with identifier: 202506173586080
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item da61703a-ad49-5e2e-8a1c-7bb0ffc1d285
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd191b5f3b767430c892c518b06fc002c.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d191b5f3b767430c892c518b06fc002c.jpg not downloaded yet
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a80a53dc-b6e5-5a9a-b301-20f73f7d1157 with identifier: 202508265760554
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a80a53dc-b6e5-5a9a-b301-20f73f7d1157
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38bbf2f187494bc09990f489f562f3eb.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38bbf2f187494bc09990f489f562f3eb.jpg not downloaded yet
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fb73a5dd-d571-5c13-89ad-1188b7ef445f with identifier 202508215632964
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fb73a5dd-d571-5c13-89ad-1188b7ef445f
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b476df1e3c4b455aafdd28c645e80037.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2012 Porsche Boxster 981 is a truly special find, '
                'boasting a desirable specification and excellent condition.  '
                "Under the bonnet, you'll find a potent 2.7 litre petrol "
                'engine, paired with a smooth transmission for an engaging '
                'driving experience.  This particular model is equipped with '
                'eye catching 20 inch Carrera Classic alloy wheels, and for '
                'your comfort, it features two zone automatic climate control '
                'and heated front seats.  The electrically folding exterior '
                'mirrors add a touch of convenience, and it’s worth noting '
                'this Boxster sits in a low insurance group, making it an '
                'accessible choice for many.\n'
                '\n'
                'The performance of this Porsche Boxster is truly impressive, '
                'with a brisk 0 to 62 miles per hour acceleration time of just '
                '5.7 seconds, demonstrating its sporting pedigree. These '
                'highlights, combined with its refined features and accessible '
                'insurance, set this 2012 Porsche Boxster 981 apart from other '
                'vehicles in its class, offering a compelling blend of '
                'performance, comfort, and style.\n'
                '\n'
                'The car has 11 stamps of service history with the last '
                'carried out at 67,000 miles in April 2025.  The PDK Oil '
                'change was carried out at 66,000 miles in February 2025. \n'
                '\n'
                'If you would like to view this vehicle, please pop in and see '
                'us, any questions we are only a phone call away!',
 'doors_number': 2,
 'emission_standard': 'Euro 5',
 'engine': '2.7L',
 'engine_horse_power': 261,
 'fuel_type': 'Petrol',
 'id': 'fb73a5dd-d571-5c13-89ad-1188b7ef445f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508215632964',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Porsche',
 'model': 'Boxster',
 'odometer': 70000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb73a5dd-d571-5c13-89ad-1188b7ef445f/fb73a5dd-d571-5c13-89ad-1188b7ef445f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260062,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b476df1e3c4b455aafdd28c645e80037.jpg',
             'Width': 2048}],
 'price': 22799,
 'price_includes_vat': True,
 'registration_date': '2012-12-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Porsche Boxster 2.7 981 PDK Euro 5 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': '981',
 'year': 2012}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508215632964%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508215632964: {'created_time': 1774523473.486556, 'last_price_update_time': 1774523473.486563}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508215632964') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 74778f00-e0cb-52a6-8501-66b63aef4623 with identifier 202508075225289
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 74778f00-e0cb-52a6-8501-66b63aef4623
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/19fd723d04d54cc3a41e1d6318468d80.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Discover this exceptional 2022 Mercedes Benz CLA180 AMG Line, '
                'a sophisticated vehicle that combines style with '
                'practicality. This particular model boasts the desirable AMG '
                'Line trim, powered by an efficient 1.3 litre petrol engine. '
                'For your convenience and comfort, it features heated front '
                'seats, ensuring a pleasant drive in any weather. Stay '
                'connected and entertained with seamless smartphone '
                'integration, including both Apple CarPlay and Android Auto, '
                'and enjoy easy wireless connectivity through the Bluetooth '
                'system. Navigating tight spaces is made simple with the '
                'comprehensive Parking Package, which includes front and rear '
                'parking sensors along with a rear-view camera.\n'
                '\n'
                'This Mercedes Benz CLA180 AMG Line is designed to impress '
                'with its impressive fuel economy, achieving a highlight of 46 '
                'miles per gallon, and its low CO2 emissions, indicating a '
                'more environmentally conscious choice compared to many '
                'similar vehicles. The automatic headlamp activation, part of '
                'the Headlamp Assist system, provides added safety and '
                'convenience by automatically turning on the headlights when '
                'needed. These carefully selected features and efficient '
                'performance make this 2022 CLA180 AMG Line a compelling '
                'option for those seeking a premium driving experience.\n'
                '\n'
                'SERVICE HISTORY: one service recorded at 30,000 miles.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '74778f00-e0cb-52a6-8501-66b63aef4623',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508075225289',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'CLA',
 'odometer': 31400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74778f00-e0cb-52a6-8501-66b63aef4623/74778f00-e0cb-52a6-8501-66b63aef4623_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246213,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/19fd723d04d54cc3a41e1d6318468d80.jpg',
             'Width': 2048}],
 'price': 20999,
 'price_includes_vat': True,
 'registration_date': '2022-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA 1.3 CLA180 AMG Line Coupe 7G-DCT Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508075225289%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508075225289: {'created_time': 1774523473.540097, 'last_price_update_time': 1774523473.540105}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508075225289') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d72ea532-0cb1-5a65-a01d-953858fec299 with identifier 202509116244569
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d72ea532-0cb1-5a65-a01d-953858fec299
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/545d3116049f473b9f0f53247d1511a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 BMW 4 Series 420i M Sport offers a superb blend of '
                'performance and refinement, boasting a powerful yet efficient '
                '2.0L petrol engine. As a Euro 6 compliant vehicle, it meets '
                'stringent emission standards. This M Sport model comes '
                'equipped with the desirable M Sport Pro Package, enhancing '
                "its sporty appeal and driving dynamics. Inside, you'll find "
                'comfortable Seat Heating for both the driver and front '
                'passenger, alongside Three-Zone Automatic Air Conditioning '
                'for personalised climate control. The BMW Live Cockpit '
                'Professional, complete with Bluetooth connectivity, keeps you '
                'informed and entertained, while the comprehensive Parking '
                'Assistant, including front and rear sensors and a rear '
                'camera, makes manoeuvring effortless.\n'
                '\n'
                'This BMW 4 Series stands out with its impressive 44 mpg fuel '
                'economy, indicating excellent efficiency for its class. '
                'Furthermore, its low CO2 emissions contribute to a more '
                'environmentally conscious drive. The vehicle also benefits '
                'from a low insurance group, potentially making ownership more '
                'affordable. Practicality is not overlooked, with generous '
                'boot space offering ample room for luggage or shopping. These '
                'highlights demonstrate how this particular BMW 4 Series '
                'offers a superior ownership experience compared to many other '
                'vehicles in its segment.\n'
                '\n'
                'SERVICE HISTORY: 3 services on iDRIVE. Last oil service at '
                '30,000 miles.\n'
                '\n'
                'Call us now for more information!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 181,
 'fuel_type': 'Petrol',
 'id': 'd72ea532-0cb1-5a65-a01d-953858fec299',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509116244569',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '4 Series',
 'odometer': 37900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d72ea532-0cb1-5a65-a01d-953858fec299/d72ea532-0cb1-5a65-a01d-953858fec299_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251693,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/545d3116049f473b9f0f53247d1511a1.jpg',
             'Width': 2048}],
 'price': 24499,
 'price_includes_vat': True,
 'registration_date': '2021-09-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4 Series 2.0 420i M Sport Auto Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509116244569%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509116244569: {'created_time': 1774523473.581117, 'last_price_update_time': 1774523473.581124}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509116244569') HTTP/1.1" 204 0
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b7492a5f79de417388000ce409cb12df.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b9f4cf4f6a0c45619836fcb33f3f9f75.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/73dff440c8e04ac6bce0aef576df44c2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-26 11:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/27e6b47c5cac4865bad45814032b8356.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c512650d0>
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e78cf565-a882-5219-8a0c-0232dbd9444a/e78cf565-a882-5219-8a0c-0232dbd9444a_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7d21bcf509b84e28872588a805ed18e0.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7d21bcf509b84e28872588a805ed18e0.jpg saved to cache
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e78cf565-a882-5219-8a0c-0232dbd9444a
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e78cf565-a882-5219-8a0c-0232dbd9444a sending to next pipeline
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51393ad0>
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3066a1b-091f-58c5-8d28-f71e69e359c8/e3066a1b-091f-58c5-8d28-f71e69e359c8_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2bfba102054d48b8bf78d95a8e3c7976.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2bfba102054d48b8bf78d95a8e3c7976.jpg saved to cache
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3066a1b-091f-58c5-8d28-f71e69e359c8
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3066a1b-091f-58c5-8d28-f71e69e359c8 sending to next pipeline
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c58de2410>
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9e7235f-1ad7-51e0-a069-a5a074c98773/f9e7235f-1ad7-51e0-a069-a5a074c98773_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd9ad9804d7dd4b4fb45a94c11338f4f5.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d9ad9804d7dd4b4fb45a94c11338f4f5.jpg saved to cache
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9e7235f-1ad7-51e0-a069-a5a074c98773
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9e7235f-1ad7-51e0-a069-a5a074c98773 sending to next pipeline
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514b4c90>
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2ccf860-0b7d-5e5c-9883-7af0e659cf30/b2ccf860-0b7d-5e5c-9883-7af0e659cf30_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F29acdd08ab604e26b978c78fd4b52bc0.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/29acdd08ab604e26b978c78fd4b52bc0.jpg saved to cache
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2ccf860-0b7d-5e5c-9883-7af0e659cf30
2026-03-26 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2ccf860-0b7d-5e5c-9883-7af0e659cf30 sending to next pipeline
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e78cf565-a882-5219-8a0c-0232dbd9444a with identifier 202508015050524
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e78cf565-a882-5219-8a0c-0232dbd9444a
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7d21bcf509b84e28872588a805ed18e0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 BMW 3 Series 330e M Sport is a Euro 6 compliant '
                'plug in hybrid, offering an impressive blend of performance '
                'and efficiency.  Powered by a 2.0 litre petrol plug in hybrid '
                'engine, this M Sport variant boasts the desirable M Sport Pro '
                'Package.  Inside, you will find the BMW Live Cockpit '
                'Professional, complete with Bluetooth connectivity, and the '
                'BMW Connected Package Professional which includes Android '
                'Auto and Apple CarPlay.  Comfort is assured with automatic '
                'three zone air conditioning, and the rain sensor with '
                'automatic headlight activation ensures convenience in varying '
                'weather conditions.\n'
                '\n'
                'Experience exhilarating performance with a 0 to 62mph '
                'acceleration time of just 5.9 seconds, a testament to the '
                'advanced engineering of this BMW 3 Series. These highlights '
                'demonstrate how this particular model surpasses expectations, '
                'offering a refined driving experience and cutting edge '
                'technology. The combination of its plug in hybrid powertrain '
                'and M Sport enhancements makes this 330e a compelling choice '
                'for those seeking a dynamic and eco conscious vehicle.\n'
                '\n'
                'SERVICE HISTORY: two services on iDRIVE.\n'
                '\n'
                'Available and on site now, call us for further details or pop '
                'in to view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 288,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'e78cf565-a882-5219-8a0c-0232dbd9444a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508015050524',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '3 Series',
 'odometer': 54800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e78cf565-a882-5219-8a0c-0232dbd9444a/e78cf565-a882-5219-8a0c-0232dbd9444a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 233231,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7d21bcf509b84e28872588a805ed18e0.jpg',
             'Width': 2048}],
 'price': 20499,
 'price_includes_vat': True,
 'registration_date': '2021-08-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3 Series 2.0 330e 12kWh M Sport Touring Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508015050524%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508015050524: {'created_time': 1774523473.915058, 'last_price_update_time': 1774523473.915067}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508015050524') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e3066a1b-091f-58c5-8d28-f71e69e359c8 with identifier 202508075215738
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e3066a1b-091f-58c5-8d28-f71e69e359c8
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2bfba102054d48b8bf78d95a8e3c7976.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'Discover this 2021 Nissan Juke DIG-T Tekna+, a stylish and '
                'feature packed compact SUV. This Euro 6 compliant model '
                'boasts a responsive 1.0 litre petrol engine, offering an '
                'impressive fuel economy of 45 miles per gallon.  Inside, '
                "you'll find the convenience of Intelligent Key with Start "
                'Push Button and Keyless Entry, allowing effortless access and '
                'ignition. Stay connected and entertained with seamless '
                'integration of Android Auto and Apple CarPlay, bringing your '
                "favourite apps directly to the car's display.\n"
                '\n'
                'This Juke Tekna+ is designed for ease of use and comfort. '
                'Parking is made simple with both rear and front parking '
                'sensors, providing comprehensive assistance. Enjoy a '
                'consistently comfortable cabin environment thanks to the '
                'automatic air conditioning. The low CO2 emissions highlight '
                'indicates this Juke is an environmentally conscious choice, '
                'performing better than many similar vehicles in its class.\n'
                '\n'
                'SERVICE HISTORY: two stamps, last at 32,000 miles.\n'
                '\n'
                'Give us a call for further information or please feel free to '
                'come in to view!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 112,
 'fuel_type': 'Petrol',
 'id': 'e3066a1b-091f-58c5-8d28-f71e69e359c8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508075215738',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 32400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3066a1b-091f-58c5-8d28-f71e69e359c8/e3066a1b-091f-58c5-8d28-f71e69e359c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 247271,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2bfba102054d48b8bf78d95a8e3c7976.jpg',
             'Width': 2048}],
 'price': 13999,
 'price_includes_vat': True,
 'registration_date': '2021-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T Tekna+ DCT Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Tekna+',
 'year': 2021}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508075215738%27 HTTP/1.1" 200 None
2026-03-26 11:11:13 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508075215738: {'created_time': 1774523473.96082, 'last_price_update_time': 1774523473.960828}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508075215738') HTTP/1.1" 204 0
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f9e7235f-1ad7-51e0-a069-a5a074c98773 with identifier 202509056069302
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f9e7235f-1ad7-51e0-a069-a5a074c98773
2026-03-26 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d9ad9804d7dd4b4fb45a94c11338f4f5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2021 BMW Z4 30i M Sport offers an exceptional driving '
                'experience, combining sporty performance with sophisticated '
                'technology. As a Euro 6 compliant vehicle, it features a '
                'responsive 2.0L petrol engine, delivering an impressive '
                '0-62mph acceleration in just 5.4 seconds. This particular '
                'model boasts the desirable M Sport trim and is equipped with '
                'the M Sport Pro Package, enhancing its dynamic capabilities. '
                "Inside, you'll find the Technology Package, which includes a "
                'Head Up Display for convenient information access and a '
                'Premium Branded Sound System for an immersive audio '
                'experience. The BMW Connected Package Professional, complete '
                'with Apple CarPlay, ensures seamless smartphone integration. '
                'For added convenience and safety, it includes the Parking '
                'Assistant, featuring rear camera and rear sensors, and front '
                'heated seats for comfort in all conditions.\n'
                '\n'
                'The Z4 30i M Sport is designed to impress, with a fuel '
                'economy of up to 40 mpg, making it an efficient choice for '
                'both spirited drives and everyday use. Its large boot space '
                'provides surprising practicality for a sports car, offering '
                'ample room for your luggage. These highlights, such as the '
                'rapid acceleration and excellent fuel efficiency, demonstrate '
                'how this BMW Z4 stands out from other vehicles in its class, '
                'offering a compelling blend of performance, technology, and '
                'everyday usability.\n'
                '\n'
                'SERVICE HISTORY: two services on iDRIVE (one oil). This '
                'vehicle will be serviced prior to sale.\n'
                '\n'
                'Available now to view, call for more details!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 254,
 'fuel_type': 'Petrol',
 'id': 'f9e7235f-1ad7-51e0-a069-a5a074c98773',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509056069302',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 21800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9e7235f-1ad7-51e0-a069-a5a074c98773/f9e7235f-1ad7-51e0-a069-a5a074c98773_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 260985,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d9ad9804d7dd4b4fb45a94c11338f4f5.jpg',
             'Width': 2048}],
 'price': 28999,
 'price_includes_vat': True,
 'registration_date': '2021-08-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z4 2.0 30i M Sport Auto sDrive Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-26 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509056069302%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509056069302: {'created_time': 1774523474.00434, 'last_price_update_time': 1774523474.004347}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509056069302') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b2ccf860-0b7d-5e5c-9883-7af0e659cf30 with identifier 202509086139119
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b2ccf860-0b7d-5e5c-9883-7af0e659cf30
2026-03-26 11:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/29acdd08ab604e26b978c78fd4b52bc0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 305,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'With an incredibly low mileage of just 800 miles, this 2024 '
                'Ford Transit 2.0 460 EcoBlue Limited Auto RWD L4 H3 Euro 6 '
                '(s/s) 5dr is practically new. This one owner vehicle boasts a '
                'powerful 163 bhp 2.0L diesel engine, meeting Euro 6 emissions '
                'standards, and is capable of towing up to 3500 kg. The '
                'Limited trim level ensures a host of desirable features, '
                'including rear air conditioning with independent rear climate '
                'control, a 12in touchscreen with the latest SYNC 4 system '
                'offering Android Auto and Apple CarPlay connectivity, and the '
                'Advance Pack 1. This pack enhances your driving experience '
                'with automatic headlights, front and rear parking sensors, '
                'and a rear parking camera, complemented by front parking '
                'aid.\n'
                '\n'
                'The Ford Transit 460 Limited stands out with its impressive '
                'specification, indicating a superior offering compared to '
                'other vehicles in its class. The inclusion of both semi '
                'automatic air conditioning with climate control and separate '
                'rear air conditioning provides exceptional comfort for all '
                'passengers. Furthermore, its low insurance group rating makes '
                'it an economical choice for many businesses and individuals. '
                'This Transit is designed for practicality and comfort, making '
                'it an excellent option for those seeking a well equipped and '
                'efficient vehicle.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 163,
 'fuel_type': 'Diesel',
 'id': 'b2ccf860-0b7d-5e5c-9883-7af0e659cf30',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509086139119',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 41,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2ccf860-0b7d-5e5c-9883-7af0e659cf30/b2ccf860-0b7d-5e5c-9883-7af0e659cf30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 402234,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/29acdd08ab604e26b978c78fd4b52bc0.jpg',
             'Width': 2048}],
 'price': 43199,
 'price_includes_vat': True,
 'registration_date': '2024-09-30',
 'seats_number': 17,
 'seller_name': None,
 'title': 'Ford Transit 2.0 460 EcoBlue Limited Auto RWD L4 H3 Euro 6 (s/s) '
          '5dr (17 Seat, DRW)',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2024}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509086139119%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509086139119: {'created_time': 1774523474.058688, 'last_price_update_time': 1774523474.058697}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509086139119') HTTP/1.1" 204 0
2026-03-26 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/975df304c61f49ea9a787b91fa4f5da5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f4f46ece891f4476b99acfb5ea38b8e6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51300b10>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5bb024f-6c75-5925-9851-9b5943fc5144/d5bb024f-6c75-5925-9851-9b5943fc5144_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb7492a5f79de417388000ce409cb12df.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b7492a5f79de417388000ce409cb12df.jpg saved to cache
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5bb024f-6c75-5925-9851-9b5943fc5144
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5bb024f-6c75-5925-9851-9b5943fc5144 sending to next pipeline
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51302710>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb87b6ee-25d8-5c89-9a77-7823f24a1822/fb87b6ee-25d8-5c89-9a77-7823f24a1822_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9f4cf4f6a0c45619836fcb33f3f9f75.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9f4cf4f6a0c45619836fcb33f3f9f75.jpg saved to cache
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb87b6ee-25d8-5c89-9a77-7823f24a1822
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb87b6ee-25d8-5c89-9a77-7823f24a1822 sending to next pipeline
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51481ed0>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_139aa15e-c669-5c0a-9e9e-9abc535420c3/139aa15e-c669-5c0a-9e9e-9abc535420c3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73dff440c8e04ac6bce0aef576df44c2.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73dff440c8e04ac6bce0aef576df44c2.jpg saved to cache
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 139aa15e-c669-5c0a-9e9e-9abc535420c3
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 139aa15e-c669-5c0a-9e9e-9abc535420c3 sending to next pipeline
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a7501286-2ca2-57b1-864a-63529a17b0c1 with identifier: 202505212638945
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a7501286-2ca2-57b1-864a-63529a17b0c1
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F204ebb436cb04d5190563ecef279a0d6.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/204ebb436cb04d5190563ecef279a0d6.jpg not downloaded yet
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514c9e90>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f4ab681-e075-5fc5-bd2a-7309bd5b8e97/6f4ab681-e075-5fc5-bd2a-7309bd5b8e97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27e6b47c5cac4865bad45814032b8356.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27e6b47c5cac4865bad45814032b8356.jpg saved to cache
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f4ab681-e075-5fc5-bd2a-7309bd5b8e97
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f4ab681-e075-5fc5-bd2a-7309bd5b8e97 sending to next pipeline
2026-03-26 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3ccc43c350ec48e2b692a1fac37e2958.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/802c7c3e33ff4877931eaf6c1a2e356d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/6af1bbac3fcb4f1881bd9453b35f523f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d5bb024f-6c75-5925-9851-9b5943fc5144 with identifier 202507024081007
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d5bb024f-6c75-5925-9851-9b5943fc5144
2026-03-26 11:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b7492a5f79de417388000ce409cb12df.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Experience the thrill of the 2022 BMW 1 Series M135i, a '
                'performance hatchback that blends everyday practicality with '
                'exhilarating driving dynamics. Equipped with a potent 2.0L '
                'petrol engine and a sophisticated four-wheel-drive system, '
                'this Euro 6 compliant vehicle delivers responsive power and '
                'confident handling in all conditions. The M135i Pro Pack '
                'enhances the driving experience, incorporating a premium '
                'branded sound system for audiophile-quality entertainment on '
                'the move.\n'
                '\n'
                'Inside, enjoy the luxury of a heated steering wheel, perfect '
                'for those chilly mornings, and immerse yourself in the Harman '
                'Kardon surround audio sound system. The stylish 19in alloy '
                'wheels, in M Double-Spoke Style 552, add a touch of sporty '
                'elegance to the exterior. Cruise control with brake function '
                'and speed limiter provides added convenience and safety on '
                'longer journeys. The large boot offers ample space for '
                'luggage, shopping, or sports equipment, making it more '
                'practical than other similar vehicles. Furthermore, the '
                'impressive acceleration, reaching 0-62mph in just 4.8 '
                'seconds, demonstrates its superior performance capabilities '
                'when compared to its rivals.\n'
                '\n'
                'SERVICE HISTORY: one service recorded at 14,000 miles. \n'
                '\n'
                'Come and take a look now or call us for more information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 302,
 'fuel_type': 'Petrol',
 'id': 'd5bb024f-6c75-5925-9851-9b5943fc5144',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202507024081007',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 23800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5bb024f-6c75-5925-9851-9b5943fc5144/d5bb024f-6c75-5925-9851-9b5943fc5144_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288524,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b7492a5f79de417388000ce409cb12df.jpg',
             'Width': 2048}],
 'price': 25799,
 'price_includes_vat': True,
 'registration_date': '2022-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 Series 2.0 M135i Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'year': 2022}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507024081007%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202507024081007: {'created_time': 1774523474.375175, 'last_price_update_time': 1774523474.375183}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202507024081007') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fb87b6ee-25d8-5c89-9a77-7823f24a1822 with identifier 202509036011291
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fb87b6ee-25d8-5c89-9a77-7823f24a1822
2026-03-26 11:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b9f4cf4f6a0c45619836fcb33f3f9f75.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2023 Ford Puma ST offers an exhilarating driving '
                'experience with its impressive 1.5L EcoBoost petrol engine, '
                'capable of accelerating from 0 to 62mph in a mere 6.7 '
                'seconds. As a Euro 6 compliant vehicle, it meets stringent '
                'emission standards. This particular model boasts a range of '
                'desirable features designed to enhance comfort and '
                'connectivity, including a heated steering wheel, a premium '
                'B&O sound system integrated with Ford SYNC 3 navigation, and '
                'the convenience of Android Auto and Apple CarPlay.\n'
                '\n'
                'Further enhancing your journey, this Puma ST comes equipped '
                'with a wireless charging pad and electronic air temperature '
                'control for effortless climate management. For added peace of '
                'mind, rear parking sensors are included to assist with '
                'manoeuvring. These features, combined with the sporty ST trim '
                'and the powerful 1.5L engine, position this Ford Puma as a '
                'compelling choice for those seeking performance and advanced '
                'technology in a stylish package.\n'
                '\n'
                'SERVICE HISTORY: two services, last at 15,000 miles.\n'
                '\n'
                'Available now for viewing! Call our sales team with any '
                'questions!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': 'fb87b6ee-25d8-5c89-9a77-7823f24a1822',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509036011291',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 17500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb87b6ee-25d8-5c89-9a77-7823f24a1822/fb87b6ee-25d8-5c89-9a77-7823f24a1822_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261351,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9f4cf4f6a0c45619836fcb33f3f9f75.jpg',
             'Width': 2048}],
 'price': 19299,
 'price_includes_vat': True,
 'registration_date': '2023-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.5T EcoBoost ST Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2023}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509036011291%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509036011291: {'created_time': 1774523474.41927, 'last_price_update_time': 1774523474.419277}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509036011291') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 139aa15e-c669-5c0a-9e9e-9abc535420c3 with identifier 202509036010711
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 139aa15e-c669-5c0a-9e9e-9abc535420c3
2026-03-26 11:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/73dff440c8e04ac6bce0aef576df44c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2018 Land Rover Range Rover TD V6 Autobiography presents '
                'an exceptional ownership proposition with its remarkably low '
                'mileage of just 51,700 miles.  Powered by a robust 3.0L '
                'Diesel engine and featuring a capable Four Wheel Drive '
                'system, this Euro 6 compliant vehicle is designed for both '
                'performance and practicality.  The Autobiography trim level '
                'ensures a luxurious experience, enhanced by features such as '
                'front and rear parking aids with parking assistance sensors, '
                'auto dimming exterior mirrors, and remote park heat with '
                'timed climate control.  For added convenience, it boasts an '
                'electrically deployable towbar, ready for towing up to 3500 '
                'kg, and the generous boot space offers ample room for all '
                'your needs.\n'
                '\n'
                'Experience unparalleled comfort with the 22 way heated and '
                'cooled massage front seats, complete with power recline, and '
                'enjoy the heated and cooled rear seats, which also include '
                'memory function. These sophisticated features, combined with '
                'an impressive 0-60mph acceleration time of 7.5 seconds, '
                'demonstrate how this Range Rover surpasses expectations for '
                'vehicles in its class. Its combination of advanced '
                'technology, refined comfort, and strong performance makes it '
                'a truly distinguished choice.\n'
                '\n'
                'SERVICE HISTORY: 6 services, last at 50,000 miles.\n'
                '\n'
                'This is a good looking vehicle in great condition and is now '
                'available on site! Call us to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 254,
 'fuel_type': 'Diesel',
 'id': '139aa15e-c669-5c0a-9e9e-9abc535420c3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509036010711',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 51700,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 63,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_139aa15e-c669-5c0a-9e9e-9abc535420c3/139aa15e-c669-5c0a-9e9e-9abc535420c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255390,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/73dff440c8e04ac6bce0aef576df44c2.jpg',
             'Width': 2048}],
 'price': 33499,
 'price_includes_vat': True,
 'registration_date': '2018-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover 3.0 TD V6 Autobiography Auto 4WD Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2018}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509036010711%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509036010711: {'created_time': 1774523474.463053, 'last_price_update_time': 1774523474.463061}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509036010711') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6f4ab681-e075-5fc5-bd2a-7309bd5b8e97 with identifier 202506304004357
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6f4ab681-e075-5fc5-bd2a-7309bd5b8e97
2026-03-26 11:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/27e6b47c5cac4865bad45814032b8356.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Experience the thrill of driving a 2023 BMW 1 Series M135i, a '
                'performance hatchback that blends everyday practicality with '
                'exhilarating performance. Equipped with a potent 2.0L petrol '
                'engine and a sophisticated four-wheel-drive system, this Euro '
                '6 compliant vehicle delivers a dynamic driving experience. '
                'The M135i Pro Pack enhances the sporty feel, while the '
                'Technology Pack adds modern convenience with Bluetooth '
                'connectivity, LED headlights, and wireless phone charging. '
                'Parking is made easy with the Park Assistant and rear camera, '
                'and the heated steering wheel provides extra comfort on '
                'colder days. Enjoy an immersive audio experience with the '
                'Harman Kardon surround sound system.\n'
                '\n'
                'The BMW 1 Series M135i stands out with its impressive '
                'acceleration, reaching 62mph in just 4.8 seconds, '
                'demonstrating its superior performance capabilities compared '
                'to similar vehicles. The spacious boot offers ample room for '
                'luggage, shopping, or sports equipment, making it a practical '
                'choice for daily use. With its combination of performance, '
                'technology, and practicality, this BMW 1 Series M135i offers '
                'a compelling package for discerning drivers.\n'
                '\n'
                'SERVICE HISTORY: 3 services on iDRIVE (2 oil) services, last '
                'at 31,000 miles.\n'
                '\n'
                'Come and take a look now!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 302,
 'fuel_type': 'Petrol',
 'id': '6f4ab681-e075-5fc5-bd2a-7309bd5b8e97',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506304004357',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 34100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f4ab681-e075-5fc5-bd2a-7309bd5b8e97/6f4ab681-e075-5fc5-bd2a-7309bd5b8e97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241225,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/27e6b47c5cac4865bad45814032b8356.jpg',
             'Width': 2048}],
 'price': 26399,
 'price_includes_vat': True,
 'registration_date': '2023-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 Series 2.0 M135i Auto xDrive Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'year': 2023}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506304004357%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506304004357: {'created_time': 1774523474.513308, 'last_price_update_time': 1774523474.513315}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506304004357') HTTP/1.1" 204 0
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 83059232-4610-5d46-b87c-c8c790e9d4b3 with identifier: 202504171439093
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 83059232-4610-5d46-b87c-c8c790e9d4b3
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe743da269df549bdbbe985fb4ecb9456.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e743da269df549bdbbe985fb4ecb9456.jpg not downloaded yet
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51243f50>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e6f4f8c-7310-5777-b7c3-03c3db5e7a53/4e6f4f8c-7310-5777-b7c3-03c3db5e7a53_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F975df304c61f49ea9a787b91fa4f5da5.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/975df304c61f49ea9a787b91fa4f5da5.jpg saved to cache
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e6f4f8c-7310-5777-b7c3-03c3db5e7a53
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e6f4f8c-7310-5777-b7c3-03c3db5e7a53 sending to next pipeline
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51165ad0>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4defca1a-2c31-5786-a2fc-f2c7112317f2/4defca1a-2c31-5786-a2fc-f2c7112317f2_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4f46ece891f4476b99acfb5ea38b8e6.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4f46ece891f4476b99acfb5ea38b8e6.jpg saved to cache
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4defca1a-2c31-5786-a2fc-f2c7112317f2
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4defca1a-2c31-5786-a2fc-f2c7112317f2 sending to next pipeline
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:14 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fa0208ec-4415-5413-862e-7a3ab7e018ce with identifier: 202503270634105
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fa0208ec-4415-5413-862e-7a3ab7e018ce
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F35f7db56097a4d5abceaa9c36f0fa9e3.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/35f7db56097a4d5abceaa9c36f0fa9e3.jpg not downloaded yet
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4e6f4f8c-7310-5777-b7c3-03c3db5e7a53 with identifier 202509036009529
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4e6f4f8c-7310-5777-b7c3-03c3db5e7a53
2026-03-26 11:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/975df304c61f49ea9a787b91fa4f5da5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Boasting exceptionally low mileage for its age, this 2020 '
                'Land Rover Range Rover Sport SD V6 HSE Dynamic presents a '
                'remarkable opportunity. Powered by a robust 3.0L Diesel '
                'engine and featuring a capable Four Wheel Drive drivetrain, '
                'this Euro 6 compliant vehicle is ready for any adventure. The '
                'HSE Dynamic trim level ensures a premium experience, '
                'complemented by notable features such as a 360 Degree '
                'Surround Camera System with parking assistance and an '
                'electrically deployable tow bar, perfect for towing up to '
                '3500 kg. Enjoy enhanced visibility with the Head Up Display '
                'and the confidence of Wade Sensing, all while taking in the '
                'surroundings through the Fixed Panoramic Roof with its '
                'powered blind.\n'
                '\n'
                'This Range Rover Sport offers impressive performance, '
                'accelerating from 0 to 60mph in a swift 6.8 seconds, '
                'demonstrating its dynamic capabilities. The generous boot '
                'space provides ample room for luggage or equipment, making it '
                'a practical choice for families and outdoor enthusiasts '
                'alike. These highlights, combined with its low mileage of '
                'just 22,100 miles, set this vehicle apart from others, '
                'offering a superior combination of luxury, performance, and '
                'utility.\n'
                '\n'
                'SERVICE HISTORY: 4 services, last at 20,000 miles.\n'
                '\n'
                'Come and take a look now!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 302,
 'fuel_type': 'Diesel',
 'id': '4e6f4f8c-7310-5777-b7c3-03c3db5e7a53',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509036009529',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 22100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e6f4f8c-7310-5777-b7c3-03c3db5e7a53/4e6f4f8c-7310-5777-b7c3-03c3db5e7a53_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239317,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/975df304c61f49ea9a787b91fa4f5da5.jpg',
             'Width': 2048}],
 'price': 36699,
 'price_includes_vat': True,
 'registration_date': '2020-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE Dynamic Auto 4WD Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2020}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509036009529%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509036009529: {'created_time': 1774523474.688176, 'last_price_update_time': 1774523474.688184}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509036009529') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4defca1a-2c31-5786-a2fc-f2c7112317f2 with identifier 202506303996691
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4defca1a-2c31-5786-a2fc-f2c7112317f2
2026-03-26 11:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f4f46ece891f4476b99acfb5ea38b8e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'With only 15000 miles on the clock, this 2021 Citroen C5 '
                'Aircross Flair Plus is barely run in. This Euro 6 compliant '
                'vehicle is equipped with a 1.6L Petrol Plug-in Hybrid engine. '
                'The Flair Plus trim comes with a range of features designed '
                'to enhance your driving experience. The Park City Camera '
                'Pack, including front sensors and a rear camera, makes '
                'parking a breeze. Stay safe on the road with the Active Blind '
                'Spot Monitoring System, which includes Blind Spot '
                'Assistance.\n'
                '\n'
                'The vehicle also features Bluetooth connectivity, allowing '
                'for hands-free calls. The Mirror Screen, compatible with '
                'Apple CarPlay and Android Auto, ensures seamless smartphone '
                'integration. Automatic headlight activation via '
                'windscreen-mounted sensors adds to the convenience. These '
                'features show how this particular C5 Aircross is '
                'well-equipped compared to similar vehicles.\n'
                '\n'
                'SERVICE HISTORY: 4 main dealer stamps, last at 14,000 miles.\n'
                '\n'
                'As you can imagine this vehicle is in great condition and is '
                'available now to view, call us for more details!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 222,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '4defca1a-2c31-5786-a2fc-f2c7112317f2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506303996691',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4defca1a-2c31-5786-a2fc-f2c7112317f2/4defca1a-2c31-5786-a2fc-f2c7112317f2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 241925,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4f46ece891f4476b99acfb5ea38b8e6.jpg',
             'Width': 2048}],
 'price': 16299,
 'price_includes_vat': True,
 'registration_date': '2021-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 13.2kWh Flair Plus e-EAT8 Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Flair Plus',
 'year': 2021}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506303996691%27 HTTP/1.1" 200 None
2026-03-26 11:11:14 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506303996691: {'created_time': 1774523474.735652, 'last_price_update_time': 1774523474.735661}
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506303996691') HTTP/1.1" 204 0
2026-03-26 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e49fc3ce2e4d435eb61e6ba978f4c13b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/38bbf2f187494bc09990f489f562f3eb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d191b5f3b767430c892c518b06fc002c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c513030d0>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8edf125-f3d1-5489-b245-0753cdefaa97/a8edf125-f3d1-5489-b245-0753cdefaa97_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ccc43c350ec48e2b692a1fac37e2958.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ccc43c350ec48e2b692a1fac37e2958.jpg saved to cache
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8edf125-f3d1-5489-b245-0753cdefaa97
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8edf125-f3d1-5489-b245-0753cdefaa97 sending to next pipeline
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5129fb10>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd22cbf-c6fb-5c59-9415-95a9d17d0b07/0fd22cbf-c6fb-5c59-9415-95a9d17d0b07_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F802c7c3e33ff4877931eaf6c1a2e356d.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/802c7c3e33ff4877931eaf6c1a2e356d.jpg saved to cache
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fd22cbf-c6fb-5c59-9415-95a9d17d0b07
2026-03-26 11:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fd22cbf-c6fb-5c59-9415-95a9d17d0b07 sending to next pipeline
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5127b850>
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0/c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6af1bbac3fcb4f1881bd9453b35f523f.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6af1bbac3fcb4f1881bd9453b35f523f.jpg saved to cache
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0 sending to next pipeline
2026-03-26 11:11:15 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-26 11:11:15 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 764dccf5-51d6-53f1-9c9d-ba67918159b9 with identifier: 202412167329061
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 764dccf5-51d6-53f1-9c9d-ba67918159b9
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed8f3f1141a14bfd92aa22d894fab11d.jpg%27 HTTP/1.1" 200 None
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed8f3f1141a14bfd92aa22d894fab11d.jpg not downloaded yet
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a8edf125-f3d1-5489-b245-0753cdefaa97 with identifier 202506253847597
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a8edf125-f3d1-5489-b245-0753cdefaa97
2026-03-26 11:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3ccc43c350ec48e2b692a1fac37e2958.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This BMW 5 Series, registered in 2021, is a stylish and '
                'efficient choice for drivers seeking a blend of performance '
                'and practicality. As a 520d M Sport, it boasts a responsive '
                '2.0L Diesel Hybrid engine, adhering to Euro 6 emission '
                'standards. The M Sport trim enhances its sporty appeal, '
                'further enhanced by the M Sport Pro Package and eye-catching '
                '20in Alloy Wheels in M Light Y-Spoke Style 846 Bicolour Jet '
                'Black, complete with mixed tyres and run-flat technology. '
                'Navigating tight spots is made easy with the Parking '
                'Assistant, which includes front and rear sensors, plus a rear '
                'camera.\n'
                '\n'
                'Inside, the BMW Live Cockpit Professional, featuring '
                'Bluetooth connectivity, keeps you connected and entertained '
                'on the move. The rain sensor with automatic headlight '
                'activation ensures optimal visibility in all weather '
                'conditions. The large boot offers a significant amount of '
                'space, making this vehicle ideal for families, long journeys, '
                'or anyone who needs to transport bulky items regularly. This '
                'combination of features and design makes this BMW 5 Series a '
                'compelling option in its class.\n'
                '\n'
                'SERVICE HISTORY: 3 services on iDRIVE, last at 52,000 miles.\n'
                '\n'
                'What a beauty, plenty of luxury and in fantastic condition! '
                'Come and take a look now or call us for more information!',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel Hybrid',
 'id': 'a8edf125-f3d1-5489-b245-0753cdefaa97',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506253847597',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'BMW',
 'model': '5 Series',
 'odometer': 58400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8edf125-f3d1-5489-b245-0753cdefaa97/a8edf125-f3d1-5489-b245-0753cdefaa97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246682,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ccc43c350ec48e2b692a1fac37e2958.jpg',
             'Width': 2048}],
 'price': 22499,
 'price_includes_vat': True,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5 Series 2.0 520d MHT M Sport Steptronic Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506253847597%27 HTTP/1.1" 200 None
2026-03-26 11:11:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506253847597: {'created_time': 1774523475.624432, 'last_price_update_time': 1774523475.624442}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506253847597') HTTP/1.1" 204 0
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0fd22cbf-c6fb-5c59-9415-95a9d17d0b07 with identifier 202509015942475
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0fd22cbf-c6fb-5c59-9415-95a9d17d0b07
2026-03-26 11:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/802c7c3e33ff4877931eaf6c1a2e356d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2020 Hyundai i30 T-GDi N Performance is a rare find with '
                'exceptionally low mileage for its year, having covered just '
                '34,000 miles. Powered by a potent 2.0 litre petrol engine and '
                'meeting Euro 6 emissions standards, this N Performance trim '
                'model offers an exhilarating driving experience. It boasts a '
                'generous boot space, perfect for everyday practicality. Key '
                'features include a Winter Pack with heated seats and a heated '
                'steering wheel for comfort in colder months, advanced LED '
                "headlights for improved visibility, and a driver's seat with "
                'memory function for personalised comfort. Convenience is '
                'further enhanced by a wireless phone charging pad and front '
                'and rear parking sensors, making manoeuvring effortless.\n'
                '\n'
                'The performance of this Hyundai i30 is truly impressive, with '
                'a rapid 0-62mph acceleration time of just 6.1 seconds, '
                'demonstrating its dynamic capabilities. This acceleration '
                'figure indicates how this particular model outperforms many '
                'other vehicles in its class. Combined with its comprehensive '
                'specification and low mileage, this i30 T-GDi N Performance '
                'represents a compelling package for those seeking both '
                'performance and everyday usability.\n'
                '\n'
                'SERVICE HISTORY: 4 stamps, last at 32,000 miles.\n'
                '\n'
                'Come and take a look now or call or if you have any '
                'questions, please don’t hesitate to contact us!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 271,
 'fuel_type': 'Petrol',
 'id': '0fd22cbf-c6fb-5c59-9415-95a9d17d0b07',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509015942475',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 34000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd22cbf-c6fb-5c59-9415-95a9d17d0b07/0fd22cbf-c6fb-5c59-9415-95a9d17d0b07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250868,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/802c7c3e33ff4877931eaf6c1a2e356d.jpg',
             'Width': 2048}],
 'price': 23499,
 'price_includes_vat': True,
 'registration_date': '2020-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 2.0 T-GDi N Performance Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509015942475%27 HTTP/1.1" 200 None
2026-03-26 11:11:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509015942475: {'created_time': 1774523475.664178, 'last_price_update_time': 1774523475.664186}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509015942475') HTTP/1.1" 204 0
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0 with identifier 202508275782157
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0
2026-03-26 11:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/6af1bbac3fcb4f1881bd9453b35f523f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'SERVICE HISTORY: 5 main dealer services,  last at 41,000 '
                'miles.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 168,
 'fuel_type': 'Diesel',
 'id': 'c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508275782157',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'GLC',
 'odometer': 44300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0/c5fe2605-8dcc-5c44-bb01-2fd0076ebfa0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258147,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/6af1bbac3fcb4f1881bd9453b35f523f.jpg',
             'Width': 2048}],
 'price': 22399,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC 2.1 GLC220d AMG Night Edition G-Tronic+ 4MATIC '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Night Edition',
 'year': 2019}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508275782157%27 HTTP/1.1" 200 None
2026-03-26 11:11:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508275782157: {'created_time': 1774523475.710138, 'last_price_update_time': 1774523475.710146}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508275782157') HTTP/1.1" 204 0
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c514d3c50>
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a9b9f08-4ac7-5a41-8d72-66d796c19808/0a9b9f08-4ac7-5a41-8d72-66d796c19808_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe49fc3ce2e4d435eb61e6ba978f4c13b.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e49fc3ce2e4d435eb61e6ba978f4c13b.jpg saved to cache
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a9b9f08-4ac7-5a41-8d72-66d796c19808
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a9b9f08-4ac7-5a41-8d72-66d796c19808 sending to next pipeline
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5a13aed0>
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a80a53dc-b6e5-5a9a-b301-20f73f7d1157/a80a53dc-b6e5-5a9a-b301-20f73f7d1157_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38bbf2f187494bc09990f489f562f3eb.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38bbf2f187494bc09990f489f562f3eb.jpg saved to cache
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a80a53dc-b6e5-5a9a-b301-20f73f7d1157
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a80a53dc-b6e5-5a9a-b301-20f73f7d1157 sending to next pipeline
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52f42110>
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da61703a-ad49-5e2e-8a1c-7bb0ffc1d285/da61703a-ad49-5e2e-8a1c-7bb0ffc1d285_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd191b5f3b767430c892c518b06fc002c.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d191b5f3b767430c892c518b06fc002c.jpg saved to cache
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da61703a-ad49-5e2e-8a1c-7bb0ffc1d285
2026-03-26 11:11:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da61703a-ad49-5e2e-8a1c-7bb0ffc1d285 sending to next pipeline
2026-03-26 11:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/204ebb436cb04d5190563ecef279a0d6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0a9b9f08-4ac7-5a41-8d72-66d796c19808 with identifier 202506233778379
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0a9b9f08-4ac7-5a41-8d72-66d796c19808
2026-03-26 11:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e49fc3ce2e4d435eb61e6ba978f4c13b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This Mazda MX-30 First Edition, registered in 2021, offers a '
                'modern driving experience. As an all-electric vehicle, it '
                'represents a step towards sustainable motoring. The First '
                'Edition trim adds a touch of exclusivity to this model.\n'
                '\n'
                'With a 36 kWh battery, the MX-30 offers a maximum range of '
                '124 miles when new. Recharging is convenient, taking '
                'approximately 5 hours using a 7kW home charger. For quicker '
                'top-ups, public charging can take the battery from empty to '
                "80% in just 48 minutes. The inclusion of driver's seat "
                'electric 8-way power adjustment with memory, heated front '
                'seats, climate control, Mazda Radar Cruise Control with '
                'Intelligent Speed Assist, and Emergency Lane Keeping with '
                'Blind Spot Assist, are all welcome additions. These features '
                'enhance comfort, convenience, and safety, making it a '
                'well-rounded choice in its class.\n'
                '\n'
                'SERVICE HISTORY: one main dealer service at 12,000 miles.\n'
                '\n'
                'Call us now to arrange your viewing!',
 'doors_number': 5,
 'engine_horse_power': 143,
 'fuel_type': 'Electric',
 'id': '0a9b9f08-4ac7-5a41-8d72-66d796c19808',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506233778379',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mazda',
 'model': 'MX-30',
 'odometer': 26900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a9b9f08-4ac7-5a41-8d72-66d796c19808/0a9b9f08-4ac7-5a41-8d72-66d796c19808_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 227421,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e49fc3ce2e4d435eb61e6ba978f4c13b.jpg',
             'Width': 2048}],
 'price': 9699,
 'price_includes_vat': True,
 'registration_date': '2021-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda MX-30 35.5kWh First Edition Auto 5dr',
 'transmission': 'automatic',
 'trim': 'First Edition',
 'year': 2021}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506233778379%27 HTTP/1.1" 200 None
2026-03-26 11:11:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506233778379: {'created_time': 1774523475.885188, 'last_price_update_time': 1774523475.885196}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506233778379') HTTP/1.1" 204 0
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a80a53dc-b6e5-5a9a-b301-20f73f7d1157 with identifier 202508265760554
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a80a53dc-b6e5-5a9a-b301-20f73f7d1157
2026-03-26 11:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/38bbf2f187494bc09990f489f562f3eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2021 Mercedes-Benz A Class A35 AMG Edition is a superb '
                'example of performance and luxury.  Powered by a potent 2.0L '
                'petrol engine and featuring a four wheel drive drivetrain, '
                'this Euro 6 compliant model offers an exhilarating driving '
                "experience.  Inside, you'll find the comfort of Air "
                'Conditioning with THERMOTRONIC Luxury Automatic Climate '
                'Control, ensuring a pleasant cabin temperature for all '
                'occupants.  The heated front seats provide extra warmth on '
                'colder days, while the Smartphone Integration, including '
                'Android Auto and Apple CarPlay, keeps you connected on the '
                'go.  Manoeuvring is made easier with the Parking Package, '
                'which includes front and rear parking sensors and a rear '
                'camera, complemented by a spacious boot perfect for all your '
                'luggage needs.\n'
                '\n'
                'The AMG Edition trim level signifies a step up in sporty '
                'design and dynamic capability, and this A Class truly excels. '
                'Its impressive acceleration, reaching 0-62mph in just 4.7 '
                'seconds, demonstrates its performance credentials, setting it '
                'apart from many other vehicles in its class. Furthermore, the '
                'panoramic glass sunroof adds an open and airy feel to the '
                'interior, enhancing the overall driving enjoyment. This '
                'Mercedes-Benz A Class A35 AMG Edition combines sophisticated '
                'technology with thrilling performance, making it a compelling '
                'choice for any discerning driver.\n'
                '\n'
                'SERVICE HISTORY: 3 main dealer services. This vehicle will be '
                'serviced prior to sale.\n'
                '\n'
                'Available now to view, give us a call to learn more!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 302,
 'fuel_type': 'Petrol',
 'id': 'a80a53dc-b6e5-5a9a-b301-20f73f7d1157',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508265760554',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Mercedes-Benz',
 'model': 'A Class',
 'odometer': 35000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a80a53dc-b6e5-5a9a-b301-20f73f7d1157/a80a53dc-b6e5-5a9a-b301-20f73f7d1157_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245285,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/38bbf2f187494bc09990f489f562f3eb.jpg',
             'Width': 2048}],
 'price': 27499,
 'price_includes_vat': True,
 'registration_date': '2021-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A Class 2.0 A35 AMG Edition (Premium Plus) 7G-DCT '
          '4MATIC Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Edition',
 'year': 2021}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508265760554%27 HTTP/1.1" 200 None
2026-03-26 11:11:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508265760554: {'created_time': 1774523475.931967, 'last_price_update_time': 1774523475.931977}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508265760554') HTTP/1.1" 204 0
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: da61703a-ad49-5e2e-8a1c-7bb0ffc1d285 with identifier 202506173586080
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item da61703a-ad49-5e2e-8a1c-7bb0ffc1d285
2026-03-26 11:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d191b5f3b767430c892c518b06fc002c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Experience the Kia Sportage, a 2022 model that combines '
                "efficiency with modern technology. This Sportage, in its '4' "
                'trim and h T-GDi 4 variant, is equipped with a 1.6L Petrol '
                'Hybrid engine and adheres to Euro 6 emission standards. '
                'Convenience is at your fingertips with the Engine Start-Stop '
                'Button featuring a Smart Entry System, complete with Keyless '
                'Entry. Manoeuvring is made easier with Front Parking Sensors, '
                'including Parking Assistance with a front sensor. Stay '
                'connected on the move with Bluetooth for music streaming and '
                'seamless smartphone integration through Android Auto and '
                'Apple CarPlay, all controllable with voice commands. Safety '
                'is enhanced with Blind-spot Collision-Avoidance Assist, '
                'incorporating Blind Spot Assistance.\n'
                '\n'
                'The Kia Sportage stands out with its rapid acceleration, '
                'reaching 0-60mph in just 7.7 seconds, demonstrating its '
                'impressive performance compared to similar vehicles. The '
                'spacious boot offers ample room for luggage, shopping, or '
                'equipment, making it more practical than other cars in its '
                'class.\n'
                '\n'
                'SERVICE HISTORY: two main dealer stamps. This vehicle will be '
                'serviced prior to sale.\n'
                '\n'
                'Call us now to arrange your viewing!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 226,
 'fuel_type': 'Petrol Hybrid',
 'id': 'da61703a-ad49-5e2e-8a1c-7bb0ffc1d285',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506173586080',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 36600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da61703a-ad49-5e2e-8a1c-7bb0ffc1d285/da61703a-ad49-5e2e-8a1c-7bb0ffc1d285_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 237838,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d191b5f3b767430c892c518b06fc002c.jpg',
             'Width': 2048}],
 'price': 22499,
 'price_includes_vat': True,
 'registration_date': '2022-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Sportage 1.6 h T-GDi 4 Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': '4',
 'year': 2022}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506173586080%27 HTTP/1.1" 200 None
2026-03-26 11:11:15 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506173586080: {'created_time': 1774523475.980662, 'last_price_update_time': 1774523475.980672}
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506173586080') HTTP/1.1" 204 0
2026-03-26 11:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e743da269df549bdbbe985fb4ecb9456.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c51d909d0>
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7501286-2ca2-57b1-864a-63529a17b0c1/a7501286-2ca2-57b1-864a-63529a17b0c1_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F204ebb436cb04d5190563ecef279a0d6.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/204ebb436cb04d5190563ecef279a0d6.jpg saved to cache
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7501286-2ca2-57b1-864a-63529a17b0c1
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7501286-2ca2-57b1-864a-63529a17b0c1 sending to next pipeline
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a7501286-2ca2-57b1-864a-63529a17b0c1 with identifier 202505212638945
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a7501286-2ca2-57b1-864a-63529a17b0c1
2026-03-26 11:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/204ebb436cb04d5190563ecef279a0d6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Experience refined performance with this 2021 Land Rover '
                'Range Rover Sport P400e Autobiography Dynamic. This '
                'four-wheel drive plug-in hybrid combines a 2.0L petrol engine '
                'with electric power, all while meeting Euro 6 emission '
                'standards. The Autobiography Dynamic trim elevates the '
                'driving experience with features such as 22-way massage '
                'memory front seats with winged headrests, ensuring optimal '
                'comfort. Passengers will enjoy heated and cooled front and '
                'rear seats, and the heated steering wheel adds a touch of '
                'luxury on colder days. Adaptive cruise control with stop and '
                'go enhances convenience on long journeys, and the digital TV '
                'keeps everyone entertained.\n'
                '\n'
                'The Range Rover Sport accelerates from 0-60mph in just 5.9 '
                'seconds, demonstrating its impressive capabilities. The large '
                'boot space makes it more practical than similar vehicles, '
                'easily accommodating luggage and gear. With a towing weight '
                'of 2500 kg, this vehicle offers enhanced versatility for '
                'those needing to tow trailers or caravans.\n'
                '\n'
                'SERVICE HISTORY: one main dealer service recorded. This '
                'vehicle will be serviced prior to sale.\n'
                '\n'
                'This really is a lovely car, great condition, comfortable and '
                'has massaging front seats! Come and take a look now or call '
                'us for further information!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 398,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': 'a7501286-2ca2-57b1-864a-63529a17b0c1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202505212638945',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 47000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7501286-2ca2-57b1-864a-63529a17b0c1/a7501286-2ca2-57b1-864a-63529a17b0c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243536,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/204ebb436cb04d5190563ecef279a0d6.jpg',
             'Width': 2048}],
 'price': 35499,
 'price_includes_vat': True,
 'registration_date': '2021-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 2.0 P400e 13.1kWh Autobiography '
          'Dynamic Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Autobiography Dynamic',
 'year': 2021}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505212638945%27 HTTP/1.1" 200 None
2026-03-26 11:11:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202505212638945: {'created_time': 1774523476.069693, 'last_price_update_time': 1774523476.069703}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202505212638945') HTTP/1.1" 204 0
2026-03-26 11:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/35f7db56097a4d5abceaa9c36f0fa9e3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ed8f3f1141a14bfd92aa22d894fab11d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5125ffd0>
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83059232-4610-5d46-b87c-c8c790e9d4b3/83059232-4610-5d46-b87c-c8c790e9d4b3_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe743da269df549bdbbe985fb4ecb9456.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e743da269df549bdbbe985fb4ecb9456.jpg saved to cache
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83059232-4610-5d46-b87c-c8c790e9d4b3
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83059232-4610-5d46-b87c-c8c790e9d4b3 sending to next pipeline
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 83059232-4610-5d46-b87c-c8c790e9d4b3 with identifier 202504171439093
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 83059232-4610-5d46-b87c-c8c790e9d4b3
2026-03-26 11:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e743da269df549bdbbe985fb4ecb9456.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This Porsche 911, registered in 2022, is a stylish car that '
                'combines performance with iconic design. As a 992 Carrera T '
                'variant with the same trim, it features a potent 3.0L petrol '
                'engine and complies with Euro 6 emission standards. The '
                'interior boasts a heated multifunction GT sports steering '
                'wheel, crafted from leather with a matt carbon panel, '
                'ensuring comfort and style. Equipped with LED main '
                'headlights, including the Porsche Dynamic Light System, it '
                'provides exceptional visibility. The inclusion of HomeLink '
                'adds convenience, while the 20in front and 21in rear alloy '
                'wheels in RS Spyder Design enhance its sporty stance. An '
                'electric glass slide and tilt sunroof brings an open-air feel '
                'to the driving experience.\n'
                '\n'
                'The acceleration of 0-62mph in just 4.0 seconds demonstrates '
                'its superior performance capabilities compared to similar '
                'vehicles. This Porsche 911 delivers an exhilarating driving '
                'experience, blending cutting-edge technology with classic '
                'Porsche styling.\n'
                '\n'
                'SERVICE HISTORY: one main dealer stamp at 10,205 miles. \n'
                '\n'
                'This 911 has a nice Pearlescent paint finish and is available '
                'now to view, or call us for more information!',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 380,
 'fuel_type': 'Petrol',
 'id': '83059232-4610-5d46-b87c-c8c790e9d4b3',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202504171439093',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Porsche',
 'model': '911',
 'odometer': 12500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83059232-4610-5d46-b87c-c8c790e9d4b3/83059232-4610-5d46-b87c-c8c790e9d4b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 251896,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e743da269df549bdbbe985fb4ecb9456.jpg',
             'Width': 2048}],
 'price': 83999,
 'price_includes_vat': True,
 'registration_date': '2022-09-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Porsche 911 3.0T 992 Carrera PDK Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': '992 Carrera',
 'year': 2022}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202504171439093%27 HTTP/1.1" 200 None
2026-03-26 11:11:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202504171439093: {'created_time': 1774523476.229098, 'last_price_update_time': 1774523476.229106}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202504171439093') HTTP/1.1" 204 0
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c52fda650>
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa0208ec-4415-5413-862e-7a3ab7e018ce/fa0208ec-4415-5413-862e-7a3ab7e018ce_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F35f7db56097a4d5abceaa9c36f0fa9e3.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/35f7db56097a4d5abceaa9c36f0fa9e3.jpg saved to cache
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa0208ec-4415-5413-862e-7a3ab7e018ce
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa0208ec-4415-5413-862e-7a3ab7e018ce sending to next pipeline
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4c5a5b7510>
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-26 11:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_764dccf5-51d6-53f1-9c9d-ba67918159b9/764dccf5-51d6-53f1-9c9d-ba67918159b9_image_0.jpg HTTP/1.1" 201 0
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed8f3f1141a14bfd92aa22d894fab11d.jpg') HTTP/1.1" 204 0
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed8f3f1141a14bfd92aa22d894fab11d.jpg saved to cache
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 764dccf5-51d6-53f1-9c9d-ba67918159b9
2026-03-26 11:11:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 764dccf5-51d6-53f1-9c9d-ba67918159b9 sending to next pipeline
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fa0208ec-4415-5413-862e-7a3ab7e018ce with identifier 202503270634105
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fa0208ec-4415-5413-862e-7a3ab7e018ce
2026-03-26 11:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/35f7db56097a4d5abceaa9c36f0fa9e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This is a 2022 Hyundai i20 1.0L Petrol Hybrid, presented in '
                'the sporty N Line trim. As a Euro 6 emissions class car, this '
                'T-GDi N Line variant offers a blend of performance and '
                'efficiency. It comes equipped with several features designed '
                'to enhance comfort and convenience, including climate control '
                'with an automatic de-fog system for the front windscreen, '
                'ensuring clear visibility in all weather conditions. '
                'Automatic headlights with a dusk sensor provide added safety, '
                'while Apple CarPlay offers seamless smartphone integration. '
                'The smart key with keyless entry and engine start-stop button '
                'adds a touch of modern convenience, and the rear-view parking '
                'camera makes parking a breeze.\n'
                '\n'
                'With only 12,600 miles on the clock, this i20 has seen very '
                'little use. The large boot space is a real plus, making it '
                'more practical than other similar vehicles in its class. This '
                'makes it an excellent choice for those who need a bit of '
                'extra room for shopping, luggage, or other cargo.\n'
                '\n'
                'SERVICE HISTORY: two main dealer services, last at 11,000 '
                'miles.\n'
                '\n'
                'Come and view it now before it goes! Call us for more '
                'details!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 118,
 'fuel_type': 'Petrol Hybrid',
 'id': 'fa0208ec-4415-5413-862e-7a3ab7e018ce',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202503270634105',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 12600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa0208ec-4415-5413-862e-7a3ab7e018ce/fa0208ec-4415-5413-862e-7a3ab7e018ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 275521,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/35f7db56097a4d5abceaa9c36f0fa9e3.jpg',
             'Width': 2048}],
 'price': 14299,
 'price_includes_vat': True,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.0 T-GDi MHEV N Line Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'N Line',
 'year': 2022}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202503270634105%27 HTTP/1.1" 200 None
2026-03-26 11:11:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202503270634105: {'created_time': 1774523476.416657, 'last_price_update_time': 1774523476.416669}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202503270634105') HTTP/1.1" 204 0
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 764dccf5-51d6-53f1-9c9d-ba67918159b9 with identifier 202412167329061
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 764dccf5-51d6-53f1-9c9d-ba67918159b9
2026-03-26 11:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ed8f3f1141a14bfd92aa22d894fab11d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'color': 'White',
 'currency': 'GBP',
 'description': 'GREAT CONDITION KIA NIRO WITH REAR PARKING CAMERA, SMARTPHONE '
                'PROJECTION, CLIMATE CONTROL AND CRUISE CONTROL! THIS VEHICLE '
                'IS SMOOTH TO DRIVE AND HAS A COMFORTABLE INTERIOR! SERVICE '
                'HISTORY: 2 services. CALL NOW FOR MORE DETAILS!',
 'doors_number': 5,
 'engine_horse_power': 134,
 'fuel_type': 'Electric',
 'id': '764dccf5-51d6-53f1-9c9d-ba67918159b9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202412167329061',
 'listing': 'directbuy',
 'location': 'Kings Lynn, Norfolk',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 15000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_764dccf5-51d6-53f1-9c9d-ba67918159b9/764dccf5-51d6-53f1-9c9d-ba67918159b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243585,
             'Height': 1365,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed8f3f1141a14bfd92aa22d894fab11d.jpg',
             'Width': 2048}],
 'price': 12199,
 'price_includes_vat': True,
 'registration_date': '2021-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'KIA Niro 39kWh 2 Auto 5dr',
 'transmission': 'automatic',
 'trim': '2',
 'year': 2021}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202412167329061%27 HTTP/1.1" 200 None
2026-03-26 11:11:16 [auto_selling_autotrader.co.uk] INFO: Saving data for 202412167329061: {'created_time': 1774523476.459528, 'last_price_update_time': 1774523476.459537}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202412167329061') HTTP/1.1" 204 0
2026-03-26 11:11:16 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-26 11:11:16 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-26 11:11:16 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 51994e1a290411f18f76c264925fbcfa
2026-03-26 11:11:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-26 11:11:16 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-26 11:11:16 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:11:16 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-26 11:11:16 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-26 11:11:16 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-26 11:11:16 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 4, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-26 11:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-26 11:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773227476 HTTP/1.1" 200 None
2026-03-26 11:11:17 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (304 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/51994e1a290411f18f76c264925fbcfa.jl
2026-03-26 11:11:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 2426058,
 'downloader/request_count': 311,
 'downloader/request_method_count/GET': 264,
 'downloader/request_method_count/POST': 47,
 'downloader/response_bytes': 78937232,
 'downloader/response_count': 311,
 'downloader/response_status_count/200': 311,
 'elapsed_time_seconds': 77.078947,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 26, 11, 11, 17, 38354, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 304,
 'log_count/DEBUG': 5107,
 'log_count/INFO': 4116,
 'memusage/max': 191479808,
 'memusage/startup': 147169280,
 'photo_download_count': 264,
 'request_depth_max': 17,
 'response_received_count': 47,
 'scheduler/dequeued': 311,
 'scheduler/dequeued/memory': 311,
 'scheduler/enqueued': 311,
 'scheduler/enqueued/memory': 311,
 'scrape_type/new': 304,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 47,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.598804132121199,
 'scrapy-zyte-api/mean_response_seconds': 2.7674426061220148,
 'scrapy-zyte-api/processed': 47,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 47,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 46,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 47,
 'scrapy-zyte-api/request_args/httpRequestBody': 47,
 'scrapy-zyte-api/request_args/httpRequestMethod': 47,
 'scrapy-zyte-api/request_args/httpResponseBody': 47,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 47,
 'scrapy-zyte-api/request_args/url': 47,
 'scrapy-zyte-api/status_codes/200': 47,
 'scrapy-zyte-api/success': 47,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 26, 11, 9, 59, 959407, tzinfo=datetime.timezone.utc)}
2026-03-26 11:11:17 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-26 11:11:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f4c5a587350>
2026-03-26 11:11:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f4c5a587bd0>
PROJECT (sourcing_v2), SPIDER (auto_selling_autotrader.co.uk)

Stats

Source

PROJECT (sourcing_v2), SPIDER (auto_selling_autotrader.co.uk)
