2026-03-25 16:13:29 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 16:13:29 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 16:13:29 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-25 16:13:29 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-25 16:13:29 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-25 16:13:29 [auto_selling_autotrader.co.uk] INFO: _job: 8d990332286511f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-25 16:13:29 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 16:13:29 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 16:13:29 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 16:13:29 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 16:13:29 [scrapy.extensions.telnet] INFO: Telnet Password: 60e428ce694dd0c6
2026-03-25 16:13:29 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-25 16:13:29 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/8d990332286511f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-25 16:13:29 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 16:13:29 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 16:13:29 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 16:13:29 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-25 16:13:29 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 16:13:29 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-25 16:13:29 [scrapy.core.engine] INFO: Spider opened
2026-03-25 16:13:29 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-25 16:13:29 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-25 16:13:29 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-25 16:13:29 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 16:13:29 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-25 16:13:29 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-25 16:13:29 [scrapy-playwright] INFO: Starting download handler
2026-03-25 16:13:29 [scrapy-playwright] INFO: Starting download handler
2026-03-25 16:13:34 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10035609 and multipost_profile_id: e218f502-6f9a-4fe2-99ae-b05a8528e346 and job_id: 8d990332286511f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/essex/ongar/john-hammick-ltd-10035609
2026-03-25 16:13:34 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10035609, page: 1
2026-03-25 16:13:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Page: 1/4, total results: 63
2026-03-25 16:13:36 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-25 16:13:36 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240953773%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240953773: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230943706%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230943706: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230926416%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230926416: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603220906132%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603220906132: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190849122%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190849122: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190849015%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190849015: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170784094%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170784094: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170783833%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170783833: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140709294%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603140709294: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140709218%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603140709218: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120641168%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120641168: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100567112%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100567112: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100562398%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100562398: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050450202%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050450202: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050450160%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050450160: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050448747%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050448747: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030360091%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030360091: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020344013%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603020344013: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270277721%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270277721: 1
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270262262%27 HTTP/1.1" 200 None
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270262262: 1
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 16:13:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-25 16:13:36 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10035609, page: 2
2026-03-25 16:13:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Page: 2/4, total results: 63
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240183480%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240183480: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230157790%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230157790: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190067790%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190067790: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190067700%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190067700: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602170003234%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602170003234: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129891128%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602129891128: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129890456%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602129890456: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129889699%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602129889699: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129889374%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602129889374: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079761121%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602079761121: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079761074%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602079761074: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079759155%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602079759155: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059714303%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602059714303: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309557621%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601309557621: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279459739%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601279459739: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239383420%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239383420: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239369656%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239369656: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229344754%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229344754: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229338638%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601229338638: 1
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209292532%27 HTTP/1.1" 200 None
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601209292532: 1
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 16:13:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-25 16:13:38 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10035609, page: 3
2026-03-25 16:13:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 09021853-29cd-548e-a51a-6b3b580531ff with identifier: 202603120641168
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09021853-29cd-548e-a51a-6b3b580531ff
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7654caec930648768b87f9d574a0b602.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7654caec930648768b87f9d574a0b602.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ca40e4af-fc57-5dbe-83d6-a06ff504589d with identifier: 202603100567112
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ca40e4af-fc57-5dbe-83d6-a06ff504589d
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fba04d9c9ff4343a48cb63f14a19d27f2.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ba04d9c9ff4343a48cb63f14a19d27f2.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f84134-3a25-5af7-ba8a-6a664a30ba2d with identifier: 202603100562398
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 36f84134-3a25-5af7-ba8a-6a664a30ba2d
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc911616d57d1469dbf53b1b12b8e42de.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c911616d57d1469dbf53b1b12b8e42de.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ad002b99-e49a-5119-96a1-f897ac4e9cd1 with identifier: 202603050450202
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ad002b99-e49a-5119-96a1-f897ac4e9cd1
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8afaa98526594a5aa4928744e0bc7ecc.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8afaa98526594a5aa4928744e0bc7ecc.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bae2b061-1271-5baa-9bbe-ff0f89b6c2c0 with identifier: 202603050450160
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bae2b061-1271-5baa-9bbe-ff0f89b6c2c0
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F728ca65f090c4c85bbff085164631778.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/728ca65f090c4c85bbff085164631778.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cd545247-b4fd-5f4d-8b98-0efe2f473c0c with identifier: 202603050448747
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cd545247-b4fd-5f4d-8b98-0efe2f473c0c
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02f07e18b90e42d8aaa8423d5e9957e8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02f07e18b90e42d8aaa8423d5e9957e8.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 694e9510-63ae-52f7-a282-e9bf202e00dd with identifier: 202603030360091
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 694e9510-63ae-52f7-a282-e9bf202e00dd
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F038fd4d8ab12412ca1d09dbc26b631c7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/038fd4d8ab12412ca1d09dbc26b631c7.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ed340d2-8c30-5819-8aa5-da8a852e1276 with identifier: 202603020344013
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9ed340d2-8c30-5819-8aa5-da8a852e1276
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2762f75da30446a19b038955ed63900a.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2762f75da30446a19b038955ed63900a.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: cb766b3a-53b4-52b6-8619-a5a7b85b04bf with identifier: 202602270277721
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item cb766b3a-53b4-52b6-8619-a5a7b85b04bf
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83074d6881664e918c1338955259df6f.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83074d6881664e918c1338955259df6f.jpg not downloaded yet
2026-03-25 16:13:39 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ae682ca-4c15-5f53-b3e5-415c7d98ab2d with identifier: 202602270262262
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4ae682ca-4c15-5f53-b3e5-415c7d98ab2d
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b7faf793496442a9b35f7717b4170f8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b7faf793496442a9b35f7717b4170f8.jpg not downloaded yet
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ba04d9c9ff4343a48cb63f14a19d27f2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c911616d57d1469dbf53b1b12b8e42de.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/728ca65f090c4c85bbff085164631778.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/7654caec930648768b87f9d574a0b602.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/038fd4d8ab12412ca1d09dbc26b631c7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8afaa98526594a5aa4928744e0bc7ecc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2762f75da30446a19b038955ed63900a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/02f07e18b90e42d8aaa8423d5e9957e8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2b7faf793496442a9b35f7717b4170f8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 16:13:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 16:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354dd0a10>
2026-03-25 16:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 16:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca40e4af-fc57-5dbe-83d6-a06ff504589d/ca40e4af-fc57-5dbe-83d6-a06ff504589d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fba04d9c9ff4343a48cb63f14a19d27f2.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ba04d9c9ff4343a48cb63f14a19d27f2.jpg saved to cache
2026-03-25 16:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca40e4af-fc57-5dbe-83d6-a06ff504589d
2026-03-25 16:13:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca40e4af-fc57-5dbe-83d6-a06ff504589d sending to next pipeline
2026-03-25 16:13:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ca40e4af-fc57-5dbe-83d6-a06ff504589d with identifier 202603100567112
2026-03-25 16:13:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-25 16:13:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 16:13:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 16:13:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 16:13:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-25 16:13:40 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2013
2026-03-25 16:13:40 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774455220
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774455220
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ca40e4af-fc57-5dbe-83d6-a06ff504589d
2026-03-25 16:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ba04d9c9ff4343a48cb63f14a19d27f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this Abarth 595 1.4 '
                'T-Jet Competizione track / fast road focused example. Sabelt '
                'racing bucket seats / rear seat delete with torsion bar '
                'install/ light weight ATS wheels wrapped on Goodyear Eagle F1 '
                'tyres. This is a really driver focused hot hatch and would be '
                'ideal for a balance of daily driving and track focused '
                'outings. A special example. Before any car leaves us, a fresh '
                'service & or MOT if due, will be conducted for the new owner. '
                'This example looks and drives as it should. Three months '
                'engine & gearbox warranty provided. Looks and drives very '
                'well and has been cherished by its previous keeper, a '
                'perfectly spec’d example. Service history is present and can '
                'be disclosed fully prior to making an appointment. Part '
                'exchange very welcome . We purchase the best examples for '
                'more! So why not try us if you have a highly spec’d car with '
                'full history! Contact our WhatsApp number directly with any '
                'questions - you will receive an instant response 07749 119841 '
                '- We pay more for your car whether you buy ours or not . '
                'Viewings are by appointment only so please do not hesitate to '
                'call with any questions or to make an appointment to view and '
                'test drive.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 180,
 'fuel_type': 'Petrol',
 'id': 'ca40e4af-fc57-5dbe-83d6-a06ff504589d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100567112',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Abarth',
 'model': '595',
 'odometer': 40980,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 42,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca40e4af-fc57-5dbe-83d6-a06ff504589d/ca40e4af-fc57-5dbe-83d6-a06ff504589d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 636916,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ba04d9c9ff4343a48cb63f14a19d27f2.jpg',
             'Width': 2048}],
 'price': 11440,
 'price_includes_vat': True,
 'registration_date': '2018-09-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 595 1.4 T-Jet Competizione Euro 6 3dr',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2018}
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100567112%27 HTTP/1.1" 200 None
2026-03-25 16:13:40 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100567112: {'created_time': 1774455220.747623, 'last_price_update_time': 1774455220.747635}
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100567112') HTTP/1.1" 204 0
2026-03-25 16:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354cb1ad0>
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36f84134-3a25-5af7-ba8a-6a664a30ba2d/36f84134-3a25-5af7-ba8a-6a664a30ba2d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc911616d57d1469dbf53b1b12b8e42de.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c911616d57d1469dbf53b1b12b8e42de.jpg saved to cache
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36f84134-3a25-5af7-ba8a-6a664a30ba2d
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36f84134-3a25-5af7-ba8a-6a664a30ba2d sending to next pipeline
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354122d90>
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bae2b061-1271-5baa-9bbe-ff0f89b6c2c0/bae2b061-1271-5baa-9bbe-ff0f89b6c2c0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F728ca65f090c4c85bbff085164631778.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/728ca65f090c4c85bbff085164631778.jpg saved to cache
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bae2b061-1271-5baa-9bbe-ff0f89b6c2c0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bae2b061-1271-5baa-9bbe-ff0f89b6c2c0 sending to next pipeline
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354136c50>
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09021853-29cd-548e-a51a-6b3b580531ff/09021853-29cd-548e-a51a-6b3b580531ff_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7654caec930648768b87f9d574a0b602.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7654caec930648768b87f9d574a0b602.jpg saved to cache
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09021853-29cd-548e-a51a-6b3b580531ff
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09021853-29cd-548e-a51a-6b3b580531ff sending to next pipeline
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b464d0>
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694e9510-63ae-52f7-a282-e9bf202e00dd/694e9510-63ae-52f7-a282-e9bf202e00dd_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F038fd4d8ab12412ca1d09dbc26b631c7.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/038fd4d8ab12412ca1d09dbc26b631c7.jpg saved to cache
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 694e9510-63ae-52f7-a282-e9bf202e00dd
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 694e9510-63ae-52f7-a282-e9bf202e00dd sending to next pipeline
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354a22d50>
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad002b99-e49a-5119-96a1-f897ac4e9cd1/ad002b99-e49a-5119-96a1-f897ac4e9cd1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8afaa98526594a5aa4928744e0bc7ecc.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8afaa98526594a5aa4928744e0bc7ecc.jpg saved to cache
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad002b99-e49a-5119-96a1-f897ac4e9cd1
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad002b99-e49a-5119-96a1-f897ac4e9cd1 sending to next pipeline
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f835414ee90>
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ed340d2-8c30-5819-8aa5-da8a852e1276/9ed340d2-8c30-5819-8aa5-da8a852e1276_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2762f75da30446a19b038955ed63900a.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2762f75da30446a19b038955ed63900a.jpg saved to cache
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ed340d2-8c30-5819-8aa5-da8a852e1276
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ed340d2-8c30-5819-8aa5-da8a852e1276 sending to next pipeline
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b45050>
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd545247-b4fd-5f4d-8b98-0efe2f473c0c/cd545247-b4fd-5f4d-8b98-0efe2f473c0c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02f07e18b90e42d8aaa8423d5e9957e8.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02f07e18b90e42d8aaa8423d5e9957e8.jpg saved to cache
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd545247-b4fd-5f4d-8b98-0efe2f473c0c
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cd545247-b4fd-5f4d-8b98-0efe2f473c0c sending to next pipeline
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b46ed0>
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ae682ca-4c15-5f53-b3e5-415c7d98ab2d/4ae682ca-4c15-5f53-b3e5-415c7d98ab2d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2b7faf793496442a9b35f7717b4170f8.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2b7faf793496442a9b35f7717b4170f8.jpg saved to cache
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ae682ca-4c15-5f53-b3e5-415c7d98ab2d
2026-03-25 16:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ae682ca-4c15-5f53-b3e5-415c7d98ab2d sending to next pipeline
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 36f84134-3a25-5af7-ba8a-6a664a30ba2d with identifier 202603100562398
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 36f84134-3a25-5af7-ba8a-6a664a30ba2d
2026-03-25 16:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c911616d57d1469dbf53b1b12b8e42de.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex are proud to offer to market This '
                '2019 Lexus NX 300h , presented with a clear vehicle history '
                'check, offering you peace of mind. This example has FULL '
                'LEXUS SERVICE HISTORY FROM NEW, COMES WITH A FRESH SERVICE '
                'FOR THE NEW OWNER AND A COMPREHENSIVE WARRANTY.\n'
                '\n'
                'This stylish SUV features a 2.5 litre petrol hybrid engine '
                'paired with a smooth Four Wheel Drive system, all meeting the '
                "Euro 6 emission standards. Inside, you'll find comfortable "
                'front heated seats and the convenience of Bluetooth mobile '
                'phone connectivity.\n'
                '\n'
                'The NX 300h is equipped with advanced LED headlights that '
                'include an Auto High Beam function, enhancing your visibility '
                'at night. Parking is made easier with a rear view camera that '
                'provides helpful back guide lines. The Lexus Safety System '
                'Plus is also included, featuring Adaptive Cruise Control for '
                'a more relaxed driving experience. Furthermore, this model '
                'boasts a generous boot space, making it a practical choice '
                'for all your needs.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.5L',
 'engine_horse_power': 194,
 'fuel_type': 'Petrol Hybrid',
 'id': '36f84134-3a25-5af7-ba8a-6a664a30ba2d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100562398',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Lexus',
 'model': 'NX',
 'odometer': 79000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36f84134-3a25-5af7-ba8a-6a664a30ba2d/36f84134-3a25-5af7-ba8a-6a664a30ba2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 653768,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c911616d57d1469dbf53b1b12b8e42de.jpg',
             'Width': 2048}],
 'price': 17990,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus NX 2.5 300h GPF E-CVT 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'year': 2019}
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100562398%27 HTTP/1.1" 200 None
2026-03-25 16:13:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100562398: {'created_time': 1774455221.810803, 'last_price_update_time': 1774455221.810812}
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100562398') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bae2b061-1271-5baa-9bbe-ff0f89b6c2c0 with identifier 202603050450160
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bae2b061-1271-5baa-9bbe-ff0f89b6c2c0
2026-03-25 16:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/728ca65f090c4c85bbff085164631778.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex County come This 2017 Fiat 500 S , '
                'A fantastic example, having been owned by only two previous '
                'keepers. This stylish 1.2 litre petrol model boasts a Euro 6 '
                'emission class, making it an environmentally conscious '
                "choice. Inside, you'll find a comfortable cabin equipped with "
                'air conditioning to keep you cool, and front seats with a '
                'memory function for personalised comfort. For your '
                'convenience and entertainment, it features a 7in HD '
                'touchscreen radio complete with Bluetooth connectivity, USB '
                'and AUX inputs, and DAB digital radio.\n'
                '\n'
                'Auto trader 5 star rated family run business. Freshly '
                'serviced and MOT’d for the new keeper. For an instant answer '
                'to any queries feel free to contact out business WhatsApp '
                'number on 07749 119841\n'
                '\n'
                'The Fiat 500 S is designed to be both economical and '
                "practical. Its low CO2 emissions mean it's kinder to the "
                'environment, and this is further complemented by its low '
                'insurance group rating, which can help to keep your running '
                'costs down. Parking is made easier thanks to the rear parking '
                'sensors and the integrated parking assistance system. This '
                '2017 model offers a compelling package of features and cost '
                'effective ownership.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': 'bae2b061-1271-5baa-9bbe-ff0f89b6c2c0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050450160',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Fiat',
 'model': '500',
 'odometer': 67000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 26,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bae2b061-1271-5baa-9bbe-ff0f89b6c2c0/bae2b061-1271-5baa-9bbe-ff0f89b6c2c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 643172,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/728ca65f090c4c85bbff085164631778.jpg',
             'Width': 2048}],
 'price': 4990,
 'price_includes_vat': True,
 'registration_date': '2017-03-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 S Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2017}
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050450160%27 HTTP/1.1" 200 None
2026-03-25 16:13:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050450160: {'created_time': 1774455221.865576, 'last_price_update_time': 1774455221.865584}
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050450160') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 09021853-29cd-548e-a51a-6b3b580531ff with identifier 202603120641168
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 09021853-29cd-548e-a51a-6b3b580531ff
2026-03-25 16:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/7654caec930648768b87f9d574a0b602.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'White',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex offer to market This 2020 Mercedes '
                'Benz CLA200 AMG Line (Premium 2) presenting a remarkable '
                'opportunity with its exceptionally low mileage of just 37,000 '
                'miles for its age. This stylish coupe, featuring the sporty '
                'AMG Line trim, is powered by an efficient 1.3 litre petrol '
                'engine and meets Euro 6 emissions standards. It comes '
                'equipped with advanced LED High Performance headlamps that '
                'include integrated LED daytime running lights, and the '
                'convenience of THERMOTRONIC luxury automatic climate control '
                'with two zones and a display. For effortless parking, it '
                'boasts a comprehensive Parking Package with front and rear '
                'sensors, as well as a rear camera. Furthermore, the cabin '
                'offers the modern convenience of wireless phone charging and '
                'automatic headlamp activation through Headlamp Assist.\n'
                '\n'
                'A simply out of the box example. Contact our direct business '
                'WhatsApp number for immediate answers to any questions on '
                '07749 119841. \n'
                '\n'
                'The Mercedes Benz CLA200 AMG Line (Premium 2) offers an '
                'impressive fuel economy of 46 miles per gallon, demonstrating '
                'its efficiency compared to other vehicles in its class. Its '
                'performance is equally noteworthy, achieving 0 to 62 miles '
                'per hour in a brisk 8.4 seconds, indicating a responsive '
                "driving experience. These highlights underscore the vehicle's "
                'superior blend of economy and dynamic capability, making it a '
                'compelling choice for those seeking a premium driving '
                'experience.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 161,
 'fuel_type': 'Petrol',
 'id': '09021853-29cd-548e-a51a-6b3b580531ff',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120641168',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'CLA',
 'odometer': 37000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09021853-29cd-548e-a51a-6b3b580531ff/09021853-29cd-548e-a51a-6b3b580531ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 550899,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/7654caec930648768b87f9d574a0b602.jpg',
             'Width': 2048}],
 'price': 18490,
 'price_includes_vat': True,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA 1.3 CLA200 AMG Line (Premium 2) Shooting Brake '
          '7G-DCT Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120641168%27 HTTP/1.1" 200 None
2026-03-25 16:13:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120641168: {'created_time': 1774455221.909901, 'last_price_update_time': 1774455221.909913}
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120641168') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 694e9510-63ae-52f7-a282-e9bf202e00dd with identifier 202603030360091
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 694e9510-63ae-52f7-a282-e9bf202e00dd
2026-03-25 16:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/038fd4d8ab12412ca1d09dbc26b631c7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex are delighted to offer This 2018 '
                'Mercedes Benz GLC250d AMG Line Premium with exceptionally low '
                'mileage for its age, having covered just 50,000 miles, and '
                'comes with a clear vehicle history check. This four wheel '
                'drive, Euro 6 compliant, 2.1 litre diesel SUV offers a '
                'compelling blend of performance and practicality. Finished in '
                'a striking AMG Line trim, it features 20 inch AMG multi spoke '
                'alloy wheels painted in titanium grey and a luxurious black '
                'leather interior. Convenience is enhanced by automatic '
                'headlamp activation and a reversing camera, while the Audio '
                '20 CD system with Bluetooth connectivity ensures you stay '
                'connected on the go.\n'
                '\n'
                'The GLC250d AMG Line Premium excels with its impressive fuel '
                'economy, achieving up to 57 miles per gallon, and low CO2 '
                'emissions, making it an economical choice. Its acceleration '
                'from 0 to 62 miles per hour in just 7.6 seconds demonstrates '
                'its responsive power, while the substantial boot space '
                'provides ample room for luggage or shopping. With a towing '
                'weight of 2500 kg, this Mercedes Benz is also a capable '
                'companion for towing needs, offering a superior driving '
                'experience compared to many other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 201,
 'fuel_type': 'Diesel',
 'id': '694e9510-63ae-52f7-a282-e9bf202e00dd',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030360091',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'GLC',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 33,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694e9510-63ae-52f7-a282-e9bf202e00dd/694e9510-63ae-52f7-a282-e9bf202e00dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 611114,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/038fd4d8ab12412ca1d09dbc26b631c7.jpg',
             'Width': 2048}],
 'price': 21990,
 'price_includes_vat': True,
 'registration_date': '2018-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC 2.1 GLC250d AMG Line (Premium) SUV 5dr Diesel '
          'G-Tronic 4MATIC Euro 6 (s/s) (204 ps)',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030360091%27 HTTP/1.1" 200 None
2026-03-25 16:13:41 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030360091: {'created_time': 1774455221.967092, 'last_price_update_time': 1774455221.967102}
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030360091') HTTP/1.1" 204 0
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ad002b99-e49a-5119-96a1-f897ac4e9cd1 with identifier 202603050450202
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:41 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ad002b99-e49a-5119-96a1-f897ac4e9cd1
2026-03-25 16:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8afaa98526594a5aa4928744e0bc7ecc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2017 MINI Hatch Cooper S offers a thrilling driving '
                'experience with its potent 2.0L petrol engine, capable of '
                'accelerating from 0 to 62mph in just 6.9 seconds. As a Euro 6 '
                'compliant vehicle, it meets modern emission standards. This '
                'particular model benefits from the desirable 7KN CHILI Pack '
                'and the John Cooper Works Chili Pack, both of which include '
                'automatic LED headlights and climate control for enhanced '
                'comfort and convenience. Further enhancing its appeal are the '
                'stylish 18 inch Cup Spoke alloy wheels in a two tone finish '
                'and the John Cooper Works Sport Pack, all controlled '
                'conveniently via multifunction controls on the steering '
                'wheel.\n'
                '\n'
                'The inclusion of the John Cooper Works Sport Pack and the '
                'Chili Packs signifies a higher specification, offering a more '
                'engaging and premium feel compared to standard models. These '
                'features, combined with the sporty Cooper S variant, ensure '
                'this MINI Hatch delivers both performance and a refined '
                'driving environment. The 2.0L engine provides ample power for '
                'both city driving and longer journeys, making it a versatile '
                'and enjoyable car to own.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 189,
 'fuel_type': 'Petrol',
 'id': 'ad002b99-e49a-5119-96a1-f897ac4e9cd1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050450202',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 78000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 36,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad002b99-e49a-5119-96a1-f897ac4e9cd1/ad002b99-e49a-5119-96a1-f897ac4e9cd1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621347,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8afaa98526594a5aa4928744e0bc7ecc.jpg',
             'Width': 2048}],
 'price': 7990,
 'price_includes_vat': True,
 'registration_date': '2017-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 Cooper S Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Cooper S',
 'year': 2017}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050450202%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050450202: {'created_time': 1774455222.01033, 'last_price_update_time': 1774455222.01034}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050450202') HTTP/1.1" 204 0
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9ed340d2-8c30-5819-8aa5-da8a852e1276 with identifier 202603020344013
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9ed340d2-8c30-5819-8aa5-da8a852e1276
2026-03-25 16:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2762f75da30446a19b038955ed63900a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'White',
 'currency': 'GBP',
 'description': 'JUST ARRIVED - AWAITING PREPERATION - RESERVE This 2019 '
                'Volkswagen Golf TSI EVO GT is a superb example of a well '
                'maintained and popular hatchback.  It features a responsive '
                '1.5 litre petrol engine, meeting Euro 6 emission standards, '
                "and comes in the desirable GT trim.  You'll appreciate the "
                'sophisticated aerodynamic black radiator grille with its '
                'chrome trimmed insert, and the convenience of the dusk sensor '
                'which automatically activates the headlights.  The '
                'Convenience Pack further enhances this with automatic '
                'headlights, while Adaptive Cruise Control makes longer '
                'journeys more relaxed.  Connecting your smartphone is '
                'seamless thanks to Car Net App Connect, supporting both '
                'Android Auto and Apple CarPlay.\n'
                '\n'
                'This Golf offers a generous boot space, making it practical '
                'for everyday use and weekend getaways. Its low CO2 emissions '
                'are a testament to its efficient design, indicating it is a '
                'more environmentally conscious choice compared to many other '
                'vehicles. The 0 to 62 miles per hour acceleration in just 9.1 '
                'seconds demonstrates a pleasing blend of performance and '
                'economy, showing how this particular model offers a more '
                'engaging driving experience than some alternatives.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': '9ed340d2-8c30-5819-8aa5-da8a852e1276',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603020344013',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 76000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 37,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ed340d2-8c30-5819-8aa5-da8a852e1276/9ed340d2-8c30-5819-8aa5-da8a852e1276_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 621904,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2762f75da30446a19b038955ed63900a.jpg',
             'Width': 2048}],
 'price': 11990,
 'price_includes_vat': True,
 'registration_date': '2019-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.5 TSI EVO GT DSG Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603020344013%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603020344013: {'created_time': 1774455222.063308, 'last_price_update_time': 1774455222.06332}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603020344013') HTTP/1.1" 204 0
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cd545247-b4fd-5f4d-8b98-0efe2f473c0c with identifier 202603050448747
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cd545247-b4fd-5f4d-8b98-0efe2f473c0c
2026-03-25 16:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/02f07e18b90e42d8aaa8423d5e9957e8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex present This 2018 Ford Fiesta '
                'Titanium with exceptionally low mileage for its age, having '
                'covered just 33,000 miles. This popular hatchback, featuring '
                'a 1.0L petrol engine and Euro 6 emissions, has had only two '
                'owners. It comes equipped with the NCAP Pack, which includes '
                'automatic headlights that turn on and off by themselves, as '
                "well as automatic high beam functionality. Inside, you'll "
                'find electronic automatic air conditioning for a comfortable '
                'cabin temperature and the Ford Navigation System with Ford '
                'SYNC 3, offering seamless integration with Apple CarPlay \n'
                '\n'
                'FULL FORD SERVICE HISTORY - IMMACULATE CONDITION - FIRST TO '
                'VIEW WILL BUY THIS OUTSTADING EXAMPLE! \n'
                '\n'
                'impressive efficiency, achieving a remarkable 60 miles per '
                'gallon, which is excellent for its class. Its low CO2 '
                'emissions also contribute to its economical running costs. '
                'Furthermore, its acceleration from 0 to 62 miles per hour in '
                'just 10.0 seconds demonstrates a responsive driving '
                'experience. These highlights collectively indicate that this '
                'particular Fiesta Titanium provides a superior combination of '
                'economy, technology, and performance compared to many other '
                'vehicles of its type.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': 'cd545247-b4fd-5f4d-8b98-0efe2f473c0c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050448747',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 33000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd545247-b4fd-5f4d-8b98-0efe2f473c0c/cd545247-b4fd-5f4d-8b98-0efe2f473c0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 631109,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/02f07e18b90e42d8aaa8423d5e9957e8.jpg',
             'Width': 2048}],
 'price': 7990,
 'price_includes_vat': True,
 'registration_date': '2018-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost Titanium Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050448747%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050448747: {'created_time': 1774455222.105003, 'last_price_update_time': 1774455222.105011}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050448747') HTTP/1.1" 204 0
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4ae682ca-4c15-5f53-b3e5-415c7d98ab2d with identifier 202602270262262
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4ae682ca-4c15-5f53-b3e5-415c7d98ab2d
2026-03-25 16:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2b7faf793496442a9b35f7717b4170f8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2017 Jaguar XF d V6 S presents a superb ownership '
                'proposition, boasting a Euro 6 compliant 3.0L diesel engine. '
                'This particular example, finished in the Portfolio trim, '
                'comes equipped with desirable features such as Bluetooth '
                'telephone connectivity, a rear view camera for effortless '
                'parking assistance, and a sophisticated 2 zone climate '
                'control system. Inside, you will appreciate the comfort of '
                'heated front seats and the immersive audio experience '
                'provided by the Meridian sound system, delivering 380W of '
                'premium sound.\n'
                '\n'
                'The Jaguar XF d V6 Portfolio offers a compelling blend of '
                'performance and practicality. Its impressive acceleration, '
                'reaching 0-60mph in just 6.1 seconds, demonstrates its '
                'dynamic capability. Furthermore, this model benefits from a '
                'low insurance group, making it an economical choice for many '
                'drivers. The generous boot space ensures that you have ample '
                'room for luggage or shopping, highlighting its suitability '
                'for everyday life and longer journeys alike, setting it apart '
                'from many other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 296,
 'fuel_type': 'Diesel',
 'id': '4ae682ca-4c15-5f53-b3e5-415c7d98ab2d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270262262',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 92000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 3,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ae682ca-4c15-5f53-b3e5-415c7d98ab2d/4ae682ca-4c15-5f53-b3e5-415c7d98ab2d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43557,
             'Height': 492,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2b7faf793496442a9b35f7717b4170f8.jpg',
             'Width': 1000}],
 'price': 14990,
 'price_includes_vat': True,
 'registration_date': '2019-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 3.0d V6 S Sportbrake 5dr Diesel Auto Euro 6 (s/s) (300 '
          'ps)',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2017}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270262262%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270262262: {'created_time': 1774455222.153884, 'last_price_update_time': 1774455222.153893}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270262262') HTTP/1.1" 204 0
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b136ee3-17dd-5011-802f-356891517874 with identifier: 202603240953773
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2b136ee3-17dd-5011-802f-356891517874
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe18627dcf454e8dae80776bf9692e52.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe18627dcf454e8dae80776bf9692e52.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a7756ed-e021-50c0-9530-95d07924aee4 with identifier: 202602079761074
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5a7756ed-e021-50c0-9530-95d07924aee4
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F341444f4b553404fa3e1e10a0248ba1c.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/341444f4b553404fa3e1e10a0248ba1c.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bd163679-71c5-5e88-a2cf-9f162ad11a57 with identifier: 202602240183480
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bd163679-71c5-5e88-a2cf-9f162ad11a57
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd7f752db01e4244a1c1e50057bdd650.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd7f752db01e4244a1c1e50057bdd650.jpg not downloaded yet
2026-03-25 16:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/83074d6881664e918c1338955259df6f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 92525ebf-d8ea-5499-bcfe-2fe195f733c9 with identifier: 202603230943706
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 92525ebf-d8ea-5499-bcfe-2fe195f733c9
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F46acd260a7c84c8d9da640deeda4b11d.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/46acd260a7c84c8d9da640deeda4b11d.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5307f918-66bf-58ba-a32e-0e7d295ba96b with identifier: 202602079759155
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5307f918-66bf-58ba-a32e-0e7d295ba96b
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F141f30fb30bb4e7b82fb1073e927832a.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/141f30fb30bb4e7b82fb1073e927832a.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 016ec962-3b2f-59bf-9a17-ee0b500ebeea with identifier: 202602230157790
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 016ec962-3b2f-59bf-9a17-ee0b500ebeea
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F400f12004ee347beb6cc3abf2943e1f7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/400f12004ee347beb6cc3abf2943e1f7.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539 with identifier: 202603230926416
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fb370d533174d2d87dd1884e0e2fa75.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fb370d533174d2d87dd1884e0e2fa75.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 817e14b0-ab4d-5e56-9465-aa4a4777d4f4 with identifier: 202602059714303
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 817e14b0-ab4d-5e56-9465-aa4a4777d4f4
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e48b99c05074785a468ef61b46e0440.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e48b99c05074785a468ef61b46e0440.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dcea8d5-468e-50db-9511-62d1f46aac9e with identifier: 202602190067790
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8dcea8d5-468e-50db-9511-62d1f46aac9e
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe5a86c6754a5479b8e29a15c0465baff.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e5a86c6754a5479b8e29a15c0465baff.jpg not downloaded yet
2026-03-25 16:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354159410>
2026-03-25 16:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb766b3a-53b4-52b6-8619-a5a7b85b04bf/cb766b3a-53b4-52b6-8619-a5a7b85b04bf_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83074d6881664e918c1338955259df6f.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83074d6881664e918c1338955259df6f.jpg saved to cache
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb766b3a-53b4-52b6-8619-a5a7b85b04bf
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb766b3a-53b4-52b6-8619-a5a7b85b04bf sending to next pipeline
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 96d33753-fb2c-5213-8f88-017d934c5ac6 with identifier: 202603220906132
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 96d33753-fb2c-5213-8f88-017d934c5ac6
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F402bb4f015384e62b3037793edb7e9fb.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/402bb4f015384e62b3037793edb7e9fb.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef65797-1cb3-50b5-99ef-8f5f8df38ee1 with identifier: 202601309557621
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ef65797-1cb3-50b5-99ef-8f5f8df38ee1
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5700ed717f054727a681a4cb0eb552e5.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5700ed717f054727a681a4cb0eb552e5.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258 with identifier: 202602190067700
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ecad30cef0148f99bb15ce4bf340c30.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ecad30cef0148f99bb15ce4bf340c30.jpg not downloaded yet
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: cb766b3a-53b4-52b6-8619-a5a7b85b04bf with identifier 202602270277721
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item cb766b3a-53b4-52b6-8619-a5a7b85b04bf
2026-03-25 16:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/83074d6881664e918c1338955259df6f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2018 Mercedes Benz A Class A200 AMG Line Premium offers '
                'a sophisticated driving experience. Powered by a 1.3 litre '
                'petrol engine and meeting Euro 6 emissions standards, this '
                'model combines efficiency with performance. The AMG Line trim '
                'enhances its sporty appeal, while the Premium Package '
                'includes convenient Keyless Entry. You will also benefit from '
                'THERMOTRONIC luxury automatic climate control, ensuring a '
                'comfortable cabin temperature for all occupants.\n'
                '\n'
                'Experience effortless driving with LED High Performance '
                'Headlamps that automatically activate, providing excellent '
                'visibility. The 180 degree reversing camera with parking '
                'guidelines makes manoeuvring simple and safe. This A Class '
                'boasts impressive acceleration, reaching 0 to 62 miles per '
                'hour in just 8.0 seconds, demonstrating its dynamic '
                'capabilities. Furthermore, the generous boot space ensures '
                'practicality for everyday needs and longer journeys, setting '
                'it apart from many other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.3L',
 'engine_horse_power': 161,
 'fuel_type': 'Petrol',
 'id': 'cb766b3a-53b4-52b6-8619-a5a7b85b04bf',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270277721',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'A Class',
 'odometer': 74000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb766b3a-53b4-52b6-8619-a5a7b85b04bf/cb766b3a-53b4-52b6-8619-a5a7b85b04bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 695520,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/83074d6881664e918c1338955259df6f.jpg',
             'Width': 2048}],
 'price': 13740,
 'price_includes_vat': True,
 'registration_date': '2018-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A Class 1.3 A200 AMG Line (Premium) 7G-DCT Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270277721%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270277721: {'created_time': 1774455222.659527, 'last_price_update_time': 1774455222.659535}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270277721') HTTP/1.1" 204 0
2026-03-25 16:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fe18627dcf454e8dae80776bf9692e52.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a94fa91d-cb67-54a5-83e5-6676a6126292 with identifier: 202603190849122
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a94fa91d-cb67-54a5-83e5-6676a6126292
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F553fa28623814656982ebf6d2c6751c3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/553fa28623814656982ebf6d2c6751c3.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 328be922-640b-56ed-8056-9f9965204b73 with identifier: 202601279459739
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 328be922-640b-56ed-8056-9f9965204b73
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d99a5d61ba84db4bc559d0e2de19fc0.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d99a5d61ba84db4bc559d0e2de19fc0.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3af2d441-03bd-5067-bd7d-9b589c0aa499 with identifier: 202602170003234
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3af2d441-03bd-5067-bd7d-9b589c0aa499
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc97ffc3ad63b4c4b981ac4deffb69a54.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c97ffc3ad63b4c4b981ac4deffb69a54.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: df6c01d2-2a1a-5072-a15d-5477f6e00b7f with identifier: 202603190849015
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item df6c01d2-2a1a-5072-a15d-5477f6e00b7f
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a4a66a709764870b9e4ddfb2dd97f87.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a4a66a709764870b9e4ddfb2dd97f87.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fdcd87e-d2fa-5353-854d-134229ecc816 with identifier: 202601239383420
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2fdcd87e-d2fa-5353-854d-134229ecc816
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54e978d27e0648958b6481659b328ef8.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54e978d27e0648958b6481659b328ef8.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b2e38601-a57e-5db2-9a2a-2185e040b8a8 with identifier: 202602129891128
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b2e38601-a57e-5db2-9a2a-2185e040b8a8
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb87e6539f47646469fd8e7419db81e48.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b87e6539f47646469fd8e7419db81e48.jpg not downloaded yet
2026-03-25 16:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/46acd260a7c84c8d9da640deeda4b11d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cd2e430-4a1b-533f-8446-0254e80a1f86 with identifier: 202603170784094
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3cd2e430-4a1b-533f-8446-0254e80a1f86
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F348262735f184a258c0284b594e951b4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/348262735f184a258c0284b594e951b4.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 28883597-60c8-5810-9cf2-bc90f477c800 with identifier: 202601239369656
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 28883597-60c8-5810-9cf2-bc90f477c800
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62c15149d85e42dcb15ce46cf49308a4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62c15149d85e42dcb15ce46cf49308a4.jpg not downloaded yet
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 55260cbc-6fa9-51f3-a81f-4f31067ab652 with identifier: 202602129890456
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 55260cbc-6fa9-51f3-a81f-4f31067ab652
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb3a5fcb75ded4d3e8273945d11337f75.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b3a5fcb75ded4d3e8273945d11337f75.jpg not downloaded yet
2026-03-25 16:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f834743c810>
2026-03-25 16:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b136ee3-17dd-5011-802f-356891517874/2b136ee3-17dd-5011-802f-356891517874_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe18627dcf454e8dae80776bf9692e52.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe18627dcf454e8dae80776bf9692e52.jpg saved to cache
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b136ee3-17dd-5011-802f-356891517874
2026-03-25 16:13:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b136ee3-17dd-5011-802f-356891517874 sending to next pipeline
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2b136ee3-17dd-5011-802f-356891517874 with identifier 202603240953773
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2b136ee3-17dd-5011-802f-356891517874
2026-03-25 16:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fe18627dcf454e8dae80776bf9692e52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'White',
 'currency': 'GBP',
 'description': 'Cheapest 22 plate online by far - DUE THIS WEEK',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '2b136ee3-17dd-5011-802f-356891517874',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240953773',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 59000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b136ee3-17dd-5011-802f-356891517874/2b136ee3-17dd-5011-802f-356891517874_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30856,
             'Height': 417,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe18627dcf454e8dae80776bf9692e52.jpg',
             'Width': 714}],
 'price': 8490,
 'price_includes_vat': True,
 'registration_date': '2022-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ecosport 1.0T EcoBoost Titanium Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2022}
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240953773%27 HTTP/1.1" 200 None
2026-03-25 16:13:42 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240953773: {'created_time': 1774455222.991585, 'last_price_update_time': 1774455222.991599}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240953773') HTTP/1.1" 204 0
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b446c520-d04a-5dad-acae-a706b28b3ce0 with identifier: 202603170783833
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b446c520-d04a-5dad-acae-a706b28b3ce0
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb0c3fef505c48999c150a0a87c1f037.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db0c3fef505c48999c150a0a87c1f037.jpg not downloaded yet
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9313b08b-e01e-59ce-b6cc-0c83fcae55d1 with identifier: 202601229344754
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9313b08b-e01e-59ce-b6cc-0c83fcae55d1
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcfb788cafcd84413b5e2627baf87eeba.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cfb788cafcd84413b5e2627baf87eeba.jpg not downloaded yet
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8 with identifier: 202602129889699
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad7c3607d57841fca2e0141a18e7e8ff.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad7c3607d57841fca2e0141a18e7e8ff.jpg not downloaded yet
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b1bf6e9-e497-5351-8cb6-18ce290c3de4 with identifier: 202603140709294
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2b1bf6e9-e497-5351-8cb6-18ce290c3de4
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F692e1ef952744f5a968b9b1fd8d71a89.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/692e1ef952744f5a968b9b1fd8d71a89.jpg not downloaded yet
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c82cd00-c477-5463-a80b-96f95eee55c0 with identifier: 202601229338638
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3c82cd00-c477-5463-a80b-96f95eee55c0
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fad6b18d899482a8b1b55f17ec2a80e.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fad6b18d899482a8b1b55f17ec2a80e.jpg not downloaded yet
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ea98eb5-8472-560e-95ce-1f8b53ef3883 with identifier: 202602129889374
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5ea98eb5-8472-560e-95ce-1f8b53ef3883
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6031998651d4fbcb60143918e85524e.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6031998651d4fbcb60143918e85524e.jpg not downloaded yet
2026-03-25 16:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cd7f752db01e4244a1c1e50057bdd650.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/341444f4b553404fa3e1e10a0248ba1c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/141f30fb30bb4e7b82fb1073e927832a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347480b90>
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92525ebf-d8ea-5499-bcfe-2fe195f733c9/92525ebf-d8ea-5499-bcfe-2fe195f733c9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F46acd260a7c84c8d9da640deeda4b11d.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/46acd260a7c84c8d9da640deeda4b11d.jpg saved to cache
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92525ebf-d8ea-5499-bcfe-2fe195f733c9
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92525ebf-d8ea-5499-bcfe-2fe195f733c9 sending to next pipeline
2026-03-25 16:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/400f12004ee347beb6cc3abf2943e1f7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b47c1724-e7bd-5269-8107-0a6c90ff8998 with identifier: 202603140709218
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b47c1724-e7bd-5269-8107-0a6c90ff8998
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6eef3a4f2c2491ea9e6d9c2b47ee343.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6eef3a4f2c2491ea9e6d9c2b47ee343.jpg not downloaded yet
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f024a43-07ea-5327-bd1f-1e5e96f93aed with identifier: 202601209292532
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4f024a43-07ea-5327-bd1f-1e5e96f93aed
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9109ff369f6b47f68a27ea6e9ab4c7fa.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9109ff369f6b47f68a27ea6e9ab4c7fa.jpg not downloaded yet
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c738788b-8ed9-58f9-a636-d946e29e3007 with identifier: 202602079761121
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c738788b-8ed9-58f9-a636-d946e29e3007
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa5ab9257480a4648b130e8a531512e3c.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a5ab9257480a4648b130e8a531512e3c.jpg not downloaded yet
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 92525ebf-d8ea-5499-bcfe-2fe195f733c9 with identifier 202603230943706
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 92525ebf-d8ea-5499-bcfe-2fe195f733c9
2026-03-25 16:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/46acd260a7c84c8d9da640deeda4b11d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 229,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Due in - very high spec',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '4.4L',
 'engine_horse_power': 334,
 'fuel_type': 'Diesel',
 'id': '92525ebf-d8ea-5499-bcfe-2fe195f733c9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230943706',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 115000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92525ebf-d8ea-5499-bcfe-2fe195f733c9/92525ebf-d8ea-5499-bcfe-2fe195f733c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105037,
             'Height': 685,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/46acd260a7c84c8d9da640deeda4b11d.jpg',
             'Width': 1290}],
 'price': 14990,
 'price_includes_vat': True,
 'registration_date': '2013-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover 4.4 SD V8 Autobiography Auto 4WD Euro 5 5dr',
 'transmission': 'automatic',
 'trim': 'Autobiography',
 'year': 2013}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230943706%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230943706: {'created_time': 1774455223.30889, 'last_price_update_time': 1774455223.308899}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230943706') HTTP/1.1" 204 0
2026-03-25 16:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/402bb4f015384e62b3037793edb7e9fb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e5a86c6754a5479b8e29a15c0465baff.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9e48b99c05074785a468ef61b46e0440.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347434890>
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd163679-71c5-5e88-a2cf-9f162ad11a57/bd163679-71c5-5e88-a2cf-9f162ad11a57_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd7f752db01e4244a1c1e50057bdd650.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd7f752db01e4244a1c1e50057bdd650.jpg saved to cache
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd163679-71c5-5e88-a2cf-9f162ad11a57
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd163679-71c5-5e88-a2cf-9f162ad11a57 sending to next pipeline
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83474934d0>
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a7756ed-e021-50c0-9530-95d07924aee4/5a7756ed-e021-50c0-9530-95d07924aee4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F341444f4b553404fa3e1e10a0248ba1c.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/341444f4b553404fa3e1e10a0248ba1c.jpg saved to cache
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a7756ed-e021-50c0-9530-95d07924aee4
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a7756ed-e021-50c0-9530-95d07924aee4 sending to next pipeline
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f834743d610>
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5307f918-66bf-58ba-a32e-0e7d295ba96b/5307f918-66bf-58ba-a32e-0e7d295ba96b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F141f30fb30bb4e7b82fb1073e927832a.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/141f30fb30bb4e7b82fb1073e927832a.jpg saved to cache
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5307f918-66bf-58ba-a32e-0e7d295ba96b
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5307f918-66bf-58ba-a32e-0e7d295ba96b sending to next pipeline
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347435250>
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016ec962-3b2f-59bf-9a17-ee0b500ebeea/016ec962-3b2f-59bf-9a17-ee0b500ebeea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F400f12004ee347beb6cc3abf2943e1f7.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/400f12004ee347beb6cc3abf2943e1f7.jpg saved to cache
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 016ec962-3b2f-59bf-9a17-ee0b500ebeea
2026-03-25 16:13:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 016ec962-3b2f-59bf-9a17-ee0b500ebeea sending to next pipeline
2026-03-25 16:13:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4fb370d533174d2d87dd1884e0e2fa75.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bd163679-71c5-5e88-a2cf-9f162ad11a57 with identifier 202602240183480
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bd163679-71c5-5e88-a2cf-9f162ad11a57
2026-03-25 16:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cd7f752db01e4244a1c1e50057bdd650.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'John Hammick Cars are proud to offer This 2019 Fiat 500 '
                'Sport, a blend of style and practicality, making it an '
                'excellent choice for city driving. Powered by an efficient '
                '1.2 litre Euro 6 petrol engine, this model is designed for '
                "economical motoring. Inside, you'll find comfortable front "
                'seats with a memory function, perfect for quickly adjusting '
                'to your preferred driving position. Parking is made easier '
                'with rear parking sensors, and the 7 inch HD touchscreen '
                'radio provides seamless connectivity through Bluetooth, USB, '
                'and DAB digital radio. Enjoy your favourite smartphone apps '
                'on the go with Apple CarPlay and Android Auto compatibility, '
                'all while staying cool with the fitted air conditioning.\n'
                '\n'
                'This Fiat 500 Sport stands out with its impressive fuel '
                'economy, achieving up to 51 miles per gallon, which indicates '
                'it is more economical than many similar vehicles. '
                'Furthermore, its low insurance group rating suggests that '
                'running costs will be kept to a minimum. The vehicle also '
                'boasts low CO2 emissions, highlighting its environmentally '
                'conscious design compared to other cars in its class.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': 'bd163679-71c5-5e88-a2cf-9f162ad11a57',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240183480',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Fiat',
 'model': '500',
 'odometer': 82000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 20,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd163679-71c5-5e88-a2cf-9f162ad11a57/bd163679-71c5-5e88-a2cf-9f162ad11a57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 618128,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd7f752db01e4244a1c1e50057bdd650.jpg',
             'Width': 2048}],
 'price': 5440,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Sport Euro 6 (s/s) 3dr',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240183480%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240183480: {'created_time': 1774455223.726428, 'last_price_update_time': 1774455223.726438}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240183480') HTTP/1.1" 204 0
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5a7756ed-e021-50c0-9530-95d07924aee4 with identifier 202602079761074
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5a7756ed-e021-50c0-9530-95d07924aee4
2026-03-25 16:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/341444f4b553404fa3e1e10a0248ba1c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'DUE THIS WEEK! The Audi A5 Cabriolet TFSI S line is a 2012 '
                'model, boasting a 2.0L Petrol Engine and Four Wheel Drive '
                'drivetrain. This S line trim is a sporty variant of the A5 '
                'Cabriolet, offering a unique blend of style and performance. '
                "The vehicle's standard features include Bi-Xenon Plus "
                'headlights, which provide superior illumination on the road, '
                'as well as an Acoustic Parking System with rear sensors, '
                'ensuring safe and effortless parking. The interior is '
                'equipped with Deluxe 3-Zone Climate Control, allowing '
                'passengers to tailor the temperature to their liking. '
                'Additionally, the vehicle is fitted with a Mobile Telephone '
                'Preparation system, featuring Bluetooth connectivity for '
                'seamless integration with your mobile device.\n'
                '\n'
                'One of the standout features of this Audi A5 Cabriolet is its '
                'generous boot space, perfect for road trips or everyday '
                "errands. With ample room for luggage or cargo, you'll never "
                'have to worry about running out of space. Furthermore, this '
                'vehicle boasts low CO2 emissions, making it an '
                'environmentally friendly choice for those looking to reduce '
                'their carbon footprint. These features set the Audi A5 '
                'Cabriolet apart from other similar vehicles in its class, '
                'offering a unique combination of style, performance, and '
                "practicality. Whether you're cruising down the motorway or "
                'navigating through city streets, this Audi A5 Cabriolet is '
                'sure to deliver a comfortable and enjoyable driving '
                'experience.',
 'doors_number': 2,
 'emission_standard': 'Euro 5',
 'engine': '2L',
 'engine_horse_power': 208,
 'fuel_type': 'Petrol',
 'id': '5a7756ed-e021-50c0-9530-95d07924aee4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602079761074',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Audi',
 'model': 'A5 Cabriolet',
 'odometer': 112000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a7756ed-e021-50c0-9530-95d07924aee4/5a7756ed-e021-50c0-9530-95d07924aee4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 651604,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/341444f4b553404fa3e1e10a0248ba1c.jpg',
             'Width': 2048}],
 'price': 5990,
 'price_includes_vat': True,
 'registration_date': '2012-04-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Cabriolet 2.0 TFSI S line S Tronic quattro Euro 5 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2012}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079761074%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602079761074: {'created_time': 1774455223.840298, 'last_price_update_time': 1774455223.84031}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079761074') HTTP/1.1" 204 0
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5307f918-66bf-58ba-a32e-0e7d295ba96b with identifier 202602079759155
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5307f918-66bf-58ba-a32e-0e7d295ba96b
2026-03-25 16:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/141f30fb30bb4e7b82fb1073e927832a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex welcome into stock this very well '
                'cared for 2016 Volvo V40 T3 R-Design Nav. This example boasts '
                'a clear vehicle history, offering you peace of mind. This '
                'stylish hatchback features a 1.5 litre Euro 6 petrol engine, '
                'delivering an impressive 0-60mph time of just 7.8 seconds. '
                'The R-Design Nav trim enhances the already appealing V40 with '
                'a Dynamic Chassis for a more engaging drive, and the '
                'convenient Winter Pack includes heated seats for those colder '
                "months. You'll also appreciate the electronic climate "
                'control, automatic headlights activated by a tunnel sensor, '
                'and the Bluetooth handsfree system for seamless '
                'connectivity.\n'
                '\n'
                'PRESENTED IN OUTSTANDING CONDITION AND FULLY SERVICED THIS '
                'VOLVO IS A TESTIMENT TO ITS PREVIOUS KEEPER. JOHN HAMMICK '
                'CARS ARE A TRUSTED 5 STAR AUTOTRADER DEALER WITH OVER 20 '
                'YEARS MOTORTRADE EXPERIENCE. PLEASE CONTACT OUR BUSINESS '
                'WHATSAPP FOR AN IMMEDIATE RESPONSE TO ANY QUESTIONS YOU MAY '
                'HAVE ON 07749119841\n'
                '\n'
                'The V40 T3 R-Design Nav stands out with its generous boot '
                'space, making it a practical choice for everyday life and '
                'longer journeys. The combination of its spirited acceleration '
                'and the refined handling provided by the Dynamic Chassis '
                'means this V40 offers a superior driving experience compared '
                'to many other vehicles in its class. This particular model is '
                'well equipped to provide comfort, convenience, and a touch of '
                'sporty flair.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 152,
 'fuel_type': 'Petrol',
 'id': '5307f918-66bf-58ba-a32e-0e7d295ba96b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602079759155',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 75000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5307f918-66bf-58ba-a32e-0e7d295ba96b/5307f918-66bf-58ba-a32e-0e7d295ba96b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 619563,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/141f30fb30bb4e7b82fb1073e927832a.jpg',
             'Width': 2048}],
 'price': 8990,
 'price_includes_vat': True,
 'registration_date': '2016-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 1.5 T3 R-Design Nav Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Design Nav',
 'year': 2016}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079759155%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602079759155: {'created_time': 1774455223.889976, 'last_price_update_time': 1774455223.889984}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079759155') HTTP/1.1" 204 0
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 016ec962-3b2f-59bf-9a17-ee0b500ebeea with identifier 202602230157790
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 016ec962-3b2f-59bf-9a17-ee0b500ebeea
2026-03-25 16:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/400f12004ee347beb6cc3abf2943e1f7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2011 Mercedes Benz SLK200 AMG Sport Edition 125 is a '
                'standout example with exceptionally low mileage for its age, '
                'having covered just 51,000 miles. This particular SLK has '
                'been cherished by only two owners, ensuring its excellent '
                'condition. Under the bonnet lies a responsive 1.8 litre '
                'petrol engine, paired with the desirable AMG Sport Edition '
                '125 trim. Notable features include Headlamp Assist for '
                'automatic activation of the headlights, a Bluetooth interface '
                'for seamless hands-free telephone calls, and air conditioning '
                'to keep you comfortable in all conditions.\n'
                '\n'
                'The fuel economy of this SLK is a significant highlight, '
                'achieving an impressive 44 miles per gallon, which indicates '
                'it is more economical than many similar vehicles. '
                'Furthermore, it boasts low CO2 emissions, making it a more '
                "environmentally conscious choice. You'll also appreciate the "
                'generous boot space, offering practicality for your journeys. '
                'These combined highlights demonstrate the superior efficiency '
                'and thoughtful design of this Mercedes Benz SLK.',
 'doors_number': 2,
 'emission_standard': 'Euro 5',
 'engine': '1.8L',
 'engine_horse_power': 181,
 'fuel_type': 'Petrol',
 'id': '016ec962-3b2f-59bf-9a17-ee0b500ebeea',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230157790',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'SLK',
 'odometer': 51000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016ec962-3b2f-59bf-9a17-ee0b500ebeea/016ec962-3b2f-59bf-9a17-ee0b500ebeea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 679972,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/400f12004ee347beb6cc3abf2943e1f7.jpg',
             'Width': 2048}],
 'price': 8990,
 'price_includes_vat': True,
 'registration_date': '2011-10-31',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK 1.8 SLK200 BlueEfficiency AMG Sport Edition 125 '
          'G-Tronic+ Euro 5 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'AMG Sport Edition 125',
 'year': 2011}
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230157790%27 HTTP/1.1" 200 None
2026-03-25 16:13:43 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230157790: {'created_time': 1774455223.99865, 'last_price_update_time': 1774455223.99866}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230157790') HTTP/1.1" 204 0
2026-03-25 16:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0ecad30cef0148f99bb15ce4bf340c30.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5700ed717f054727a681a4cb0eb552e5.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347745590>
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96d33753-fb2c-5213-8f88-017d934c5ac6/96d33753-fb2c-5213-8f88-017d934c5ac6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F402bb4f015384e62b3037793edb7e9fb.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/402bb4f015384e62b3037793edb7e9fb.jpg saved to cache
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96d33753-fb2c-5213-8f88-017d934c5ac6
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96d33753-fb2c-5213-8f88-017d934c5ac6 sending to next pipeline
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354bb16d0>
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8dcea8d5-468e-50db-9511-62d1f46aac9e/8dcea8d5-468e-50db-9511-62d1f46aac9e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe5a86c6754a5479b8e29a15c0465baff.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e5a86c6754a5479b8e29a15c0465baff.jpg saved to cache
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8dcea8d5-468e-50db-9511-62d1f46aac9e
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8dcea8d5-468e-50db-9511-62d1f46aac9e sending to next pipeline
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347765210>
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817e14b0-ab4d-5e56-9465-aa4a4777d4f4/817e14b0-ab4d-5e56-9465-aa4a4777d4f4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e48b99c05074785a468ef61b46e0440.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e48b99c05074785a468ef61b46e0440.jpg saved to cache
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 817e14b0-ab4d-5e56-9465-aa4a4777d4f4
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 817e14b0-ab4d-5e56-9465-aa4a4777d4f4 sending to next pipeline
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 96d33753-fb2c-5213-8f88-017d934c5ac6 with identifier 202603220906132
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 96d33753-fb2c-5213-8f88-017d934c5ac6
2026-03-25 16:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/402bb4f015384e62b3037793edb7e9fb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2017 Mercedes Benz C220d AMG Line boasts exceptionally '
                'low mileage for its age, having covered just 42,000 miles. '
                'This Euro 6 compliant diesel model, with a 2.1L engine, has '
                'had only two owners and comes with a clear vehicle history '
                'check. The AMG Line trim enhances its appeal, featuring a '
                'sophisticated black leather interior, high performance LED '
                'headlights, and heated front seats for added comfort. '
                'Practicality is also a strong point, with a reversing camera '
                'and front parking sensors to assist with manoeuvring.\n'
                '\n'
                'John Hammick Cars of Essex are proud to offer this Mercedes '
                'C220d coupe AMG Line . several key advantages that set it '
                'apart are Its impressive fuel economy of 61 mpg means fewer '
                'trips to the petrol station, while its low CO2 emissions '
                'contribute to a more environmentally friendly drive. The '
                'generous boot space provides ample room for luggage or '
                'shopping, making it a versatile choice for everyday use. '
                'Furthermore, its placement in a low insurance group can help '
                'to reduce ongoing ownership costs, making this Mercedes Benz '
                'a sensible and appealing option.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 168,
 'fuel_type': 'Diesel',
 'id': '96d33753-fb2c-5213-8f88-017d934c5ac6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603220906132',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'C Class',
 'odometer': 42000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d33753-fb2c-5213-8f88-017d934c5ac6/96d33753-fb2c-5213-8f88-017d934c5ac6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86145,
             'Height': 702,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/402bb4f015384e62b3037793edb7e9fb.jpg',
             'Width': 1290}],
 'price': 15990,
 'price_includes_vat': True,
 'registration_date': '2017-03-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C Class 2.1 C220d AMG Line G-Tronic+ Euro 6 (s/s) 2dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603220906132%27 HTTP/1.1" 200 None
2026-03-25 16:13:44 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603220906132: {'created_time': 1774455224.305323, 'last_price_update_time': 1774455224.305333}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603220906132') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8dcea8d5-468e-50db-9511-62d1f46aac9e with identifier 202602190067790
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8dcea8d5-468e-50db-9511-62d1f46aac9e
2026-03-25 16:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e5a86c6754a5479b8e29a15c0465baff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'White',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this Audi A4 2.0 '
                'TFSI S line S Tronic Euro 6 finished in Audi Ibis white with '
                'full black leather ! ONE OWNER FROM NEW!!Before any car '
                'leaves us, a fresh service & or MOT if due, will be conducted '
                'for the new owner. This example looks and drives as it '
                'should. Three months engine & gearbox warranty provided. '
                'Looks and drives very well and has been cherished by its '
                'previous keeper, a perfectly spec’d example. Service history '
                'is present and can be disclosed fully prior to making an '
                'appointment. Part exchange very welcome . We purchase the '
                'best examples for more! So why not try us if you have a '
                'highly spec’d car with full history! Contact our WhatsApp '
                'number directly with any questions - you will receive an '
                'instant response 07749 119841 - We pay more for your car '
                'whether you buy ours or not . Viewings are by appointment '
                'only so please do not hesitate to call with any questions or '
                'to make an appointment to view and test drive.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Petrol',
 'id': '8dcea8d5-468e-50db-9511-62d1f46aac9e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190067790',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 94000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcea8d5-468e-50db-9511-62d1f46aac9e/8dcea8d5-468e-50db-9511-62d1f46aac9e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 573958,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e5a86c6754a5479b8e29a15c0465baff.jpg',
             'Width': 2048}],
 'price': 10990,
 'price_includes_vat': True,
 'registration_date': '2017-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI S line S Tronic Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2017}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190067790%27 HTTP/1.1" 200 None
2026-03-25 16:13:44 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190067790: {'created_time': 1774455224.349655, 'last_price_update_time': 1774455224.349664}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190067790') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 817e14b0-ab4d-5e56-9465-aa4a4777d4f4 with identifier 202602059714303
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 817e14b0-ab4d-5e56-9465-aa4a4777d4f4
2026-03-25 16:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9e48b99c05074785a468ef61b46e0440.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'White',
 'currency': 'GBP',
 'description': 'John Hammick Cars are delighted to offer this This 2022 Ford '
                'Focus ST-Line Style , a superb example, having been owned by '
                'just one careful keeper. This Euro 6 compliant 1.0 litre '
                'petrol model offers a compelling blend of style and '
                'practicality. It comes equipped with the desirable Winter '
                'Pack, ensuring comfort with heated seats and a heated '
                'steering wheel, while the Parking Pack, including a rear '
                'camera and front and rear parking sensors, makes manoeuvring '
                'effortless. The Ford Key Free System allows for keyless entry '
                "and start, and you'll appreciate the full fixed LED "
                'headlights with LED daytime running lights for excellent '
                'visibility. PLEASE FEEL FREE TO CONTACT OUR DIRECT WHATSAPP '
                'NUMBER AT ANY TIME FOR AN INSTANT RESPONSE ON 07749119841.\n'
                '\n'
                'Experience impressive efficiency with a fuel economy of 52 '
                'miles per gallon, alongside low CO2 emissions, making this '
                'Focus a sensible choice. Its acceleration from 0 to 62 miles '
                'per hour in just 10.2 seconds demonstrates a responsive '
                'drive. Furthermore, the generous boot space provides ample '
                'room for all your luggage or shopping, highlighting its '
                'versatility for everyday life and longer journeys.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '817e14b0-ab4d-5e56-9465-aa4a4777d4f4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602059714303',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 33,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817e14b0-ab4d-5e56-9465-aa4a4777d4f4/817e14b0-ab4d-5e56-9465-aa4a4777d4f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 541522,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e48b99c05074785a468ef61b46e0440.jpg',
             'Width': 2048}],
 'price': 11990,
 'price_includes_vat': True,
 'registration_date': '2022-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0T EcoBoost ST-Line Style Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'ST-Line Style',
 'year': 2022}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602059714303%27 HTTP/1.1" 200 None
2026-03-25 16:13:44 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602059714303: {'created_time': 1774455224.400125, 'last_price_update_time': 1774455224.400136}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602059714303') HTTP/1.1" 204 0
2026-03-25 16:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c97ffc3ad63b4c4b981ac4deffb69a54.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b74a10>
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539/09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fb370d533174d2d87dd1884e0e2fa75.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fb370d533174d2d87dd1884e0e2fa75.jpg saved to cache
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539 sending to next pipeline
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539 with identifier 202603230926416
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539
2026-03-25 16:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4fb370d533174d2d87dd1884e0e2fa75.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex are excited to offer This 2016 '
                'Honda Civic i VTEC Type R GT!boasting a clear vehicle '
                'history, offering you peace of mind.  Powered by a 2.0L '
                'petrol engine and meeting Euro 6 emissions standards, this '
                'Type R GT model comes equipped with front and rear parking '
                'sensors for easier manoeuvring, and Bluetooth hands free '
                'telephone for convenient connectivity.  Enjoy the ease of '
                'smart keyless entry and start, and let the dusk sensing '
                'headlights take care of themselves.\n'
                '\n'
                'THIS EXAMPLE IS FINISHED IN THE BEST AND LEAST PRODUCED '
                'COLOUR! A FULL COMPREHENSIVE SERVICE HISTORY IS PRESENT AND '
                'ITS PRESENTED IN STUNNING CONDITION THROUGHOUT.  Two original '
                'keys are present. First to see this Type R will buy. Viewings '
                'are by appointment please contact our business WhatsApp with '
                'any questions on 07749 119841.\n'
                '\n'
                'Experience exhilarating performance with a rapid 0 to 62mph '
                'acceleration time of just 5.7 seconds, a figure that sets '
                'this Civic apart. This impressive speed, combined with its '
                'large boot space, demonstrates how this particular Honda '
                'Civic i VTEC Type R GT offers a superior blend of dynamic '
                'driving and everyday practicality compared to other vehicles '
                'in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 306,
 'fuel_type': 'Petrol',
 'id': '09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230926416',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 81000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 36,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539/09a1fe14-4ff4-5e6a-9a61-3abc2ea0b539_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 609856,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4fb370d533174d2d87dd1884e0e2fa75.jpg',
             'Width': 2048}],
 'price': 17440,
 'price_includes_vat': True,
 'registration_date': '2016-09-12',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Honda Civic 2.0 i-VTEC Type R GT Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Type R GT',
 'year': 2016}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230926416%27 HTTP/1.1" 200 None
2026-03-25 16:13:44 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230926416: {'created_time': 1774455224.549591, 'last_price_update_time': 1774455224.549601}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230926416') HTTP/1.1" 204 0
2026-03-25 16:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/54e978d27e0648958b6481659b328ef8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ad7c3607d57841fca2e0141a18e7e8ff.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83541bbfd0>
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258/796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ecad30cef0148f99bb15ce4bf340c30.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ecad30cef0148f99bb15ce4bf340c30.jpg saved to cache
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258 sending to next pipeline
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b1c950>
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ef65797-1cb3-50b5-99ef-8f5f8df38ee1/5ef65797-1cb3-50b5-99ef-8f5f8df38ee1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5700ed717f054727a681a4cb0eb552e5.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5700ed717f054727a681a4cb0eb552e5.jpg saved to cache
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ef65797-1cb3-50b5-99ef-8f5f8df38ee1
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ef65797-1cb3-50b5-99ef-8f5f8df38ee1 sending to next pipeline
2026-03-25 16:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/553fa28623814656982ebf6d2c6751c3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258 with identifier 202602190067700
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258
2026-03-25 16:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0ecad30cef0148f99bb15ce4bf340c30.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this Mitsubishi '
                'Outlander 2.0h 12kWh GX4hs CVT 4WD presented in absolutely '
                'immaculate condition and with a full Mitsubishi Service '
                'history from brand new! Before any car leaves us, a fresh '
                'service & or MOT if due, will be conducted for the new owner. '
                'This example looks and drives as it should. Three months '
                'engine & gearbox warranty provided. Looks and drives very '
                'well and has been cherished by its previous keeper, a '
                'perfectly spec’d example. Service history is present and can '
                'be disclosed fully prior to making an appointment. Part '
                'exchange very welcome . We purchase the best examples for '
                'more! So why not try us if you have a highly spec’d car with '
                'full history! Contact our WhatsApp number directly with any '
                'questions - you will receive an instant response 07749 119841 '
                '- We pay more for your car whether you buy ours or not . '
                'Viewings are by appointment only so please do not hesitate to '
                'call with any questions or to make an appointment to view and '
                'test drive. Discover this exceptional 2015 Mitsubishi '
                'Outlander GX4HS, boasting remarkably low mileage for its age, '
                'having covered just 40,000 miles. This well maintained '
                'example has had only two owners and comes with a clear '
                'vehicle history check, offering peace of mind. Under the '
                "bonnet, you'll find an efficient 2.0L petrol plug in hybrid "
                'engine paired with a capable four wheel drive system, making '
                'it a versatile choice for various driving conditions. Key '
                'features include keyless entry for effortless access, '
                'Bluetooth hands free telephone kit for safe communication on '
                'the go, and adaptive cruise control to ease long journeys. '
                'Enjoy enhanced visibility with xenon headlights and cosy up '
                'on colder days with heated front seats.\n'
                '\n'
                'This Mitsubishi Outlander GX4HS stands out from others thanks '
                'to its impressive combination of features and low mileage. '
                'The plug in hybrid technology offers a more economical and '
                'environmentally conscious driving experience compared to '
                'traditional petrol or diesel models. The four wheel drive '
                'system provides added confidence and stability',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '2L',
 'engine_horse_power': 198,
 'fuel_type': 'Petrol Plug-in Hybrid',
 'id': '796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190067700',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 40000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258/796b5d36-0fd9-5edb-8e4a-dcd5eb1c6258_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 576888,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0ecad30cef0148f99bb15ce4bf340c30.jpg',
             'Width': 2048}],
 'price': 10490,
 'price_includes_vat': True,
 'registration_date': '2015-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0h 12kWh GX4hs CVT 4WD Euro 5 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'GX4hs',
 'year': 2015}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190067700%27 HTTP/1.1" 200 None
2026-03-25 16:13:44 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190067700: {'created_time': 1774455224.754937, 'last_price_update_time': 1774455224.754945}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190067700') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5ef65797-1cb3-50b5-99ef-8f5f8df38ee1 with identifier 202601309557621
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5ef65797-1cb3-50b5-99ef-8f5f8df38ee1
2026-03-25 16:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5700ed717f054727a681a4cb0eb552e5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2020 MINI Clubman Cooper Sport offers a blend of style '
                'and practicality, making it an excellent choice for those '
                'seeking a distinctive driving experience. Powered by a 1.5L '
                'Petrol Engine and meeting Euro 6 emissions standards, this '
                'model is equipped with the desirable Comfort Pack, which '
                'includes rear parking assistance and heated seats for added '
                'convenience. The interior features Cross Punch Leather in '
                'Carbon Black, complementing the manual air conditioning and '
                'Bluetooth connectivity for compatible mobile phones with '
                'audio streaming.\n'
                '\n'
                'With a fuel economy highlighting 46 miles per gallon, this '
                'MINI Clubman Cooper Sport demonstrates impressive efficiency. '
                'The inclusion of Park Distance Control with rear sensors '
                'further enhances its usability, making parking manoeuvres '
                'straightforward. These features, combined with its stylish '
                'Cooper Sport trim, position this vehicle as a compelling '
                'option that stands out from other similar models on the '
                'market.',
 'doors_number': 6,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '5ef65797-1cb3-50b5-99ef-8f5f8df38ee1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601309557621',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 59000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ef65797-1cb3-50b5-99ef-8f5f8df38ee1/5ef65797-1cb3-50b5-99ef-8f5f8df38ee1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264900,
             'Height': 938,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5700ed717f054727a681a4cb0eb552e5.jpg',
             'Width': 1290}],
 'price': 12990,
 'price_includes_vat': True,
 'registration_date': '2020-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman 1.5 Cooper Sport Euro 6 (s/s) 6dr',
 'transmission': 'manual',
 'trim': 'Cooper Sport',
 'year': 2020}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309557621%27 HTTP/1.1" 200 None
2026-03-25 16:13:44 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601309557621: {'created_time': 1774455224.824903, 'last_price_update_time': 1774455224.824916}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309557621') HTTP/1.1" 204 0
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354acd6d0>
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af2d441-03bd-5067-bd7d-9b589c0aa499/3af2d441-03bd-5067-bd7d-9b589c0aa499_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc97ffc3ad63b4c4b981ac4deffb69a54.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c97ffc3ad63b4c4b981ac4deffb69a54.jpg saved to cache
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3af2d441-03bd-5067-bd7d-9b589c0aa499
2026-03-25 16:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3af2d441-03bd-5067-bd7d-9b589c0aa499 sending to next pipeline
2026-03-25 16:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0d99a5d61ba84db4bc559d0e2de19fc0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3af2d441-03bd-5067-bd7d-9b589c0aa499 with identifier 202602170003234
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3af2d441-03bd-5067-bd7d-9b589c0aa499
2026-03-25 16:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c97ffc3ad63b4c4b981ac4deffb69a54.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this LOW MILAGE '
                'VAUXHALL MOKKA AUTO WITH FULL SERVICE HISTORY - Before any '
                'car leaves us, a fresh service & or MOT if due, will be '
                'conducted for the new owner. This example looks and drives as '
                'it should. Three months engine & gearbox warranty provided. '
                'Looks and drives very well and has been cherished by its '
                'previous keeper, a perfectly spec’d example. Service history '
                'is present and can be disclosed fully prior to making an '
                'appointment. Part exchange very welcome . We purchase the '
                'best examples for more! So why not try us if you have a '
                'highly spec’d car with full history! Contact our WhatsApp '
                'number directly with any questions - you will receive an '
                'instant response 07749 119841 - We pay more for your car '
                'whether you buy ours or not . Viewings are by appointment '
                'only so please do not hesitate to call with any questions or '
                'to make an appointment to view and test drive.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '3af2d441-03bd-5067-bd7d-9b589c0aa499',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602170003234',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Vauxhall',
 'model': 'Mokka X',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af2d441-03bd-5067-bd7d-9b589c0aa499/3af2d441-03bd-5067-bd7d-9b589c0aa499_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 250721,
             'Height': 954,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c97ffc3ad63b4c4b981ac4deffb69a54.jpg',
             'Width': 1290}],
 'price': 9740,
 'price_includes_vat': True,
 'registration_date': '2019-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka X 1.4i Turbo Design Nav SUV 5dr Petrol Auto Euro 6 '
          '(140 ps)',
 'transmission': 'automatic',
 'trim': 'Design Nav',
 'year': 2019}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602170003234%27 HTTP/1.1" 200 None
2026-03-25 16:13:44 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602170003234: {'created_time': 1774455224.934472, 'last_price_update_time': 1774455224.934482}
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602170003234') HTTP/1.1" 204 0
2026-03-25 16:13:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b87e6539f47646469fd8e7419db81e48.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354acf650>
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fdcd87e-d2fa-5353-854d-134229ecc816/2fdcd87e-d2fa-5353-854d-134229ecc816_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F54e978d27e0648958b6481659b328ef8.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/54e978d27e0648958b6481659b328ef8.jpg saved to cache
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fdcd87e-d2fa-5353-854d-134229ecc816
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fdcd87e-d2fa-5353-854d-134229ecc816 sending to next pipeline
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347523b50>
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8/deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad7c3607d57841fca2e0141a18e7e8ff.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad7c3607d57841fca2e0141a18e7e8ff.jpg saved to cache
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8 sending to next pipeline
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83541d3d90>
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94fa91d-cb67-54a5-83e5-6676a6126292/a94fa91d-cb67-54a5-83e5-6676a6126292_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F553fa28623814656982ebf6d2c6751c3.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/553fa28623814656982ebf6d2c6751c3.jpg saved to cache
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a94fa91d-cb67-54a5-83e5-6676a6126292
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a94fa91d-cb67-54a5-83e5-6676a6126292 sending to next pipeline
2026-03-25 16:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f6031998651d4fbcb60143918e85524e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2fdcd87e-d2fa-5353-854d-134229ecc816 with identifier 202601239383420
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2fdcd87e-d2fa-5353-854d-134229ecc816
2026-03-25 16:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/54e978d27e0648958b6481659b328ef8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Brown',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex are proud to offer This 2016 Land '
                'Rover Discovery Sport TD4 HSE, a superb example, having had '
                'only two owners from new. This capable seven seat SUV is '
                'powered by a 2.0 litre diesel engine and features a four '
                'wheel drive drivetrain, making it ready for any adventure. '
                'The HSE trim level ensures a premium experience, complemented '
                'by desirable features such as Bluetooth telephone '
                'connectivity for seamless calls on the go, and heated front '
                'seats for comfort in all weather. Parking is made easier with '
                'front and rear parking aids, and for added practicality. A '
                'Fresh service will be carried out for the new owner. FIXED '
                'GLASS PAN ROOF, REVERSE CAMERA, MEDIA INTERFACE. CONTACT OUR '
                'DIRECT BUSINESS WHATSAPP FOR AN INSTANT RESPONSE TO ANY '
                'QUESTION ON 07749119841\n'
                '\n'
                'With an impressive fuel economy of 53 miles per gallon, this '
                'Discovery Sport offers excellent efficiency for its class, a '
                'significant advantage for your running costs. Its '
                'acceleration from 0 to 60 miles per hour in just 8.4 seconds '
                'demonstrates a strong performance, outperforming many similar '
                'vehicles. Furthermore, the generous boot space provides ample '
                'room for luggage, shopping, or sports equipment, making it a '
                'truly versatile choice. The Euro 6 emission class ensures it '
                'meets current environmental standards, and with a towing '
                'weight of 2200 kg, it is well equipped for towing caravans or '
                'trailers.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 178,
 'fuel_type': 'Diesel',
 'id': '2fdcd87e-d2fa-5353-854d-134229ecc816',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601239383420',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 89000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 43,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fdcd87e-d2fa-5353-854d-134229ecc816/2fdcd87e-d2fa-5353-854d-134229ecc816_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263682,
             'Height': 943,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/54e978d27e0648958b6481659b328ef8.jpg',
             'Width': 1242}],
 'price': 8990,
 'price_includes_vat': True,
 'registration_date': '2016-01-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 TD4 HSE Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2016}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239383420%27 HTTP/1.1" 200 None
2026-03-25 16:13:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601239383420: {'created_time': 1774455225.268913, 'last_price_update_time': 1774455225.268923}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239383420') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8 with identifier 202602129889699
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8
2026-03-25 16:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ad7c3607d57841fca2e0141a18e7e8ff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex are proud to offer this 2014 '
                'Mercedes Benz C Class C220 AMG Line. This example presents a '
                'superb ownership proposition. This Euro 6 compliant diesel '
                'model, with a clear vehicle history check, features the '
                'desirable AMG Line trim and is equipped with striking 19in '
                'AMG Multi Spoke alloy wheels painted in titanium grey. '
                'PREMIUM BURMESTER AUDIO UPGRADE .Further enhancing its appeal '
                'are the panoramic glass sunroof, offering an open and airy '
                'cabin, and the Premium Plus Package which includes convenient '
                'keyless entry and memory seats. Practicality is also '
                'considered with a manually folding tow bar and rear parking '
                'sensors for easier manoeuvring.\n'
                '\n'
                'This C220 AMG Line excels with its impressive performance and '
                'efficiency, achieving 0-62mph in just 7.4 seconds. Its fuel '
                'economy is a standout highlight, delivering an exceptional 64 '
                'mpg, which, combined with its low CO2 emissions and low '
                'insurance group, makes it a remarkably economical choice. '
                'These factors collectively indicate that this Mercedes Benz '
                'offers a superior ownership experience compared to many other '
                'vehicles in its class.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 168,
 'fuel_type': 'Diesel',
 'id': 'deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602129889699',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'C Class',
 'odometer': 71110,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8/deb6f76b-23dd-5e80-87b4-fcfb2a7b0cb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242235,
             'Height': 883,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad7c3607d57841fca2e0141a18e7e8ff.jpg',
             'Width': 1290}],
 'price': 12440,
 'price_includes_vat': True,
 'registration_date': '2014-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C Class 2.1 C220 BlueTEC AMG Line G-Tronic+ Euro 6 '
          '(s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2014}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129889699%27 HTTP/1.1" 200 None
2026-03-25 16:13:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602129889699: {'created_time': 1774455225.316866, 'last_price_update_time': 1774455225.316874}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602129889699') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a94fa91d-cb67-54a5-83e5-6676a6126292 with identifier 202603190849122
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a94fa91d-cb67-54a5-83e5-6676a6126292
2026-03-25 16:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/553fa28623814656982ebf6d2c6751c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'White',
 'currency': 'GBP',
 'description': 'This 2016 Smart forfour Prime (Premium Plus) is a standout '
                'example, having been cherished by only two owners from new.  '
                'Powered by an efficient 1.0 litre Euro 6 petrol engine, this '
                'automatic model offers a smooth driving experience.  It comes '
                'equipped with desirable features such as automatic climate '
                'control to keep you comfortable in all conditions, and rear '
                'view camera parking assistance for easier manoeuvring.  Enjoy '
                'your favourite music on the go with audio streaming via the '
                'Bluetooth module, and benefit from the convenience of '
                'automatic headlights.  The fixed panoramic roof with sun '
                'protection adds a sense of spaciousness to the cabin.\n'
                '\n'
                'This Smart forfour Prime stands out with its impressive fuel '
                'economy, achieving a remarkable 67 miles per gallon, which '
                'indicates it is more economical than many other vehicles in '
                'its class. Furthermore, its low insurance group rating '
                'suggests that running costs will be more affordable. The low '
                'CO2 emissions also highlight its environmental consideration '
                'compared to similar cars.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 70,
 'fuel_type': 'Petrol',
 'id': 'a94fa91d-cb67-54a5-83e5-6676a6126292',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190849122',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 62000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94fa91d-cb67-54a5-83e5-6676a6126292/a94fa91d-cb67-54a5-83e5-6676a6126292_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450634,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/553fa28623814656982ebf6d2c6751c3.jpg',
             'Width': 2048}],
 'price': 4990,
 'price_includes_vat': True,
 'registration_date': '2016-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Smart Forfour 1.0 Prime (Premium Plus) Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Prime',
 'year': 2016}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190849122%27 HTTP/1.1" 200 None
2026-03-25 16:13:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190849122: {'created_time': 1774455225.372796, 'last_price_update_time': 1774455225.372807}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190849122') HTTP/1.1" 204 0
2026-03-25 16:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/db0c3fef505c48999c150a0a87c1f037.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cfb788cafcd84413b5e2627baf87eeba.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9109ff369f6b47f68a27ea6e9ab4c7fa.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f6eef3a4f2c2491ea9e6d9c2b47ee343.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83476ecb50>
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_328be922-640b-56ed-8056-9f9965204b73/328be922-640b-56ed-8056-9f9965204b73_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0d99a5d61ba84db4bc559d0e2de19fc0.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0d99a5d61ba84db4bc559d0e2de19fc0.jpg saved to cache
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 328be922-640b-56ed-8056-9f9965204b73
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 328be922-640b-56ed-8056-9f9965204b73 sending to next pipeline
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83477c5a50>
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2e38601-a57e-5db2-9a2a-2185e040b8a8/b2e38601-a57e-5db2-9a2a-2185e040b8a8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb87e6539f47646469fd8e7419db81e48.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b87e6539f47646469fd8e7419db81e48.jpg saved to cache
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2e38601-a57e-5db2-9a2a-2185e040b8a8
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2e38601-a57e-5db2-9a2a-2185e040b8a8 sending to next pipeline
2026-03-25 16:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 328be922-640b-56ed-8056-9f9965204b73 with identifier 202601279459739
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 328be922-640b-56ed-8056-9f9965204b73
2026-03-25 16:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0d99a5d61ba84db4bc559d0e2de19fc0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This Mercedes Benz A Class A180 CDI SE from 2013 boasts an '
                'impressive 74 miles per gallon, making it an exceptionally '
                'economical choice. With only two previous owners and a '
                'mileage of 93,000 miles, this vehicle has been well cared '
                'for. It features a 1.5 litre diesel engine and comes with the '
                'SE trim level. Notable features include a Bluetooth interface '
                'for hands free telephone calls, air conditioning to keep you '
                'comfortable, and automatic headlamp activation for enhanced '
                'visibility.\n'
                '\n'
                'The large boot space offers practicality for all your needs, '
                'while the low CO2 emissions contribute to a more '
                'environmentally friendly drive. These highlights demonstrate '
                'how this Mercedes Benz A Class offers superior value and '
                'efficiency compared to many other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.5L',
 'engine_horse_power': 108,
 'fuel_type': 'Diesel',
 'id': '328be922-640b-56ed-8056-9f9965204b73',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601279459739',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'A Class',
 'odometer': 93000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_328be922-640b-56ed-8056-9f9965204b73/328be922-640b-56ed-8056-9f9965204b73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 635289,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0d99a5d61ba84db4bc559d0e2de19fc0.jpg',
             'Width': 2048}],
 'price': 4990,
 'price_includes_vat': True,
 'registration_date': '2013-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A Class 1.5 A180 CDI SE Euro 5 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2013}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601279459739%27 HTTP/1.1" 200 None
2026-03-25 16:13:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601279459739: {'created_time': 1774455225.574799, 'last_price_update_time': 1774455225.574807}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601279459739') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b2e38601-a57e-5db2-9a2a-2185e040b8a8 with identifier 202602129891128
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b2e38601-a57e-5db2-9a2a-2185e040b8a8
2026-03-25 16:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b87e6539f47646469fd8e7419db81e48.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2020 Vauxhall Corsa SE is a great choice for those '
                'seeking a reliable and well equipped hatchback. Powered by an '
                'efficient 1.2 litre petrol engine, this Euro 6 compliant '
                'model offers a smooth driving experience. The SE trim level '
                'comes with a host of desirable features, including a '
                'Smartphone Interface that seamlessly integrates with both '
                'Android Auto and Apple CarPlay, allowing you to access your '
                "favourite apps on the go. You'll also appreciate the "
                'convenience of Air Conditioning to keep you comfortable in '
                'all weather, and LED Headlights for improved visibility. For '
                'easier manoeuvring, a Front Camera System is included, and '
                'the Bluetooth Mobile Phone Portal lets you make calls '
                'handsfree.\n'
                '\n'
                'This Vauxhall Corsa SE stands out with its impressive fuel '
                'economy, achieving up to 53 miles per gallon, which indicates '
                'it is more economical than many similar vehicles. '
                'Furthermore, its low insurance group rating suggests that '
                'running costs will be kept to a minimum. The vehicle also '
                'boasts low CO2 emissions, highlighting its environmentally '
                'conscious design compared to other cars in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 74,
 'fuel_type': 'Petrol',
 'id': 'b2e38601-a57e-5db2-9a2a-2185e040b8a8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602129891128',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 79000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 29,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2e38601-a57e-5db2-9a2a-2185e040b8a8/b2e38601-a57e-5db2-9a2a-2185e040b8a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 603221,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b87e6539f47646469fd8e7419db81e48.jpg',
             'Width': 2048}],
 'price': 7290,
 'price_includes_vat': True,
 'registration_date': '2020-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2 SE Euro 6 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2020}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129891128%27 HTTP/1.1" 200 None
2026-03-25 16:13:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602129891128: {'created_time': 1774455225.622108, 'last_price_update_time': 1774455225.622119}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602129891128') HTTP/1.1" 204 0
2026-03-25 16:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a5ab9257480a4648b130e8a531512e3c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f835413a290>
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ea98eb5-8472-560e-95ce-1f8b53ef3883/5ea98eb5-8472-560e-95ce-1f8b53ef3883_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6031998651d4fbcb60143918e85524e.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6031998651d4fbcb60143918e85524e.jpg saved to cache
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ea98eb5-8472-560e-95ce-1f8b53ef3883
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ea98eb5-8472-560e-95ce-1f8b53ef3883 sending to next pipeline
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5ea98eb5-8472-560e-95ce-1f8b53ef3883 with identifier 202602129889374
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5ea98eb5-8472-560e-95ce-1f8b53ef3883
2026-03-25 16:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f6031998651d4fbcb60143918e85524e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'John Hammick Cars pf Essex are proud to offer  this '
                'exceptional 2017 Land Rover Range Rover Evoque TD4 SE Tech, '
                'boasting an incredibly low mileage of just 29,000 miles for '
                'its age. This four wheel drive model, powered by a 2.0L '
                'diesel engine, meets Euro 6 emission standards. It comes '
                'equipped with desirable features including automatic '
                'headlights, front and rear parking aids for effortless '
                'manoeuvring, and Bluetooth connectivity for both phone calls '
                'and audio streaming, ensuring a connected and convenient '
                'driving experience.\n'
                '\n'
                'This Range Rover Evoque stands out with its impressive fuel '
                'economy, achieving a remarkable 59 miles per gallon, which is '
                'significantly better than many other vehicles in its class. '
                'Furthermore, its low CO2 emissions contribute to a more '
                "environmentally conscious drive. You'll also appreciate the "
                'generous boot space, offering ample room for all your luggage '
                'and shopping needs, making it a practical choice for everyday '
                'life and longer journeys.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 178,
 'fuel_type': 'Diesel',
 'id': '5ea98eb5-8472-560e-95ce-1f8b53ef3883',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602129889374',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 29000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 38,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ea98eb5-8472-560e-95ce-1f8b53ef3883/5ea98eb5-8472-560e-95ce-1f8b53ef3883_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 240357,
             'Height': 930,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f6031998651d4fbcb60143918e85524e.jpg',
             'Width': 1203}],
 'price': 11440,
 'price_includes_vat': True,
 'registration_date': '2017-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.0 TD4 SE Tech 4WD Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE Tech',
 'year': 2017}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129889374%27 HTTP/1.1" 200 None
2026-03-25 16:13:45 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602129889374: {'created_time': 1774455225.716187, 'last_price_update_time': 1774455225.716194}
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602129889374') HTTP/1.1" 204 0
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b76350>
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b446c520-d04a-5dad-acae-a706b28b3ce0/b446c520-d04a-5dad-acae-a706b28b3ce0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb0c3fef505c48999c150a0a87c1f037.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db0c3fef505c48999c150a0a87c1f037.jpg saved to cache
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b446c520-d04a-5dad-acae-a706b28b3ce0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b446c520-d04a-5dad-acae-a706b28b3ce0 sending to next pipeline
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347450ed0>
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9313b08b-e01e-59ce-b6cc-0c83fcae55d1/9313b08b-e01e-59ce-b6cc-0c83fcae55d1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcfb788cafcd84413b5e2627baf87eeba.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cfb788cafcd84413b5e2627baf87eeba.jpg saved to cache
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9313b08b-e01e-59ce-b6cc-0c83fcae55d1
2026-03-25 16:13:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9313b08b-e01e-59ce-b6cc-0c83fcae55d1 sending to next pipeline
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83476efbd0>
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f024a43-07ea-5327-bd1f-1e5e96f93aed/4f024a43-07ea-5327-bd1f-1e5e96f93aed_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9109ff369f6b47f68a27ea6e9ab4c7fa.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9109ff369f6b47f68a27ea6e9ab4c7fa.jpg saved to cache
2026-03-25 16:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f024a43-07ea-5327-bd1f-1e5e96f93aed
2026-03-25 16:13:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f024a43-07ea-5327-bd1f-1e5e96f93aed sending to next pipeline
2026-03-25 16:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83477ef0d0>
2026-03-25 16:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1724-e7bd-5269-8107-0a6c90ff8998/b47c1724-e7bd-5269-8107-0a6c90ff8998_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff6eef3a4f2c2491ea9e6d9c2b47ee343.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f6eef3a4f2c2491ea9e6d9c2b47ee343.jpg saved to cache
2026-03-25 16:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b47c1724-e7bd-5269-8107-0a6c90ff8998
2026-03-25 16:13:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b47c1724-e7bd-5269-8107-0a6c90ff8998 sending to next pipeline
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Page: 3/4, total results: 63
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199265998%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199265998: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601109056363%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601109056363: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601109050752%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601109050752: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601068955573%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601068955573: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601058939429%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601058939429: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512248793545%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512248793545: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512198705115%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512198705115: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168625778%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512168625778: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512138576482%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512138576482: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512098467378%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512098467378: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028288338%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512028288338: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511218057036%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511218057036: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107797100%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511107797100: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511077736177%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511077736177: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510076949764%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510076949764: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510046893500%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510046893500: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509196479354%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509196479354: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509166382274%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509166382274: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509025962123%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509025962123: 1
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506203710190%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202506203710190: 1
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 16:13:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b446c520-d04a-5dad-acae-a706b28b3ce0 with identifier 202603170783833
2026-03-25 16:13:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b446c520-d04a-5dad-acae-a706b28b3ce0
2026-03-25 16:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/db0c3fef505c48999c150a0a87c1f037.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'Just arrived and awaiting prep',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 178,
 'fuel_type': 'Petrol',
 'id': 'b446c520-d04a-5dad-acae-a706b28b3ce0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170783833',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b446c520-d04a-5dad-acae-a706b28b3ce0/b446c520-d04a-5dad-acae-a706b28b3ce0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 527059,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/db0c3fef505c48999c150a0a87c1f037.jpg',
             'Width': 2048}],
 'price': 16440,
 'price_includes_vat': True,
 'registration_date': '2017-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI BlueMotion Tech SEL DSG 4Motion Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'SEL',
 'year': 2017}
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170783833%27 HTTP/1.1" 200 None
2026-03-25 16:13:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170783833: {'created_time': 1774455226.479451, 'last_price_update_time': 1774455226.479461}
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170783833') HTTP/1.1" 204 0
2026-03-25 16:13:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9313b08b-e01e-59ce-b6cc-0c83fcae55d1 with identifier 202601229344754
2026-03-25 16:13:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9313b08b-e01e-59ce-b6cc-0c83fcae55d1
2026-03-25 16:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cfb788cafcd84413b5e2627baf87eeba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'John Hammick Cars are excited to offer This 2018 Skoda Fabia '
                'TSI Colour Edition, an exceptional ownership proposition, '
                'boasting a remarkable fuel economy of 64 miles per gallon. '
                'This particular Fabia is a Euro 6 compliant model, powered by '
                "an efficient 1.0 litre petrol engine. Inside, you'll find a "
                'user friendly Bolero Radio complete with Bluetooth '
                'connectivity, allowing for seamless music streaming and '
                'handsfree calls. For added convenience, this Colour Edition '
                'model includes manual air conditioning to keep you '
                'comfortable in all conditions, and acoustic parking sensors '
                'at the rear to assist with parking manoeuvres. 5 SKODA '
                'SERVICES - FRESH SERVICE CONDUCTED UPON SALE FOR NEW KEEPER - '
                'RARE VIPER GREEN COLOUR - EXCELLENT LOOKING EXAMPLE!\n'
                '\n'
                'The Skoda Fabia TSI Colour Edition stands out with several '
                'key advantages that make it a smart choice. Its low CO2 '
                'emissions contribute to a lower environmental impact, and it '
                'also falls into a low insurance group, which can help to '
                "reduce your running costs. You'll appreciate the generous "
                'boot space, offering ample room for shopping or luggage. '
                'Performance is also a strong point, with a brisk 0 to 60 '
                'miles per hour acceleration time of just 10.3 seconds, '
                'demonstrating a good balance between efficiency and '
                'responsiveness.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 94,
 'fuel_type': 'Petrol',
 'id': '9313b08b-e01e-59ce-b6cc-0c83fcae55d1',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229344754',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 99000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9313b08b-e01e-59ce-b6cc-0c83fcae55d1/9313b08b-e01e-59ce-b6cc-0c83fcae55d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639773,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cfb788cafcd84413b5e2627baf87eeba.jpg',
             'Width': 2048}],
 'price': 5795,
 'price_includes_vat': True,
 'registration_date': '2018-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Fabia 1.0 TSI Colour Edition Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Colour Edition',
 'year': 2018}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229344754%27 HTTP/1.1" 200 None
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229344754: {'created_time': 1774455227.02339, 'last_price_update_time': 1774455227.023399}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229344754') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4f024a43-07ea-5327-bd1f-1e5e96f93aed with identifier 202601209292532
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4f024a43-07ea-5327-bd1f-1e5e96f93aed
2026-03-25 16:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9109ff369f6b47f68a27ea6e9ab4c7fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2017 Land Rover Range Rover Evoque eD4 SE offers an '
                'exceptional blend of style and efficiency, boasting a '
                'remarkable 66 miles per gallon. This Euro 6 compliant 2.0L '
                'diesel engine ensures a refined driving experience, while the '
                'SE trim level provides a host of desirable features. Inside, '
                "you'll appreciate the automatic climate control with air "
                'filtration and recirculation, keeping the cabin comfortable '
                'in all conditions. Stay connected on the go with Bluetooth '
                'telephone connectivity and streamed audio. For added '
                'convenience, this Evoque is equipped with front and rear '
                'parking aid, making manoeuvring in tight spaces effortless, '
                'and heated front seats for those colder journeys. CONTACT OUR '
                'BUSINESS WHATAPP NOW ON 07749119841 FOR AN IMMEDIATE RESPONSE '
                'TO ANY QUESTIONS OR TO ARRANGE A VIEWING, REQUEST A LIVE '
                'VIDEO CALL OR TO RESERVE THE VEHICLE! COMES WITH A FRESH '
                'SERVICE FOR THE NEW OWNER ANA A MINIMUM OF THREE MONTHS '
                'WARRANTY! JOHN HAMMICK CARS ESSEX ARE A FAMILY RUN BUSINESS '
                'WITH 5 STAR RATING ON BOTH AUTOTRADER AND GOOGLE.\n'
                '\n'
                'Beyond its impressive features, this Range Rover Evoque '
                'stands out with its low CO2 emissions, indicating a more '
                'environmentally conscious choice. The generous boot space '
                'provides ample room for luggage, shopping, or equipment, '
                'making it a practical companion for everyday life and longer '
                'trips. These highlights demonstrate how this particular '
                'Evoque offers a superior ownership proposition compared to '
                'other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': '4f024a43-07ea-5327-bd1f-1e5e96f93aed',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601209292532',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 75000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 36,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f024a43-07ea-5327-bd1f-1e5e96f93aed/4f024a43-07ea-5327-bd1f-1e5e96f93aed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285057,
             'Height': 913,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9109ff369f6b47f68a27ea6e9ab4c7fa.jpg',
             'Width': 1290}],
 'price': 8240,
 'price_includes_vat': True,
 'registration_date': '2017-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.0 eD4 SE FWD Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2017}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601209292532%27 HTTP/1.1" 200 None
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601209292532: {'created_time': 1774455227.073449, 'last_price_update_time': 1774455227.073463}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601209292532') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b47c1724-e7bd-5269-8107-0a6c90ff8998 with identifier 202603140709218
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b47c1724-e7bd-5269-8107-0a6c90ff8998
2026-03-25 16:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f6eef3a4f2c2491ea9e6d9c2b47ee343.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2019 Audi A3 TDI S line offers a compelling blend of '
                'style and efficiency, boasting a 1.6 litre Euro 6 diesel '
                'engine.  This particular model comes with the sought after S '
                "line trim, enhancing its sporty appeal.  Inside, you'll find "
                'a host of convenient features designed to make every journey '
                'more enjoyable, including a Bluetooth interface for seamless '
                'phone connectivity, rear parking sensors to aid with '
                'manoeuvring, and an auto dimming rear view mirror that '
                'automatically adjusts to light conditions.  The dual zone '
                'electronic climate control ensures comfort for all occupants, '
                'while the LED headlights with dynamic rear indicators provide '
                'excellent visibility and a modern aesthetic.\n'
                '\n'
                'The Audi A3 TDI S line stands out with its practical '
                'advantages, including a generous boot space that easily '
                'accommodates luggage or shopping. Furthermore, its placement '
                'in a low insurance group makes it an economical choice for '
                'many drivers. These aspects, combined with its Euro 6 '
                'compliant engine and advanced lighting technology, '
                'demonstrate how this A3 offers a superior ownership '
                'experience compared to other vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 114,
 'fuel_type': 'Diesel',
 'id': 'b47c1724-e7bd-5269-8107-0a6c90ff8998',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603140709218',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 80000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1724-e7bd-5269-8107-0a6c90ff8998/b47c1724-e7bd-5269-8107-0a6c90ff8998_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103743,
             'Height': 611,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f6eef3a4f2c2491ea9e6d9c2b47ee343.jpg',
             'Width': 1290}],
 'price': 10990,
 'price_includes_vat': True,
 'registration_date': '2019-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI 30 S line Sportback Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'S line',
 'year': 2019}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140709218%27 HTTP/1.1" 200 None
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603140709218: {'created_time': 1774455227.124811, 'last_price_update_time': 1774455227.12482}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603140709218') HTTP/1.1" 204 0
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 16:13:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Getting next page: 4
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10035609, page: 4
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83541f1dd0>
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c738788b-8ed9-58f9-a636-d946e29e3007/c738788b-8ed9-58f9-a636-d946e29e3007_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa5ab9257480a4648b130e8a531512e3c.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a5ab9257480a4648b130e8a531512e3c.jpg saved to cache
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c738788b-8ed9-58f9-a636-d946e29e3007
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c738788b-8ed9-58f9-a636-d946e29e3007 sending to next pipeline
2026-03-25 16:13:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4fad6b18d899482a8b1b55f17ec2a80e.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c738788b-8ed9-58f9-a636-d946e29e3007 with identifier 202602079761121
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c738788b-8ed9-58f9-a636-d946e29e3007
2026-03-25 16:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a5ab9257480a4648b130e8a531512e3c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex are proud to offer This Volvo V70 '
                'D5 SE Lux is a 2010 model that boasts a 2.4L Diesel Engine, '
                'providing a reliable and efficient driving experience. With '
                'only two previous owners and 14 SERVICES CARRIED OUT BY THE '
                'SAME GARAGE!! this vehicle has had a life of luxury, with a '
                'low mileage of 96,000 miles for its age. The SE Lux trim '
                'level ensures a high level of comfort and refinement, while '
                'the inclusion of Rear Park Assist and Parking Assistance - '
                'Rear Sensor makes navigating tight spaces a breeze. This '
                'combination of features and low mileage makes for a '
                'worry-free ownership experience.\n'
                '\n'
                'One of the standout features of this V70 is its spacious '
                'boot, perfect for families or those who need to transport '
                'bulky items. The SE Lux trim also adds a touch of '
                'sophistication to the interior, making it a great choice for '
                'those who value comfort and style. With its low mileage and '
                'two previous owners, this vehicle is a great option for those '
                'looking for a reliable and hassle-free driving experience. '
                'The Volvo V70 D5 SE Lux is a solid choice for anyone seeking '
                "a dependable and feature-packed vehicle that won't break the "
                'bank.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '2.4L',
 'engine_horse_power': 202,
 'fuel_type': 'Diesel',
 'id': 'c738788b-8ed9-58f9-a636-d946e29e3007',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602079761121',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 96000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c738788b-8ed9-58f9-a636-d946e29e3007/c738788b-8ed9-58f9-a636-d946e29e3007_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 212862,
             'Height': 888,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a5ab9257480a4648b130e8a531512e3c.jpg',
             'Width': 1199}],
 'price': 7990,
 'price_includes_vat': True,
 'registration_date': '2010-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V70 2.4 D5 SE Lux Geartronic Euro 5 5dr',
 'transmission': 'automatic',
 'trim': 'SE Lux',
 'year': 2010}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079761121%27 HTTP/1.1" 200 None
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602079761121: {'created_time': 1774455227.240398, 'last_price_update_time': 1774455227.240407}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079761121') HTTP/1.1" 204 0
2026-03-25 16:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/692e1ef952744f5a968b9b1fd8d71a89.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0a4a66a709764870b9e4ddfb2dd97f87.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b3a5fcb75ded4d3e8273945d11337f75.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/348262735f184a258c0284b594e951b4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/62c15149d85e42dcb15ce46cf49308a4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354c4e990>
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c82cd00-c477-5463-a80b-96f95eee55c0/3c82cd00-c477-5463-a80b-96f95eee55c0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fad6b18d899482a8b1b55f17ec2a80e.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fad6b18d899482a8b1b55f17ec2a80e.jpg saved to cache
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c82cd00-c477-5463-a80b-96f95eee55c0
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c82cd00-c477-5463-a80b-96f95eee55c0 sending to next pipeline
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3c82cd00-c477-5463-a80b-96f95eee55c0 with identifier 202601229338638
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3c82cd00-c477-5463-a80b-96f95eee55c0
2026-03-25 16:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4fad6b18d899482a8b1b55f17ec2a80e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'JUST ARRIVED - HUGE SPEC EXAMPLE - This 2015 BMW 4 Series '
                'Gran Coupe 430d M Sport is a Euro 6 compliant vehicle, '
                'offering a blend of performance and practicality. It features '
                'a powerful 3.0L diesel engine and is presented in the '
                'desirable M Sport trim. Notable features include 19in M Star '
                'Spoke Alloy Wheels (403M), the M Sport Plus Package, and '
                'front Park Distance Control with front parking assistance. '
                'For driver comfort, it boasts electric front seat adjustment '
                'with driver memory and automatic two zone climate control.\n'
                '\n'
                'The 430d M Sport variant excels with its impressive '
                'acceleration, achieving 0-62mph in just 5.6 seconds, '
                'demonstrating its dynamic capabilities. This performance, '
                'combined with its large boot space, makes it a versatile '
                'choice for various needs. The inclusion of the M Sport Plus '
                'Package and other premium features further enhances its '
                'appeal, indicating a superior driving experience compared to '
                'other vehicles in its class.o',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 254,
 'fuel_type': 'Diesel',
 'id': '3c82cd00-c477-5463-a80b-96f95eee55c0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601229338638',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'BMW',
 'model': '4 Series Gran Coupe',
 'odometer': 118000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c82cd00-c477-5463-a80b-96f95eee55c0/3c82cd00-c477-5463-a80b-96f95eee55c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 647007,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4fad6b18d899482a8b1b55f17ec2a80e.jpg',
             'Width': 2048}],
 'price': 10740,
 'price_includes_vat': True,
 'registration_date': '2015-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4 Series Gran Coupe 3.0 430d M Sport Auto Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2015}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601229338638%27 HTTP/1.1" 200 None
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601229338638: {'created_time': 1774455227.430756, 'last_price_update_time': 1774455227.430783}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601229338638') HTTP/1.1" 204 0
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354c88d50>
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b1bf6e9-e497-5351-8cb6-18ce290c3de4/2b1bf6e9-e497-5351-8cb6-18ce290c3de4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F692e1ef952744f5a968b9b1fd8d71a89.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/692e1ef952744f5a968b9b1fd8d71a89.jpg saved to cache
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b1bf6e9-e497-5351-8cb6-18ce290c3de4
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b1bf6e9-e497-5351-8cb6-18ce290c3de4 sending to next pipeline
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b5f7d0>
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df6c01d2-2a1a-5072-a15d-5477f6e00b7f/df6c01d2-2a1a-5072-a15d-5477f6e00b7f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a4a66a709764870b9e4ddfb2dd97f87.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a4a66a709764870b9e4ddfb2dd97f87.jpg saved to cache
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df6c01d2-2a1a-5072-a15d-5477f6e00b7f
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df6c01d2-2a1a-5072-a15d-5477f6e00b7f sending to next pipeline
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f834748dbd0>
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55260cbc-6fa9-51f3-a81f-4f31067ab652/55260cbc-6fa9-51f3-a81f-4f31067ab652_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb3a5fcb75ded4d3e8273945d11337f75.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b3a5fcb75ded4d3e8273945d11337f75.jpg saved to cache
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55260cbc-6fa9-51f3-a81f-4f31067ab652
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55260cbc-6fa9-51f3-a81f-4f31067ab652 sending to next pipeline
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347764610>
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cd2e430-4a1b-533f-8446-0254e80a1f86/3cd2e430-4a1b-533f-8446-0254e80a1f86_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F348262735f184a258c0284b594e951b4.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/348262735f184a258c0284b594e951b4.jpg saved to cache
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cd2e430-4a1b-533f-8446-0254e80a1f86
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cd2e430-4a1b-533f-8446-0254e80a1f86 sending to next pipeline
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83540ffad0>
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28883597-60c8-5810-9cf2-bc90f477c800/28883597-60c8-5810-9cf2-bc90f477c800_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62c15149d85e42dcb15ce46cf49308a4.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62c15149d85e42dcb15ce46cf49308a4.jpg saved to cache
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28883597-60c8-5810-9cf2-bc90f477c800
2026-03-25 16:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28883597-60c8-5810-9cf2-bc90f477c800 sending to next pipeline
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2b1bf6e9-e497-5351-8cb6-18ce290c3de4 with identifier 202603140709294
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2b1bf6e9-e497-5351-8cb6-18ce290c3de4
2026-03-25 16:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/692e1ef952744f5a968b9b1fd8d71a89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'PART EXCHANGE TO CLEAR - TREMENDOUS VALUE 2.2 EVOQUE WITH '
                'FILL LEATHER AND MERIDIAN HIFI - This 2014 Land Rover Range '
                'Rover Evoque SD4 Pure Tech boasts a clear vehicle history, '
                'offering you peace of mind. This stylish four wheel drive '
                'model features a robust 2.2 litre diesel engine and comes '
                'equipped with automatic climate control with air filtration, '
                'heated front seats for those colder mornings, and rear '
                'parking aid with sensors to assist with manoeuvring. Enjoy '
                'your favourite music and stay connected on the go with '
                'Bluetooth audio streaming and telephone connectivity.\n'
                '\n'
                'The Evoque Pure Tech trim level provides a comfortable and '
                'convenient driving experience. Its generous boot space '
                'ensures you have ample room for luggage, shopping, or sports '
                'equipment, making it a practical choice for various needs. '
                'The inclusion of these thoughtful features, such as the '
                'climate control and heated seats, demonstrates a higher level '
                'of comfort and convenience compared to many other vehicles in '
                'its class.l',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '2.2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': '2b1bf6e9-e497-5351-8cb6-18ce290c3de4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603140709294',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 138000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 25,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b1bf6e9-e497-5351-8cb6-18ce290c3de4/2b1bf6e9-e497-5351-8cb6-18ce290c3de4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 720104,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/692e1ef952744f5a968b9b1fd8d71a89.jpg',
             'Width': 2048}],
 'price': 4990,
 'price_includes_vat': True,
 'registration_date': '2014-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.2 SD4 Pure Tech 4WD Euro 5 (s/s) '
          '5dr',
 'transmission': 'manual',
 'trim': 'Pure Tech',
 'year': 2014}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140709294%27 HTTP/1.1" 200 None
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603140709294: {'created_time': 1774455227.919859, 'last_price_update_time': 1774455227.919866}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603140709294') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: df6c01d2-2a1a-5072-a15d-5477f6e00b7f with identifier 202603190849015
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item df6c01d2-2a1a-5072-a15d-5477f6e00b7f
2026-03-25 16:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0a4a66a709764870b9e4ddfb2dd97f87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'White',
 'currency': 'GBP',
 'description': 'JUST ARRIVED AND AWAITING RETAIL PREP  absolutely stunning '
                'one owner car from new with full Jaguar history and a Pan '
                'roof!!\n'
                'John Hammick Cars of Essex are delighted to offer This 2018 '
                'Jaguar F-PACE D240 R-Sport which presents an exceptional '
                'ownership proposition, having been meticulously maintained by '
                'a single owner with a full dealership service history and a '
                'clear vehicle history check. This Euro 6 compliant, four '
                'wheel drive model boasts a powerful 2.0 litre diesel engine, '
                'capable of reaching 0-60mph in just 6.8 seconds. Its R-Sport '
                'trim level is enhanced by striking 20 inch alloy wheels with '
                'a gloss black finish, a fixed panoramic roof offering an open '
                'and airy cabin, and a convenient rear view camera alongside a '
                'comprehensive surround camera system for effortless parking '
                'assistance.\n'
                '\n'
                'The F-PACE D240 R-Sport offers a refined driving experience, '
                'further elevated by the Touch Pro Navigation Pack featuring a '
                'premium 380w Meridian Digital Sound System. With a '
                'substantial towing weight of 2400 kg and generous boot space, '
                'this vehicle is as practical as it is stylish. The low '
                'mileage of 72,000 miles for its age, combined with these '
                'desirable features and its single owner provenance, clearly '
                'sets this Jaguar F-PACE apart from other vehicles in its '
                'class.o',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 237,
 'fuel_type': 'Diesel',
 'id': 'df6c01d2-2a1a-5072-a15d-5477f6e00b7f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190849015',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Jaguar',
 'model': 'F-PACE',
 'odometer': 72000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df6c01d2-2a1a-5072-a15d-5477f6e00b7f/df6c01d2-2a1a-5072-a15d-5477f6e00b7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 605465,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a4a66a709764870b9e4ddfb2dd97f87.jpg',
             'Width': 2048}],
 'price': 14990,
 'price_includes_vat': True,
 'registration_date': '2018-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 2.0 D240 R-Sport Auto AWD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2018}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190849015%27 HTTP/1.1" 200 None
2026-03-25 16:13:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190849015: {'created_time': 1774455227.965499, 'last_price_update_time': 1774455227.965506}
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190849015') HTTP/1.1" 204 0
2026-03-25 16:13:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 55260cbc-6fa9-51f3-a81f-4f31067ab652 with identifier 202602129890456
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 55260cbc-6fa9-51f3-a81f-4f31067ab652
2026-03-25 16:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b3a5fcb75ded4d3e8273945d11337f75.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'John Hammick Cars welcome This 2017 Land Rover Range Rover '
                'Evoque TD4 HSE Dynamic.A compelling blend of style and '
                'capability. As a Euro 6 compliant model, it showcases a 2.0L '
                'Diesel engine paired with a Four Wheel Drive system, ensuring '
                'confident performance in various conditions. The HSE Dynamic '
                'trim level provides a refined interior experience, enhanced '
                'by features such as automatic climate control with air '
                'filtration and air quality sensing, ensuring a pleasant cabin '
                'environment. For added convenience, it includes front and '
                'rear parking aid with parking assistance sensors, and '
                'Bluetooth connectivity for seamless phone integration. The '
                'driver will appreciate the memory function for the seats, '
                'allowing for personalised comfort on every journey.\n'
                '\n'
                'FULL BLACK PACK - LARGE MY18 MEDIA SCREEN - CAMERA - '
                'CONTRASTING ROOF IN GREY - A STUNNING EXAMPLE FIRST TO SEE '
                'WILL BUY!\n'
                '\n'
                'John Hammick Cars of Essex are delighted to offer This Range '
                'Rover Evoque 2.0 Dynamic Auto with Full Black pack and '
                'contrasting grey roof, an expensive optional extra. This '
                'example stands out with its impressive fuel economy, '
                'achieving a highlight of 55 mpg, which is excellent for its '
                'class. Its low CO2 emissions also contribute to a more '
                'environmentally conscious drive. The acceleration from '
                '0-60mph in just 8.5 seconds demonstrates its responsive '
                'power. Furthermore, the generous boot space offers ample room '
                'for luggage or shopping, making it a practical choice for '
                'everyday use and longer trips. These highlights collectively '
                'indicate that this Evoque offers a superior driving '
                'experience compared to many other vehicles in its segment.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 178,
 'fuel_type': 'Diesel',
 'id': '55260cbc-6fa9-51f3-a81f-4f31067ab652',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602129890456',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 91000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55260cbc-6fa9-51f3-a81f-4f31067ab652/55260cbc-6fa9-51f3-a81f-4f31067ab652_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 727938,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b3a5fcb75ded4d3e8273945d11337f75.jpg',
             'Width': 2048}],
 'price': 9990,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.0 TD4 HSE Dynamic SUV 5dr Diesel '
          'Auto 4WD Euro 6 (s/s) (180 ps)',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2017}
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602129890456%27 HTTP/1.1" 200 None
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602129890456: {'created_time': 1774455228.021986, 'last_price_update_time': 1774455228.021994}
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602129890456') HTTP/1.1" 204 0
2026-03-25 16:13:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3cd2e430-4a1b-533f-8446-0254e80a1f86 with identifier 202603170784094
2026-03-25 16:13:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3cd2e430-4a1b-533f-8446-0254e80a1f86
2026-03-25 16:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/348262735f184a258c0284b594e951b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'White',
 'currency': 'GBP',
 'description': 'DUE THIS WEEK - STUNNING EXAMPLE - This 2014 Alfa Romeo '
                'Giulietta JTDM-2 Sportiva Nav presents a compelling '
                'proposition with its remarkably low mileage for its age, '
                'having covered just 82,000 miles. This particular model, the '
                'Sportiva Nav variant, is equipped with a responsive 2.0 litre '
                'diesel engine, offering a blend of efficiency and '
                'performance. Comfort is well catered for with dual zone '
                'climate control, ensuring a pleasant cabin temperature for '
                'both driver and passengers. For seamless connectivity and '
                'entertainment, it features Bluetooth audio streaming and '
                'handsfree capabilities. Parking is made simpler thanks to '
                'front and rear parking sensors, providing added confidence '
                'when manoeuvring.\n'
                '\n'
                'The Giulietta Sportiva Nav excels in practicality and driving '
                'dynamics. Its acceleration from 0 to 62 miles per hour in '
                'just 8.8 seconds demonstrates its spirited performance, a '
                'notable advantage over many comparable vehicles. Furthermore, '
                'the generous boot space ensures that you have ample room for '
                'luggage, shopping, or any other essentials, making it a '
                'versatile choice for everyday use and longer journeys. This '
                'combination of performance, technology, and practicality '
                'makes this Alfa Romeo Giulietta a stand out option.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '2L',
 'engine_horse_power': 150,
 'fuel_type': 'Diesel',
 'id': '3cd2e430-4a1b-533f-8446-0254e80a1f86',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170784094',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 82000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cd2e430-4a1b-533f-8446-0254e80a1f86/3cd2e430-4a1b-533f-8446-0254e80a1f86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731935,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/348262735f184a258c0284b594e951b4.jpg',
             'Width': 2048}],
 'price': 4990,
 'price_includes_vat': True,
 'registration_date': '2014-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM-2 Sportiva Nav Euro 5 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Sportiva Nav',
 'year': 2014}
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170784094%27 HTTP/1.1" 200 None
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170784094: {'created_time': 1774455228.066269, 'last_price_update_time': 1774455228.066278}
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170784094') HTTP/1.1" 204 0
2026-03-25 16:13:48 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 28883597-60c8-5810-9cf2-bc90f477c800 with identifier 202601239369656
2026-03-25 16:13:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:48 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:48 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 28883597-60c8-5810-9cf2-bc90f477c800
2026-03-25 16:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/62c15149d85e42dcb15ce46cf49308a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Ongar are proud to offer This 2016 Land '
                'Rover Range Rover Evoque eD4 SE Tech, an exceptional blend of '
                'style and efficiency, boasting a remarkable 66 mpg fuel '
                'economy. As a Euro 6 compliant vehicle, it features a 2.0L '
                'diesel engine and is presented in the desirable SE Tech trim. '
                'This particular Evoque comes equipped with automatic '
                'headlights, front parking aid for easier manoeuvring, and '
                'sophisticated Xenon headlamps with a distinctive LED '
                'signature. Inside, you will find automatic climate control '
                'with air filtration and air quality sensing, ensuring a '
                'comfortable cabin environment, alongside Bluetooth audio '
                'streaming for seamless connectivity. CONTACT OUR BUSINESS '
                'WHATAPP NOW ON 07749119841 FOR AN IMMEDIATE RESPONSE TO ANY '
                'QUESTIONS OR TO ARRANGE A VIEWING, REQUEST A LIVE VIDEO CALL '
                'OR TO RESERVE THE VEHICLE! COMES WITH A FRESH SERVICE FOR THE '
                'NEW OWNER ANA A MINIMUM OF THREE MONTHS WARRANTY! JOHN '
                'HAMMICK CARS ESSEX ARE A FAMILY RUN BUSINESS WITH 5 STAR '
                'RATING ON BOTH AUTOTRADER AND GOOGLE.\n'
                '\n'
                'The large boot space offers practicality for all your needs, '
                'while the low CO2 emissions highlight its environmental '
                'consideration. These features collectively demonstrate how '
                'this Range Rover Evoque eD4 SE Tech offers a superior '
                'ownership experience compared to other vehicles in its class, '
                'combining advanced technology with impressive running costs '
                'and ample room for passengers and luggage.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 148,
 'fuel_type': 'Diesel',
 'id': '28883597-60c8-5810-9cf2-bc90f477c800',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601239369656',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 85000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28883597-60c8-5810-9cf2-bc90f477c800/28883597-60c8-5810-9cf2-bc90f477c800_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 715373,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/62c15149d85e42dcb15ce46cf49308a4.jpg',
             'Width': 2048}],
 'price': 7440,
 'price_includes_vat': True,
 'registration_date': '2016-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.0 eD4 SE Tech FWD Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE Tech',
 'year': 2016}
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239369656%27 HTTP/1.1" 200 None
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601239369656: {'created_time': 1774455228.112284, 'last_price_update_time': 1774455228.112293}
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239369656') HTTP/1.1" 204 0
2026-03-25 16:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] INFO: Page: 4/4, total results: 63
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505272848512%27 HTTP/1.1" 200 None
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202505272848512: 1
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505152450104%27 HTTP/1.1" 200 None
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202505152450104: 1
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202406241081196%27 HTTP/1.1" 200 None
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202406241081196: 1
2026-03-25 16:13:48 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 3 detail requests (batch 1)
2026-03-25 16:13:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 16:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:13:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bfaeed61-9b81-5143-9e6f-ee7935960a3e with identifier: 202505272848512
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bfaeed61-9b81-5143-9e6f-ee7935960a3e
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3d7935ca56984876b0424a94590102f7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3d7935ca56984876b0424a94590102f7.jpg not downloaded yet
2026-03-25 16:13:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e134457-f57a-5b4c-b9f1-be9152efbf88 with identifier: 202505152450104
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e134457-f57a-5b4c-b9f1-be9152efbf88
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9a62c3a04f844599c74da7c0d7e51ad.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9a62c3a04f844599c74da7c0d7e51ad.jpg not downloaded yet
2026-03-25 16:13:50 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:13:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b4df6073-bbb3-54c2-ab57-c186874c5390 with identifier: 202406241081196
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4df6073-bbb3-54c2-ab57-c186874c5390
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff25080a01cc4ceb9c50c966c9f3b771.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff25080a01cc4ceb9c50c966c9f3b771.jpg not downloaded yet
2026-03-25 16:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3d7935ca56984876b0424a94590102f7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c9a62c3a04f844599c74da7c0d7e51ad.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ff25080a01cc4ceb9c50c966c9f3b771.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347722990>
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfaeed61-9b81-5143-9e6f-ee7935960a3e/bfaeed61-9b81-5143-9e6f-ee7935960a3e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3d7935ca56984876b0424a94590102f7.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3d7935ca56984876b0424a94590102f7.jpg saved to cache
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfaeed61-9b81-5143-9e6f-ee7935960a3e
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfaeed61-9b81-5143-9e6f-ee7935960a3e sending to next pipeline
2026-03-25 16:13:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bfaeed61-9b81-5143-9e6f-ee7935960a3e with identifier 202505272848512
2026-03-25 16:13:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bfaeed61-9b81-5143-9e6f-ee7935960a3e
2026-03-25 16:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3d7935ca56984876b0424a94590102f7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this perfectly '
                'presented and fully serviced Toyota Verso Tremd. NEW TURBO '
                '£1400 - FULL SERVICE HISTORY - BRAND NEW MOT - Before any car '
                'leaves us, a fresh service & or MOT if due, will be conducted '
                'for the new owner. This example looks and drives as it '
                'should. Three months engine & gearbox warranty provided. '
                'Looks and drives very well and has been cherished by its '
                'previous keeper, a perfectly spec’d example. Service history '
                'is present and can be disclosed fully prior to making an '
                'appointment. Part exchange very welcome . We purchase the '
                'best examples for more! So why not try us if you have a '
                'highly spec’d car with full history! Contact our WhatsApp '
                'number directly with any questions - you will receive an '
                'instant response 07749 119841 - We pay more for your car '
                'whether you buy ours or not . Viewings are by appointment '
                'only so please do not hesitate to call with any questions or '
                'to make an appointment to view and test drive.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'fuel_type': 'Diesel',
 'id': 'bfaeed61-9b81-5143-9e6f-ee7935960a3e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202505272848512',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 100000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bfaeed61-9b81-5143-9e6f-ee7935960a3e/bfaeed61-9b81-5143-9e6f-ee7935960a3e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 561037,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3d7935ca56984876b0424a94590102f7.jpg',
             'Width': 2048}],
 'price': 5490,
 'price_includes_vat': True,
 'registration_date': '2015-11-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Toyota Verso 1.6 D-4D Trend Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505272848512%27 HTTP/1.1" 200 None
2026-03-25 16:13:50 [auto_selling_autotrader.co.uk] INFO: Saving data for 202505272848512: {'created_time': 1774455230.84295, 'last_price_update_time': 1774455230.842963}
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202505272848512') HTTP/1.1" 204 0
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354c4c650>
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e134457-f57a-5b4c-b9f1-be9152efbf88/2e134457-f57a-5b4c-b9f1-be9152efbf88_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc9a62c3a04f844599c74da7c0d7e51ad.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c9a62c3a04f844599c74da7c0d7e51ad.jpg saved to cache
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e134457-f57a-5b4c-b9f1-be9152efbf88
2026-03-25 16:13:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e134457-f57a-5b4c-b9f1-be9152efbf88 sending to next pipeline
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354adf250>
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4df6073-bbb3-54c2-ab57-c186874c5390/b4df6073-bbb3-54c2-ab57-c186874c5390_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff25080a01cc4ceb9c50c966c9f3b771.jpg') HTTP/1.1" 204 0
2026-03-25 16:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff25080a01cc4ceb9c50c966c9f3b771.jpg saved to cache
2026-03-25 16:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4df6073-bbb3-54c2-ab57-c186874c5390
2026-03-25 16:13:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4df6073-bbb3-54c2-ab57-c186874c5390 sending to next pipeline
2026-03-25 16:13:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2e134457-f57a-5b4c-b9f1-be9152efbf88 with identifier 202505152450104
2026-03-25 16:13:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2e134457-f57a-5b4c-b9f1-be9152efbf88
2026-03-25 16:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c9a62c3a04f844599c74da7c0d7e51ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this ULTRA LOW '
                'MILAGE Volkswagen Golf 1.4 TSI BlueMotion Tech Match Edition '
                'DSG Euro 6 (s/s) 5dr - FULL VW SERVICE HISTORY - MATCHING '
                'GOODYEAR TYRES - FULL AUTOMATIC DSG GEARBOX - JUST 14010 '
                'MILES FROM NEW Before any car leaves us, a fresh service & or '
                'MOT if due, will be conducted for the new owner. This example '
                'looks and drives as it should. Three months engine & gearbox '
                'warranty provided. Looks and drives very well and has been '
                'cherished by its previous keeper, a perfectly spec’d example. '
                'Service history is present and can be disclosed fully prior '
                'to making an appointment. Part exchange very welcome . We '
                'purchase the best examples for more! So why not try us if you '
                'have a highly spec’d car with full history! Contact our '
                'WhatsApp number directly with any questions - you will '
                'receive an instant response 07749 119841 - We pay more for '
                'your car whether you buy ours or not . Viewings are by '
                'appointment only so please do not hesitate to call with any '
                'questions or to make an appointment to view and test drive.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '2e134457-f57a-5b4c-b9f1-be9152efbf88',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202505152450104',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 14000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e134457-f57a-5b4c-b9f1-be9152efbf88/2e134457-f57a-5b4c-b9f1-be9152efbf88_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 568304,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c9a62c3a04f844599c74da7c0d7e51ad.jpg',
             'Width': 2048}],
 'price': 13440,
 'price_includes_vat': True,
 'registration_date': '2016-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf 1.4 TSI BlueMotion Tech Match Edition DSG Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Match Edition',
 'year': 2016}
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505152450104%27 HTTP/1.1" 200 None
2026-03-25 16:13:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202505152450104: {'created_time': 1774455231.084608, 'last_price_update_time': 1774455231.084617}
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202505152450104') HTTP/1.1" 204 0
2026-03-25 16:13:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b4df6073-bbb3-54c2-ab57-c186874c5390 with identifier 202406241081196
2026-03-25 16:13:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:13:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b4df6073-bbb3-54c2-ab57-c186874c5390
2026-03-25 16:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ff25080a01cc4ceb9c50c966c9f3b771.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'color': 'White',
 'currency': 'GBP',
 'description': 'John Hammick Cars of Essex are delighted to offer for sale '
                'this absolutely stunning Range Rover HSE with just the 37,000 '
                'miles from new! Finished in Fugi white with the all important '
                'black pack this example is a real eyeful. TIMING BELT JUST '
                'DONE!! NEW DISCS AND PADS ALL AROUND - £1500 service bill '
                'THIS YEAR - CHERISHED EXAMPLE . 22’ OVERFINCH WHEELS - '
                'OVERFINCH CARBON TRIM - FULL BLACK NAPPA LEATHER INTERIOR - 4 '
                'LANDROVER SERVICES - ABSOLUTELY STUNNING LOW MILAGE '
                'EXAMPLE-For further information or to arrange a live video '
                'walk around if any of our cars please message our dedicated '
                'WhatsApp number on 07749 119841',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '3L',
 'engine_horse_power': 288,
 'fuel_type': 'Diesel',
 'id': 'b4df6073-bbb3-54c2-ab57-c186874c5390',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202406241081196',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 41000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4df6073-bbb3-54c2-ab57-c186874c5390/b4df6073-bbb3-54c2-ab57-c186874c5390_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 531653,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ff25080a01cc4ceb9c50c966c9f3b771.jpg',
             'Width': 2048}],
 'price': 17440,
 'price_includes_vat': True,
 'registration_date': '2013-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE Auto 4WD Euro 5 (s/s) '
          '5dr',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2013}
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202406241081196%27 HTTP/1.1" 200 None
2026-03-25 16:13:51 [auto_selling_autotrader.co.uk] INFO: Saving data for 202406241081196: {'created_time': 1774455231.129043, 'last_price_update_time': 1774455231.129052}
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202406241081196') HTTP/1.1" 204 0
2026-03-25 16:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 968be23e-f106-5705-9748-11d7e4c4b98f with identifier: 202601199265998
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 968be23e-f106-5705-9748-11d7e4c4b98f
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69f6e2c2399b44b193e8108d057dc422.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69f6e2c2399b44b193e8108d057dc422.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c2a86fc-65b5-5451-af75-2b9601b7600c with identifier: 202601109056363
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6c2a86fc-65b5-5451-af75-2b9601b7600c
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F670bf3c048044808b48e7cfb536260a4.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/670bf3c048044808b48e7cfb536260a4.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 710cbb1d-a9cd-55ee-9669-75d6f7dbe206 with identifier: 202601109050752
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 710cbb1d-a9cd-55ee-9669-75d6f7dbe206
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1fc1bc76047c44ccb8e51103015376ae.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1fc1bc76047c44ccb8e51103015376ae.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a54f171e-587e-50f3-8362-7111c7ada925 with identifier: 202601068955573
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a54f171e-587e-50f3-8362-7111c7ada925
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52275e20aca64cc291bce36617cc1a52.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52275e20aca64cc291bce36617cc1a52.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c4aba6-58a8-564e-9864-18a31df41d6f with identifier: 202601058939429
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a4c4aba6-58a8-564e-9864-18a31df41d6f
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb007d50e687f473ea6dbe9fb591f7843.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b007d50e687f473ea6dbe9fb591f7843.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5411aea6-47cd-5c66-93ce-051469a08c36 with identifier: 202512248793545
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5411aea6-47cd-5c66-93ce-051469a08c36
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb004a8e45b24d30bd8558c7e39f03cf.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb004a8e45b24d30bd8558c7e39f03cf.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fc28f427-319f-554a-8bc5-bfe5c3efb55a with identifier: 202512198705115
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc28f427-319f-554a-8bc5-bfe5c3efb55a
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F34ebe2a97eb94cddbc14186f735fe9e7.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/34ebe2a97eb94cddbc14186f735fe9e7.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 99154531-ccce-5876-b575-2578ae593606 with identifier: 202512168625778
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 99154531-ccce-5876-b575-2578ae593606
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fc7ebe017db40bab06346363c470c0a.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fc7ebe017db40bab06346363c470c0a.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 983f7205-c0ba-51c6-82d3-5224dd2f220b with identifier: 202512138576482
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 983f7205-c0ba-51c6-82d3-5224dd2f220b
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63ad331384b245739c2aadedcba3deec.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63ad331384b245739c2aadedcba3deec.jpg not downloaded yet
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bb22493-0c10-5ee8-9760-e1368fb8209d with identifier: 202512098467378
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2bb22493-0c10-5ee8-9760-e1368fb8209d
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8507919ece24b14bf91792a5a38ff2d.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8507919ece24b14bf91792a5a38ff2d.jpg not downloaded yet
2026-03-25 16:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/69f6e2c2399b44b193e8108d057dc422.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/670bf3c048044808b48e7cfb536260a4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1fc1bc76047c44ccb8e51103015376ae.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/52275e20aca64cc291bce36617cc1a52.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/eb004a8e45b24d30bd8558c7e39f03cf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/63ad331384b245739c2aadedcba3deec.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354d7ebd0>
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968be23e-f106-5705-9748-11d7e4c4b98f/968be23e-f106-5705-9748-11d7e4c4b98f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F69f6e2c2399b44b193e8108d057dc422.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/69f6e2c2399b44b193e8108d057dc422.jpg saved to cache
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 968be23e-f106-5705-9748-11d7e4c4b98f
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 968be23e-f106-5705-9748-11d7e4c4b98f sending to next pipeline
2026-03-25 16:14:01 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 968be23e-f106-5705-9748-11d7e4c4b98f with identifier 202601199265998
2026-03-25 16:14:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:01 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 968be23e-f106-5705-9748-11d7e4c4b98f
2026-03-25 16:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/69f6e2c2399b44b193e8108d057dc422.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 279,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2005 Jaguar XK8 offers a compelling blend of performance '
                'and style, making it a desirable choice for discerning '
                'drivers. Under the bonnet lies a potent 4.2 litre petrol '
                'engine, ready to deliver an engaging driving experience. This '
                'particular XK8 benefits from a low insurance group, which can '
                'help to keep running costs down.\n'
                '\n'
                'The acceleration of this Jaguar is particularly noteworthy, '
                'achieving 0 to 60 miles per hour in just 6.3 seconds. This '
                'impressive figure indicates a level of responsiveness and '
                'power that sets it apart from many other vehicles in its '
                'class. The combination of its refined engineering and '
                'spirited performance makes this 2005 Jaguar XK8 a truly '
                'appealing proposition.',
 'doors_number': 2,
 'emission_standard': 'Euro 3',
 'engine': '4.2L',
 'engine_horse_power': 300,
 'fuel_type': 'Petrol',
 'id': '968be23e-f106-5705-9748-11d7e4c4b98f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199265998',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Jaguar',
 'model': 'XK8',
 'odometer': 92000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968be23e-f106-5705-9748-11d7e4c4b98f/968be23e-f106-5705-9748-11d7e4c4b98f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 627263,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/69f6e2c2399b44b193e8108d057dc422.jpg',
             'Width': 2048}],
 'price': 6990,
 'price_includes_vat': True,
 'registration_date': '2005-03-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Jaguar XK8 4.2 2dr',
 'transmission': 'automatic',
 'year': 2005}
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199265998%27 HTTP/1.1" 200 None
2026-03-25 16:14:01 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199265998: {'created_time': 1774455241.66391, 'last_price_update_time': 1774455241.66392}
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199265998') HTTP/1.1" 204 0
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354d7d7d0>
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c2a86fc-65b5-5451-af75-2b9601b7600c/6c2a86fc-65b5-5451-af75-2b9601b7600c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F670bf3c048044808b48e7cfb536260a4.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/670bf3c048044808b48e7cfb536260a4.jpg saved to cache
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c2a86fc-65b5-5451-af75-2b9601b7600c
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c2a86fc-65b5-5451-af75-2b9601b7600c sending to next pipeline
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83541d23d0>
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_710cbb1d-a9cd-55ee-9669-75d6f7dbe206/710cbb1d-a9cd-55ee-9669-75d6f7dbe206_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1fc1bc76047c44ccb8e51103015376ae.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1fc1bc76047c44ccb8e51103015376ae.jpg saved to cache
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 710cbb1d-a9cd-55ee-9669-75d6f7dbe206
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 710cbb1d-a9cd-55ee-9669-75d6f7dbe206 sending to next pipeline
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354d8af50>
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a54f171e-587e-50f3-8362-7111c7ada925/a54f171e-587e-50f3-8362-7111c7ada925_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F52275e20aca64cc291bce36617cc1a52.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/52275e20aca64cc291bce36617cc1a52.jpg saved to cache
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a54f171e-587e-50f3-8362-7111c7ada925
2026-03-25 16:14:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a54f171e-587e-50f3-8362-7111c7ada925 sending to next pipeline
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f834748c450>
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5411aea6-47cd-5c66-93ce-051469a08c36/5411aea6-47cd-5c66-93ce-051469a08c36_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feb004a8e45b24d30bd8558c7e39f03cf.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eb004a8e45b24d30bd8558c7e39f03cf.jpg saved to cache
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5411aea6-47cd-5c66-93ce-051469a08c36
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5411aea6-47cd-5c66-93ce-051469a08c36 sending to next pipeline
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f83477641d0>
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983f7205-c0ba-51c6-82d3-5224dd2f220b/983f7205-c0ba-51c6-82d3-5224dd2f220b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63ad331384b245739c2aadedcba3deec.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63ad331384b245739c2aadedcba3deec.jpg saved to cache
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 983f7205-c0ba-51c6-82d3-5224dd2f220b
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 983f7205-c0ba-51c6-82d3-5224dd2f220b sending to next pipeline
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6c2a86fc-65b5-5451-af75-2b9601b7600c with identifier 202601109056363
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6c2a86fc-65b5-5451-af75-2b9601b7600c
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/670bf3c048044808b48e7cfb536260a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'White',
 'currency': 'GBP',
 'description': 'John Hammick Cars are proud to offer This 2015 Land Rover '
                'Range Rover Evoque TD4 SE Tech. An impressive offering with '
                'this examples having BRAND NEW TIMING CHAINS AT THE COST OF '
                '£2500! FULL BLACK LEATHER!  BLACK PACK INCLUDING BLACK '
                'BADGES \n'
                '\n'
                'Contact our business WhatsApp for an instant answer to any '
                'questions 07749 119841\n'
                '\n'
                '59 miles per gallon on an average journey!  making it a '
                'remarkably economical choice for your motoring needs. This '
                'Four Wheel Drive model is powered by a 2.0L Diesel Engine and '
                "meets Euro 6 emission standards. Inside, you'll find comfort "
                'and convenience with Automatic Climate Control featuring air '
                'filtration and air quality sensing, along with Heated Front '
                'Seats. The SE Tech trim also includes Automatic Headlights, '
                'Bluetooth Audio Streaming for your entertainment, and Front '
                'Parking Aid to assist with manoeuvring.\n'
                '\n'
                'The Evoque boasts a generous boot space, providing ample room '
                'for luggage or shopping. Its low CO2 emissions further '
                'highlight its efficiency and environmental consideration '
                'compared to other vehicles in its class. This combination of '
                'practicality, advanced features, and excellent fuel economy '
                'makes this Range Rover Evoque a compelling option for those '
                'seeking a stylish and capable SUV.o',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 178,
 'fuel_type': 'Diesel',
 'id': '6c2a86fc-65b5-5451-af75-2b9601b7600c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601109056363',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 94000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c2a86fc-65b5-5451-af75-2b9601b7600c/6c2a86fc-65b5-5451-af75-2b9601b7600c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 731573,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/670bf3c048044808b48e7cfb536260a4.jpg',
             'Width': 2048}],
 'price': 6990,
 'price_includes_vat': True,
 'registration_date': '2015-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.0 TD4 SE Tech 4WD Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SE Tech',
 'year': 2015}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601109056363%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601109056363: {'created_time': 1774455242.196807, 'last_price_update_time': 1774455242.196823}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601109056363') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 710cbb1d-a9cd-55ee-9669-75d6f7dbe206 with identifier 202601109050752
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 710cbb1d-a9cd-55ee-9669-75d6f7dbe206
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1fc1bc76047c44ccb8e51103015376ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'color': 'Bronze',
 'currency': 'GBP',
 'description': 'This 2014 Maserati Quattroporte D V6 offers a compelling '
                'blend of performance and luxury, boasting a powerful 3.0L '
                'Diesel engine for an engaging driving experience. Equipped '
                'with Bi-Xenon headlights for excellent visibility and heated '
                'front seats for added comfort, this Quattroporte ensures a '
                'pleasant journey in any condition. The inclusion of rear air '
                'conditioning and Bluetooth for audio streaming further '
                'enhances the convenience for all occupants.\n'
                '\n'
                'The Maserati Quattroporte D V6 demonstrates its superior '
                'capabilities with an impressive 0-62mph acceleration time of '
                'just 6.4 seconds, setting it apart from many other vehicles '
                'in its class. This swift acceleration, combined with a '
                'generous boot space, makes it a practical yet exhilarating '
                'choice for those seeking a refined and capable executive '
                'saloon.lo',
 'doors_number': 4,
 'emission_standard': 'Euro 5',
 'engine': '3L',
 'engine_horse_power': 271,
 'fuel_type': 'Diesel',
 'id': '710cbb1d-a9cd-55ee-9669-75d6f7dbe206',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601109050752',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Maserati',
 'model': 'Quattroporte',
 'odometer': 85000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_710cbb1d-a9cd-55ee-9669-75d6f7dbe206/710cbb1d-a9cd-55ee-9669-75d6f7dbe206_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 866151,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1fc1bc76047c44ccb8e51103015376ae.jpg',
             'Width': 2048}],
 'price': 11990,
 'price_includes_vat': True,
 'registration_date': '2014-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Quattroporte 3.0D V6 ZF Euro 5 (s/s) 4dr',
 'transmission': 'automatic',
 'year': 2014}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601109050752%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601109050752: {'created_time': 1774455242.242671, 'last_price_update_time': 1774455242.24268}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601109050752') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a54f171e-587e-50f3-8362-7111c7ada925 with identifier 202601068955573
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a54f171e-587e-50f3-8362-7111c7ada925
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/52275e20aca64cc291bce36617cc1a52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'JOHN HAMMICK CARS OF ESSEX ARE DELIGHTED TO OFFER This 2014 '
                'Mercedes Benz B Class B180 CDI Sport, a well maintained '
                'example having had only two owners.  It features a 1.5 litre '
                'diesel engine and comes in the Sport trim.  Notable features '
                'include Bluetooth connectivity, air conditioning for your '
                'comfort, and Headlight Assist for automatic headlight '
                'activation.  For easier parking, it is equipped with a '
                'reversing camera with parking guidelines, and Bi-Xenon '
                'headlights provide excellent illumination.\n'
                '\n'
                'This B Class offers impressive efficiency, achieving a '
                'remarkable 64 miles per gallon, which is a significant '
                'advantage for running costs. Its low CO2 emissions also '
                'contribute to its economical profile. Furthermore, the '
                'generous boot space ensures you have ample room for luggage '
                'or shopping, making it a practical choice for everyday use '
                'and longer journeys.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.5L',
 'engine_horse_power': 108,
 'fuel_type': 'Diesel',
 'id': 'a54f171e-587e-50f3-8362-7111c7ada925',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601068955573',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'B Class',
 'odometer': 112500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a54f171e-587e-50f3-8362-7111c7ada925/a54f171e-587e-50f3-8362-7111c7ada925_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 850564,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/52275e20aca64cc291bce36617cc1a52.jpg',
             'Width': 2048}],
 'price': 4995,
 'price_includes_vat': True,
 'registration_date': '2014-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B Class 1.5 B180 CDI Sport 7G-DCT Euro 5 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2014}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601068955573%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601068955573: {'created_time': 1774455242.29733, 'last_price_update_time': 1774455242.297341}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601068955573') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5411aea6-47cd-5c66-93ce-051469a08c36 with identifier 202512248793545
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5411aea6-47cd-5c66-93ce-051469a08c36
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/eb004a8e45b24d30bd8558c7e39f03cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'This 2019 Volkswagen Polo TSI SEL offers a superb blend of '
                'style and practicality, making it an excellent choice for any '
                'driver. Powered by an efficient 1.0 litre petrol engine, this '
                'Euro 6 compliant model is registered in 2019 and boasts the '
                "desirable SEL trim. You'll appreciate the convenience of the "
                'Composition Media System, complete with Bluetooth '
                'connectivity for seamless phone integration and music '
                'streaming. Stay comfortable in all conditions with the 2 zone '
                'climate control, and navigate tight spaces with ease thanks '
                'to the front and rear parking sensors. The Polo also features '
                'halogen clear headlights with automatic activation and '
                'separate daytime running lights, enhancing both visibility '
                'and safety.\n'
                '\n'
                'The Volkswagen Polo TSI SEL is designed to impress with its '
                'performance and economy. Experience brisk acceleration with a '
                '0 to 62mph time of just 9.5 seconds, demonstrating its '
                'responsive nature. This model also stands out for its low CO2 '
                'emissions, indicating a more environmentally friendly and '
                'potentially more economical driving experience compared to '
                'similar vehicles. Furthermore, the generous boot space '
                'provides ample room for shopping, luggage, or sports '
                "equipment, proving that this compact car doesn't compromise "
                'on utility.\n'
                '\n'
                'Contact us via WhatsApp anytime of the day on 07749 119841 '
                'for an instant response to any question!',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': '5411aea6-47cd-5c66-93ce-051469a08c36',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512248793545',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 94000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5411aea6-47cd-5c66-93ce-051469a08c36/5411aea6-47cd-5c66-93ce-051469a08c36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 829208,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/eb004a8e45b24d30bd8558c7e39f03cf.jpg',
             'Width': 2048}],
 'price': 8990,
 'price_includes_vat': True,
 'registration_date': '2019-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI SEL Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'SEL',
 'year': 2019}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512248793545%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512248793545: {'created_time': 1774455242.344308, 'last_price_update_time': 1774455242.344321}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512248793545') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 983f7205-c0ba-51c6-82d3-5224dd2f220b with identifier 202512138576482
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 983f7205-c0ba-51c6-82d3-5224dd2f220b
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/63ad331384b245739c2aadedcba3deec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2017 Mercedes Benz E Class E220d AMG Line (Premium) '
                'offers an exceptional blend of luxury and efficiency, '
                'boasting an impressive fuel economy of 61 miles per gallon.  '
                'As a Euro 6 compliant model, it features a powerful yet '
                'economical 2.0L diesel engine, ensuring a refined driving '
                'experience.  The AMG Line trim enhances its sporty appeal, '
                'while the Premium designation brings a host of desirable '
                'features.  These include the advanced Driving Assistance Plus '
                'Package with adaptive cruise control for effortless journeys, '
                'and a panoramic glass sunroof that floods the cabin with '
                'natural light.  LED High Performance headlamps with '
                'integrated daytime running lights provide excellent '
                'visibility, and heated front seats ensure comfort in all '
                'conditions.\n'
                '\n'
                'This E Class also excels in practicality and performance. The '
                'active parking assist with front and rear sensors, along with '
                'PARKTRONIC, makes manoeuvring in tight spaces stress free. '
                'Furthermore, the generous boot space offers ample room for '
                'luggage or shopping. Demonstrating its dynamic capabilities, '
                'this E Class accelerates from 0 to 62 miles per hour in just '
                '7.7 seconds, a performance that indicates its superior '
                'responsiveness compared to many vehicles in its class.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 191,
 'fuel_type': 'Diesel',
 'id': '983f7205-c0ba-51c6-82d3-5224dd2f220b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512138576482',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'E Class',
 'odometer': 97000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983f7205-c0ba-51c6-82d3-5224dd2f220b/983f7205-c0ba-51c6-82d3-5224dd2f220b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 929949,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/63ad331384b245739c2aadedcba3deec.jpg',
             'Width': 2048}],
 'price': 13990,
 'price_includes_vat': True,
 'registration_date': '2017-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E Class 2.0 E220d AMG Line (Premium) G-Tronic+ Euro 6 '
          '(s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512138576482%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512138576482: {'created_time': 1774455242.391119, 'last_price_update_time': 1774455242.391128}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512138576482') HTTP/1.1" 204 0
2026-03-25 16:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b8507919ece24b14bf91792a5a38ff2d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/34ebe2a97eb94cddbc14186f735fe9e7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4fc7ebe017db40bab06346363c470c0a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b007d50e687f473ea6dbe9fb591f7843.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f834764fb90>
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bb22493-0c10-5ee8-9760-e1368fb8209d/2bb22493-0c10-5ee8-9760-e1368fb8209d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8507919ece24b14bf91792a5a38ff2d.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8507919ece24b14bf91792a5a38ff2d.jpg saved to cache
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bb22493-0c10-5ee8-9760-e1368fb8209d
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bb22493-0c10-5ee8-9760-e1368fb8209d sending to next pipeline
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2bb22493-0c10-5ee8-9760-e1368fb8209d with identifier 202512098467378
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2bb22493-0c10-5ee8-9760-e1368fb8209d
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b8507919ece24b14bf91792a5a38ff2d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this Land Rover '
                'Range Rover Velar 2.0 D240 HSE Auto 4WD Euro 6 (s/s) 5dr '
                'finished in metallic Grey with stunning Ivory bi tone leather '
                'interior. This 2018 Land Rover Range Rover Velar D240 HSE '
                'boasts a clear vehicle history, offering peace of mind for '
                'its next owner. This sophisticated SUV features a powerful '
                '2.0L diesel engine paired with a Four Wheel Drive system, '
                'ensuring capable performance in all conditions. As a Euro 6 '
                'compliant vehicle, it meets stringent emission standards. The '
                'HSE trim level signifies a premium experience, enhanced by a '
                'Full Extended Leather Upgrade that envelops the cabin in '
                'luxury. Practicality is also a key consideration, with ample '
                'boot space ready to accommodate your needs, and a towing '
                'weight of 2500 kg for added versatility.\n'
                '\n'
                'The Range Rover Velar D240 HSE excels with its impressive '
                'acceleration, reaching 0-60mph in just 7.0 seconds, a '
                'testament to its dynamic capabilities. This performance, '
                'combined with the Meridian Surround Sound System offering '
                '825W of audio power, elevates your driving experience beyond '
                'that of many similar vehicles. Enjoy personalised comfort '
                'with Two Zone Climate Control, and navigate with ease thanks '
                'to the Rear View Camera and Keyless Entry\n'
                '\n'
                'Before any car leaves us, a fresh service & or MOT if due, '
                'will be conducted for the new owner. This example looks and '
                'drives as it should. Three months engine & gearbox warranty '
                'provided. Looks and drives very well and has been cherished '
                'by its previous keeper, a perfectly spec’d example. Service '
                'history is present and can be disclosed fully prior to making '
                'an appointment. Part exchange very welcome . We purchase the '
                'best examples for more! So why not try us if you have a '
                'highly spec’d car with full history! Contact our WhatsApp '
                'number directly with any questions - you will receive an '
                'instant response 07749 119841 - We pay more for your car '
                'whether you buy ours or not . Viewings are by appointment '
                'only so please do not hesitate to call with any questions or '
                'to make an appointment to view and test drive.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 237,
 'fuel_type': 'Diesel',
 'id': '2bb22493-0c10-5ee8-9760-e1368fb8209d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512098467378',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 65000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 39,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bb22493-0c10-5ee8-9760-e1368fb8209d/2bb22493-0c10-5ee8-9760-e1368fb8209d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 897783,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b8507919ece24b14bf91792a5a38ff2d.jpg',
             'Width': 2048}],
 'price': 19990,
 'price_includes_vat': True,
 'registration_date': '2018-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 D240 HSE Auto 4WD Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2018}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512098467378%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512098467378: {'created_time': 1774455242.629313, 'last_price_update_time': 1774455242.629322}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512098467378') HTTP/1.1" 204 0
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347639d10>
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc28f427-319f-554a-8bc5-bfe5c3efb55a/fc28f427-319f-554a-8bc5-bfe5c3efb55a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F34ebe2a97eb94cddbc14186f735fe9e7.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/34ebe2a97eb94cddbc14186f735fe9e7.jpg saved to cache
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc28f427-319f-554a-8bc5-bfe5c3efb55a
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc28f427-319f-554a-8bc5-bfe5c3efb55a sending to next pipeline
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f834743e410>
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99154531-ccce-5876-b575-2578ae593606/99154531-ccce-5876-b575-2578ae593606_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fc7ebe017db40bab06346363c470c0a.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fc7ebe017db40bab06346363c470c0a.jpg saved to cache
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99154531-ccce-5876-b575-2578ae593606
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99154531-ccce-5876-b575-2578ae593606 sending to next pipeline
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f834743c850>
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4c4aba6-58a8-564e-9864-18a31df41d6f/a4c4aba6-58a8-564e-9864-18a31df41d6f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb007d50e687f473ea6dbe9fb591f7843.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b007d50e687f473ea6dbe9fb591f7843.jpg saved to cache
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4c4aba6-58a8-564e-9864-18a31df41d6f
2026-03-25 16:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4c4aba6-58a8-564e-9864-18a31df41d6f sending to next pipeline
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fc28f427-319f-554a-8bc5-bfe5c3efb55a with identifier 202512198705115
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fc28f427-319f-554a-8bc5-bfe5c3efb55a
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/34ebe2a97eb94cddbc14186f735fe9e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'color': 'Grey',
 'currency': 'GBP',
 'description': 'OUTSTANDING VALUE PART EXCHANGE TO CLEAR - FULL AUTO - '
                'BARGAIN CAR Discover this 2003 Honda Accord i VTEC Executive, '
                'a well maintained example of this popular saloon.  This '
                'Executive trim model boasts a smooth 2.0 litre petrol engine, '
                'offering a refined driving experience.  Its registration year '
                'of 2003 places it in a favourable and low insurance group, '
                'making it an economical choice for many drivers.\n'
                '\n'
                'The Honda Accord i VTEC Executive stands out with its '
                'thoughtful features and reliable engineering. The low '
                'insurance group is a significant advantage, suggesting lower '
                'running costs compared to many other vehicles in its class. '
                'This particular Accord is designed to provide comfort and '
                'practicality, making it a sensible and appealing option for '
                'those seeking a dependable car.',
 'doors_number': 5,
 'emission_standard': 'Euro 4',
 'engine': '2L',
 'engine_horse_power': 153,
 'fuel_type': 'Petrol',
 'id': 'fc28f427-319f-554a-8bc5-bfe5c3efb55a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512198705115',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Honda',
 'model': 'Accord',
 'odometer': 121000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc28f427-319f-554a-8bc5-bfe5c3efb55a/fc28f427-319f-554a-8bc5-bfe5c3efb55a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 900803,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/34ebe2a97eb94cddbc14186f735fe9e7.jpg',
             'Width': 2048}],
 'price': 1750,
 'price_includes_vat': True,
 'registration_date': '2003-12-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Accord 2.0 i-VTEC Executive Tourer 5dr',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2003}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512198705115%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512198705115: {'created_time': 1774455242.905099, 'last_price_update_time': 1774455242.905109}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512198705115') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 99154531-ccce-5876-b575-2578ae593606 with identifier 202512168625778
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 99154531-ccce-5876-b575-2578ae593606
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4fc7ebe017db40bab06346363c470c0a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 283,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this stunning Jeep '
                'Wrangler 3.8 V6 Petrol Manual. 2016 import - Before any car '
                'leaves us, a fresh service & or MOT if due, will be conducted '
                'for the new owner. This example looks and drives as it '
                'should. Three months engine & gearbox warranty provided. '
                'Looks and drives very well and has been cherished by its '
                'previous keeper, a perfectly spec’d example. Service history '
                'is present and can be disclosed fully prior to making an '
                'appointment. Part exchange very welcome . We purchase the '
                'best examples for more! So why not try us if you have a '
                'highly spec’d car with full history! Contact our WhatsApp '
                'number directly with any questions - you will receive an '
                'instant response 07749 119841 - We pay more for your car '
                'whether you buy ours or not . Viewings are by appointment '
                'only so please do not hesitate to call with any questions or '
                'to make an appointment to view and test drive.',
 'doors_number': 2,
 'emission_standard': 'Euro 5',
 'engine': '3.8L',
 'engine_horse_power': 193,
 'fuel_type': 'Petrol',
 'id': '99154531-ccce-5876-b575-2578ae593606',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512168625778',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Jeep',
 'model': 'Wrangler',
 'odometer': 111000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99154531-ccce-5876-b575-2578ae593606/99154531-ccce-5876-b575-2578ae593606_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 818357,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4fc7ebe017db40bab06346363c470c0a.jpg',
             'Width': 2048}],
 'price': 9990,
 'price_includes_vat': True,
 'registration_date': '2015-03-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Jeep Wrangler 3.8 V6 Rubicon 4WD Euro 5 2dr',
 'transmission': 'manual',
 'trim': 'Rubicon',
 'year': 2010}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512168625778%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512168625778: {'created_time': 1774455242.950509, 'last_price_update_time': 1774455242.950518}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512168625778') HTTP/1.1" 204 0
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a4c4aba6-58a8-564e-9864-18a31df41d6f with identifier 202601058939429
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a4c4aba6-58a8-564e-9864-18a31df41d6f
2026-03-25 16:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b007d50e687f473ea6dbe9fb591f7843.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'This 2013 Mercedes Benz GL Class GL350 V6 AMG Sport presents '
                'a compelling proposition with its remarkably low mileage for '
                'its age, having covered just 94,000 miles. This impressive '
                'seven seater, finished in the desirable AMG Sport trim, '
                'boasts a powerful yet efficient 3.0L V6 diesel engine paired '
                'with a four wheel drive system, ensuring capability in '
                'various conditions. Its Euro 6 emission class signifies a '
                'more environmentally conscious performance. Notable features '
                'include heated front seats for enhanced comfort, automatic '
                'climate control to maintain the perfect cabin temperature, '
                'and a Bluetooth interface for seamless hands free calls. The '
                'convenience of automatic headlamp activation and an electric '
                'glass sunroof further elevate the driving experience. With a '
                'substantial towing weight of 3500 kg, this GL Class is as '
                'practical as it is luxurious.\n'
                '\n'
                'Contact us via WhatsApp anytime of the day on 07749 119841 '
                'for an instant response to any question!\n'
                '\n'
                'The performance of this GL350 V6 AMG Sport is further '
                'underscored by its acceleration, reaching 0-62mph in a swift '
                '7.9 seconds, demonstrating a dynamic driving experience that '
                'sets it apart from many other vehicles in its class. This '
                'combination of potent acceleration, sophisticated Mercedes '
                'Benz engineering, and a comprehensive suite of features makes '
                'this GL Class a distinguished choice for those seeking a '
                'premium, capable, and comfortable seven seater vehicle.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '3L',
 'engine_horse_power': 254,
 'fuel_type': 'Diesel',
 'id': 'a4c4aba6-58a8-564e-9864-18a31df41d6f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601058939429',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'GL Class',
 'odometer': 94000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4c4aba6-58a8-564e-9864-18a31df41d6f/a4c4aba6-58a8-564e-9864-18a31df41d6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836698,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/b007d50e687f473ea6dbe9fb591f7843.jpg',
             'Width': 2048}],
 'price': 15440,
 'price_includes_vat': True,
 'registration_date': '2013-09-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz GL Class 3.0 GL350 V6 BlueTEC AMG Sport G-Tronic+ 4WD '
          'Euro 6 (s/s) 5dr',
 'transmission': 'automatic',
 'trim': 'AMG Sport',
 'year': 2013}
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601058939429%27 HTTP/1.1" 200 None
2026-03-25 16:14:02 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601058939429: {'created_time': 1774455242.992842, 'last_price_update_time': 1774455242.992849}
2026-03-25 16:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601058939429') HTTP/1.1" 204 0
2026-03-25 16:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 16:14:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b5d4e2e-b531-5789-a67c-5fbcb7706f5c with identifier: 202512028288338
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9b5d4e2e-b531-5789-a67c-5fbcb7706f5c
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad80b11d5b704b2e8b5d57aea53e7eac.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad80b11d5b704b2e8b5d57aea53e7eac.jpg not downloaded yet
2026-03-25 16:14:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 862ccd4e-29df-59d9-9fa2-fec8661350ac with identifier: 202511218057036
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 862ccd4e-29df-59d9-9fa2-fec8661350ac
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F812fa522a4084b94b190b9fa5fbf43eb.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/812fa522a4084b94b190b9fa5fbf43eb.jpg not downloaded yet
2026-03-25 16:14:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d4bb2668-c371-5f0d-af20-25e8ffbab215 with identifier: 202511107797100
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d4bb2668-c371-5f0d-af20-25e8ffbab215
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8828f74d4a6348dc8d4fa45450f59795.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8828f74d4a6348dc8d4fa45450f59795.jpg not downloaded yet
2026-03-25 16:14:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a45612b-3eca-5223-9094-0b08bb21831a with identifier: 202511077736177
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1a45612b-3eca-5223-9094-0b08bb21831a
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffc8597f0a1b740d1a5dbcb8719fe036f.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fc8597f0a1b740d1a5dbcb8719fe036f.jpg not downloaded yet
2026-03-25 16:14:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 950a4fdf-4576-5f25-b734-53078e4e0407 with identifier: 202510076949764
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 950a4fdf-4576-5f25-b734-53078e4e0407
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83bc18698f3c436d9e3e0a5fa8e8f962.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83bc18698f3c436d9e3e0a5fa8e8f962.jpg not downloaded yet
2026-03-25 16:14:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 817b82d4-1ff8-5389-b702-308d2e5c73ba with identifier: 202510046893500
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 817b82d4-1ff8-5389-b702-308d2e5c73ba
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fdde8cfffca46e9a43d42cdac18e914.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fdde8cfffca46e9a43d42cdac18e914.jpg not downloaded yet
2026-03-25 16:14:19 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c6d16950-8a60-56a4-b7f8-495218dbfeab with identifier: 202509196479354
2026-03-25 16:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c6d16950-8a60-56a4-b7f8-495218dbfeab
2026-03-25 16:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3bf73d4da84a41deac0df8da8ee868bf.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3bf73d4da84a41deac0df8da8ee868bf.jpg not downloaded yet
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0407a960-1b01-52d7-90d9-8cf8f6b6cfbe with identifier: 202509166382274
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0407a960-1b01-52d7-90d9-8cf8f6b6cfbe
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd9e498397325471688f8df2cafb7788f.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d9e498397325471688f8df2cafb7788f.jpg not downloaded yet
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ab5bfeba-1485-587a-bc69-5d0bd580413a with identifier: 202509025962123
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ab5bfeba-1485-587a-bc69-5d0bd580413a
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28c79b9567cd49b1a85663d476f696a3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28c79b9567cd49b1a85663d476f696a3.jpg not downloaded yet
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 16:14:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 277b8649-d6f1-54f8-86d3-067b0c79f04a with identifier: 202506203710190
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 277b8649-d6f1-54f8-86d3-067b0c79f04a
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffee7421bc9104935aa0d1e15ca2578e3.jpg%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fee7421bc9104935aa0d1e15ca2578e3.jpg not downloaded yet
2026-03-25 16:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ad80b11d5b704b2e8b5d57aea53e7eac.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8828f74d4a6348dc8d4fa45450f59795.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/83bc18698f3c436d9e3e0a5fa8e8f962.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4fdde8cfffca46e9a43d42cdac18e914.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/28c79b9567cd49b1a85663d476f696a3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b3c050>
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5d4e2e-b531-5789-a67c-5fbcb7706f5c/9b5d4e2e-b531-5789-a67c-5fbcb7706f5c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fad80b11d5b704b2e8b5d57aea53e7eac.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ad80b11d5b704b2e8b5d57aea53e7eac.jpg saved to cache
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b5d4e2e-b531-5789-a67c-5fbcb7706f5c
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b5d4e2e-b531-5789-a67c-5fbcb7706f5c sending to next pipeline
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9b5d4e2e-b531-5789-a67c-5fbcb7706f5c with identifier 202512028288338
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9b5d4e2e-b531-5789-a67c-5fbcb7706f5c
2026-03-25 16:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ad80b11d5b704b2e8b5d57aea53e7eac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 239,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'This 2009 Mercedes Benz CLK350 Sport is a well maintained '
                'example with only four previous owners.  It features a '
                'powerful 3.5 litre petrol engine and is presented in the '
                'desirable Sport trim.  This model offers a refined driving '
                'experience synonymous with the Mercedes Benz brand.\n'
                '\n'
                'The CLK350 Sport benefits from a low insurance group, making '
                'it an economical choice for many drivers. This, combined with '
                'its reputable Mercedes Benz engineering and the Sport '
                'specification, indicates a vehicle that offers both '
                'performance and value compared to other cars in its class.o',
 'doors_number': 2,
 'emission_standard': 'Euro 4',
 'engine': '3.5L',
 'engine_horse_power': 272,
 'fuel_type': 'Petrol',
 'id': '9b5d4e2e-b531-5789-a67c-5fbcb7706f5c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512028288338',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'CLK',
 'odometer': 68000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 31,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b5d4e2e-b531-5789-a67c-5fbcb7706f5c/9b5d4e2e-b531-5789-a67c-5fbcb7706f5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 610463,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ad80b11d5b704b2e8b5d57aea53e7eac.jpg',
             'Width': 2048}],
 'price': 7990,
 'price_includes_vat': True,
 'registration_date': '2009-06-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz CLK 3.5 CLK350 Sport 7G-Tronic 2dr',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2009}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512028288338%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512028288338: {'created_time': 1774455260.355555, 'last_price_update_time': 1774455260.355562}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512028288338') HTTP/1.1" 204 0
2026-03-25 16:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3bf73d4da84a41deac0df8da8ee868bf.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347791250>
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4bb2668-c371-5f0d-af20-25e8ffbab215/d4bb2668-c371-5f0d-af20-25e8ffbab215_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8828f74d4a6348dc8d4fa45450f59795.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8828f74d4a6348dc8d4fa45450f59795.jpg saved to cache
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4bb2668-c371-5f0d-af20-25e8ffbab215
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4bb2668-c371-5f0d-af20-25e8ffbab215 sending to next pipeline
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354d6fe10>
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_950a4fdf-4576-5f25-b734-53078e4e0407/950a4fdf-4576-5f25-b734-53078e4e0407_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F83bc18698f3c436d9e3e0a5fa8e8f962.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/83bc18698f3c436d9e3e0a5fa8e8f962.jpg saved to cache
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 950a4fdf-4576-5f25-b734-53078e4e0407
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 950a4fdf-4576-5f25-b734-53078e4e0407 sending to next pipeline
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b48350>
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_817b82d4-1ff8-5389-b702-308d2e5c73ba/817b82d4-1ff8-5389-b702-308d2e5c73ba_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4fdde8cfffca46e9a43d42cdac18e914.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4fdde8cfffca46e9a43d42cdac18e914.jpg saved to cache
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 817b82d4-1ff8-5389-b702-308d2e5c73ba
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 817b82d4-1ff8-5389-b702-308d2e5c73ba sending to next pipeline
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354adc7d0>
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab5bfeba-1485-587a-bc69-5d0bd580413a/ab5bfeba-1485-587a-bc69-5d0bd580413a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F28c79b9567cd49b1a85663d476f696a3.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/28c79b9567cd49b1a85663d476f696a3.jpg saved to cache
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab5bfeba-1485-587a-bc69-5d0bd580413a
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab5bfeba-1485-587a-bc69-5d0bd580413a sending to next pipeline
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d4bb2668-c371-5f0d-af20-25e8ffbab215 with identifier 202511107797100
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d4bb2668-c371-5f0d-af20-25e8ffbab215
2026-03-25 16:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8828f74d4a6348dc8d4fa45450f59795.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this MINI Hatch 2.0 '
                'Cooper S Sport Steptronic Euro 6 (s/s) 3dr sporting plenty of '
                'JCW options including JCW SPORTS SEATS JCW STEERING WHEEL AND '
                'FULL JCW AERO BODY STYLING! FULL COLOUR SAT NAV! Before any '
                'car leaves us, a fresh service & or MOT if due, will be '
                'conducted for the new owner. This example looks and drives '
                'PERFECTLY!!. Three months engine & gearbox warranty provided. '
                'Looks and drives very well and has been cherished by its '
                'previous keeper, a perfectly spec’d example. Service history '
                'is present and can be disclosed fully prior to making an '
                'appointment. Part exchange very welcome . We purchase the '
                'best examples for more! So why not try us if you have a '
                'highly spec’d car with full history! Contact our WhatsApp '
                'number directly with any questions - you will receive an '
                'instant response 07749 119841 - We pay more for your car '
                'whether you buy ours or not . Viewings are by appointment '
                'only so please do not hesitate to call with any questions or '
                'to make an appointment to view and test drive. \n'
                'Discover this 2020 MINI Hatch Cooper S Sport, a dynamic and '
                'stylish car ready for its next adventure. This particular '
                'model boasts a powerful 2.0L petrol engine, meeting Euro 6 '
                'emission standards, ensuring a blend of performance and '
                'efficiency. It comes equipped with a host of desirable '
                'features, including striking 18in John Cooper Works Cup Spoke '
                'alloy wheels with run flat tyres, complemented by sleek Piano '
                'Black interior surfaces. For your convenience and '
                'connectivity, it includes the Navigation Pack with Apple '
                'CarPlay and Bluetooth for compatible mobile phones, complete '
                'with audio streaming.\n'
                '\n'
                'Experience exhilarating performance with this MINI Hatch, '
                'capable of accelerating from 0 to 62mph in a swift 6.7 '
                'seconds. This impressive acceleration highlights how this '
                'Cooper S Sport variant offers a more engaging driving '
                'experience compared to many other vehicles in its class. '
                'Additionally, it features 17in John Cooper Works Track Spoke '
                'alloy wheels in black, also with run flat tyres, further '
                'enhancing its sporty appeal and practicality.',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 189,
 'fuel_type': 'Petrol',
 'id': 'd4bb2668-c371-5f0d-af20-25e8ffbab215',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511107797100',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 75000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 47,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4bb2668-c371-5f0d-af20-25e8ffbab215/d4bb2668-c371-5f0d-af20-25e8ffbab215_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 613662,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8828f74d4a6348dc8d4fa45450f59795.jpg',
             'Width': 2048}],
 'price': 13790,
 'price_includes_vat': True,
 'registration_date': '2020-11-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 Cooper S Sport Steptronic Euro 6 (s/s) 3dr',
 'transmission': 'automatic',
 'trim': 'Cooper S Sport',
 'year': 2020}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511107797100%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511107797100: {'created_time': 1774455260.718457, 'last_price_update_time': 1774455260.718466}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511107797100') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 950a4fdf-4576-5f25-b734-53078e4e0407 with identifier 202510076949764
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 950a4fdf-4576-5f25-b734-53078e4e0407
2026-03-25 16:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/83bc18698f3c436d9e3e0a5fa8e8f962.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'Just arrived Aand awaiting retail preparation including full '
                'vallet - Discover this exceptional 2018 Mercedes Benz CLA220d '
                'AMG Line Night Edition, boasting remarkably low mileage for '
                'its age at just 44,000 miles. This Euro 6 compliant model '
                'features a powerful yet efficient 2.1L diesel engine and is '
                'presented in the sought after AMG Line Night Edition trim. '
                "Inside, you'll find luxurious heated front seats for added "
                'comfort, complemented by THERMOTRONIC luxury automatic '
                'climate control for a perfect cabin temperature. The Audio 20 '
                'radio with Bluetooth connectivity keeps you entertained and '
                'connected on the go, while the automatic headlamp activation '
                'and LED high performance headlamps with integrated daytime '
                'running lights ensure excellent visibility in all '
                'conditions.\n'
                '\n'
                'This particular CLA220d AMG Line Night Edition stands out '
                'with its low insurance group, offering potential savings for '
                'its next owner. The combination of its advanced features, '
                'including the automatic headlights and climate control, '
                'alongside its impressive fuel efficiency and low mileage, '
                'signifies a superior ownership experience compared to other '
                'vehicles in its class. This Mercedes Benz represents a '
                'compelling choice for those seeking style, performance, and '
                'advanced technology.',
 'doors_number': 4,
 'emission_standard': 'Euro 6',
 'engine': '2.1L',
 'engine_horse_power': 168,
 'fuel_type': 'Diesel',
 'id': '950a4fdf-4576-5f25-b734-53078e4e0407',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510076949764',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mercedes-Benz',
 'model': 'CLA',
 'odometer': 44000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 30,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_950a4fdf-4576-5f25-b734-53078e4e0407/950a4fdf-4576-5f25-b734-53078e4e0407_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752977,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/83bc18698f3c436d9e3e0a5fa8e8f962.jpg',
             'Width': 2048}],
 'price': 15990,
 'price_includes_vat': True,
 'registration_date': '2018-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA 2.1 CLA220d AMG Line Night Edition Coupe 7G-DCT '
          'Euro 6 (s/s) 4dr',
 'transmission': 'automatic',
 'trim': 'AMG Line Night Edition',
 'year': 2018}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510076949764%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510076949764: {'created_time': 1774455260.763232, 'last_price_update_time': 1774455260.76324}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510076949764') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 817b82d4-1ff8-5389-b702-308d2e5c73ba with identifier 202510046893500
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 817b82d4-1ff8-5389-b702-308d2e5c73ba
2026-03-25 16:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4fdde8cfffca46e9a43d42cdac18e914.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'color': 'Red',
 'currency': 'GBP',
 'description': 'This 2010 Mazda MX-5 i Miyako is a truly special find, '
                'boasting a remarkably low insurance group that makes it an '
                'accessible choice for many drivers.  This particular example, '
                'finished in the Miyako trim, is powered by a responsive 1.8 '
                'litre petrol engine, offering an engaging driving '
                'experience.\n'
                '\n'
                'Enjoy impressive running costs with this MX-5, achieving an '
                'excellent fuel economy of 40 miles per gallon. Furthermore, '
                'its low CO2 emissions mean it is kinder to the environment. '
                'These factors combined indicate that this Mazda MX-5 offers a '
                'more economical and efficient ownership proposition compared '
                'to many other vehicles in its class.',
 'doors_number': 2,
 'emission_standard': 'Euro 4',
 'engine': '1.8L',
 'engine_horse_power': 124,
 'fuel_type': 'Petrol',
 'id': '817b82d4-1ff8-5389-b702-308d2e5c73ba',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510046893500',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 74000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_817b82d4-1ff8-5389-b702-308d2e5c73ba/817b82d4-1ff8-5389-b702-308d2e5c73ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 586320,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4fdde8cfffca46e9a43d42cdac18e914.jpg',
             'Width': 2048}],
 'price': 5990,
 'price_includes_vat': True,
 'registration_date': '2010-10-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mazda MX-5 1.8i Miyako Euro 4 2dr',
 'transmission': 'manual',
 'trim': 'Miyako',
 'year': 2010}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510046893500%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510046893500: {'created_time': 1774455260.809597, 'last_price_update_time': 1774455260.809605}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510046893500') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ab5bfeba-1485-587a-bc69-5d0bd580413a with identifier 202509025962123
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ab5bfeba-1485-587a-bc69-5d0bd580413a
2026-03-25 16:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/28c79b9567cd49b1a85663d476f696a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 301,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this stunning and '
                'rather rare XKR 4.0 100 Linited edition. Before any car '
                'leaves us, a fresh service & or MOT if due, will be conducted '
                'for the new owner. This example looks and drives as it '
                'should. Three months engine & gearbox warranty provided. '
                'Looks and drives very well and has been cherished by its '
                'previous keeper, a perfectly spec’d example. Service history '
                'is present and can be disclosed fully prior to making an '
                'appointment. Part exchange very welcome . We purchase the '
                'best examples for more! So why not try us if you have a '
                'highly spec’d car with full history! Contact our WhatsApp '
                'number directly with any questions - you will receive an '
                'instant response 07749 119841 - We pay more for your car '
                'whether you buy ours or not . Viewings are by appointment '
                'only so please do not hesitate to call with any questions or '
                'to make an appointment to view and test drive. \n'
                '\n'
                'This 2002 Jaguar XKR 100 is presented with a clear vehicle '
                'history check, offering peace of mind for its next owner.  '
                'This special edition XKR is powered by a robust 4.0 litre '
                'petrol engine, delivering a refined driving experience.  As a '
                '100 variant and trim, it represents a desirable specification '
                'within the XKR range.\n'
                '\n'
                'The Jaguar XKR is known for its blend of performance and '
                'luxury, and this particular model benefits from a low '
                'insurance group, making it an attractive proposition. This '
                'combination of a powerful engine, exclusive 100 badging, and '
                'favourable insurance costs highlights its appeal compared to '
                'other vehicles in its class.',
 'doors_number': 2,
 'emission_standard': 'Euro 3',
 'engine': '4L',
 'engine_horse_power': 370,
 'fuel_type': 'Petrol',
 'id': 'ab5bfeba-1485-587a-bc69-5d0bd580413a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509025962123',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Jaguar',
 'model': 'XKR',
 'odometer': 77000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 29,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab5bfeba-1485-587a-bc69-5d0bd580413a/ab5bfeba-1485-587a-bc69-5d0bd580413a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 564899,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/28c79b9567cd49b1a85663d476f696a3.jpg',
             'Width': 2048}],
 'price': 9990,
 'price_includes_vat': True,
 'registration_date': '2002-01-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Jaguar XKR 4.0 100 Limited Edition 2dr',
 'transmission': 'automatic',
 'trim': '100',
 'year': 2002}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509025962123%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509025962123: {'created_time': 1774455260.857857, 'last_price_update_time': 1774455260.857865}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509025962123') HTTP/1.1" 204 0
2026-03-25 16:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fc8597f0a1b740d1a5dbcb8719fe036f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fee7421bc9104935aa0d1e15ca2578e3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b2fc10>
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6d16950-8a60-56a4-b7f8-495218dbfeab/c6d16950-8a60-56a4-b7f8-495218dbfeab_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3bf73d4da84a41deac0df8da8ee868bf.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3bf73d4da84a41deac0df8da8ee868bf.jpg saved to cache
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6d16950-8a60-56a4-b7f8-495218dbfeab
2026-03-25 16:14:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6d16950-8a60-56a4-b7f8-495218dbfeab sending to next pipeline
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c6d16950-8a60-56a4-b7f8-495218dbfeab with identifier 202509196479354
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c6d16950-8a60-56a4-b7f8-495218dbfeab
2026-03-25 16:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3bf73d4da84a41deac0df8da8ee868bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Green',
 'currency': 'GBP',
 'description': 'John Hammick Cars offer This 2009 Ford Ka Studio, a fantastic '
                'example, having been owned by just one careful keeper from '
                'new.  This popular compact car is powered by an efficient 1.2 '
                'litre petrol engine, making it a sensible choice for everyday '
                'driving.\n'
                '\n'
                'The Ford Ka Studio offers excellent running costs, boasting '
                'an impressive fuel economy of 55 miles per gallon. '
                'Furthermore, its low insurance group rating and low CO2 '
                'emissions indicate that it is more economical to own and run '
                'compared to many other vehicles in its class.',
 'doors_number': 3,
 'emission_standard': 'Euro 4',
 'engine': '1.2L',
 'engine_horse_power': 68,
 'fuel_type': 'Petrol',
 'id': 'c6d16950-8a60-56a4-b7f8-495218dbfeab',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509196479354',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 12000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6d16950-8a60-56a4-b7f8-495218dbfeab/c6d16950-8a60-56a4-b7f8-495218dbfeab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 542104,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3bf73d4da84a41deac0df8da8ee868bf.jpg',
             'Width': 2048}],
 'price': 3990,
 'price_includes_vat': True,
 'registration_date': '2009-09-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford KA 1.2 Studio Euro 4 3dr',
 'transmission': 'manual',
 'trim': 'Studio',
 'year': 2009}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509196479354%27 HTTP/1.1" 200 None
2026-03-25 16:14:20 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509196479354: {'created_time': 1774455260.982035, 'last_price_update_time': 1774455260.982043}
2026-03-25 16:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509196479354') HTTP/1.1" 204 0
2026-03-25 16:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d9e498397325471688f8df2cafb7788f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/812fa522a4084b94b190b9fa5fbf43eb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8347417050>
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a45612b-3eca-5223-9094-0b08bb21831a/1a45612b-3eca-5223-9094-0b08bb21831a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffc8597f0a1b740d1a5dbcb8719fe036f.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fc8597f0a1b740d1a5dbcb8719fe036f.jpg saved to cache
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a45612b-3eca-5223-9094-0b08bb21831a
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a45612b-3eca-5223-9094-0b08bb21831a sending to next pipeline
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354149590>
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_277b8649-d6f1-54f8-86d3-067b0c79f04a/277b8649-d6f1-54f8-86d3-067b0c79f04a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffee7421bc9104935aa0d1e15ca2578e3.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fee7421bc9104935aa0d1e15ca2578e3.jpg saved to cache
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 277b8649-d6f1-54f8-86d3-067b0c79f04a
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 277b8649-d6f1-54f8-86d3-067b0c79f04a sending to next pipeline
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1a45612b-3eca-5223-9094-0b08bb21831a with identifier 202511077736177
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1a45612b-3eca-5223-9094-0b08bb21831a
2026-03-25 16:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fc8597f0a1b740d1a5dbcb8719fe036f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Silver',
 'currency': 'GBP',
 'description': 'John Hammick Cars welcome This 2016 MINI Convertible Cooper '
                'S, a delightful driving experience with its engaging '
                'performance and open top motoring.  Powered by a 2.0 litre '
                'petrol engine, this Euro 6 compliant model combines spirited '
                'driving with efficiency, achieving an impressive 47 miles per '
                "gallon.  Inside, you'll find the comfortable Black Pearl "
                'Cloth Leatherette upholstery in Carbon Black, complemented by '
                'seat heating for both the driver and front passenger.  The '
                'steering wheel features multifunction controls for '
                "convenience, and the driver's seat benefits from a memory "
                'function, ensuring your preferred position is always readily '
                'available.  Manual air conditioning keeps the cabin at a '
                'comfortable temperature.\n'
                '\n'
                'Auto trader 5 star rated family run business. Freshly '
                'serviced and MOT’d for the new keeper. For an instant answer '
                'to any queries feel free to contact out business WhatsApp '
                'number on 07749 119841 \n'
                '\n'
                'This MINI Convertible Cooper S stands out with its low '
                'insurance group and low CO2 emissions, indicating it is a '
                'more economical choice compared to many other vehicles in its '
                'class. These highlights, alongside its fuel economy, make it '
                'a sensible and enjoyable option for those seeking a stylish '
                'and practical convertible.',
 'doors_number': 2,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 189,
 'fuel_type': 'Petrol',
 'id': '1a45612b-3eca-5223-9094-0b08bb21831a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511077736177',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'MINI',
 'model': 'Convertible',
 'odometer': 83000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 32,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a45612b-3eca-5223-9094-0b08bb21831a/1a45612b-3eca-5223-9094-0b08bb21831a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 580033,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fc8597f0a1b740d1a5dbcb8719fe036f.jpg',
             'Width': 2048}],
 'price': 7990,
 'price_includes_vat': True,
 'registration_date': '2016-11-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Convertible 2.0 Cooper S Euro 6 (s/s) 2dr',
 'transmission': 'manual',
 'trim': 'Cooper S',
 'year': 2016}
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511077736177%27 HTTP/1.1" 200 None
2026-03-25 16:14:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511077736177: {'created_time': 1774455261.195254, 'last_price_update_time': 1774455261.195263}
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511077736177') HTTP/1.1" 204 0
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 277b8649-d6f1-54f8-86d3-067b0c79f04a with identifier 202506203710190
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 277b8649-d6f1-54f8-86d3-067b0c79f04a
2026-03-25 16:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fee7421bc9104935aa0d1e15ca2578e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'White',
 'currency': 'GBP',
 'description': 'John Hammick cars are delighted to offer this incredibly well '
                'kept Smart fortwo 1.0 Passion Cabriolet SoftTouch Euro 5 2dr. '
                'Finished in Candy white with a black convertible roof and '
                'black interior. Sat nav and Bluetooth phone. 9 SERVICE STAMPS '
                'IN THE BOOK! Before any car leaves us, a fresh service & or '
                'MOT if due, will be conducted for the new owner. This example '
                'looks and drives as it should. Three months engine & gearbox '
                'warranty provided. Looks and drives very well and has been '
                'cherished by its previous keeper, a perfectly spec’d example. '
                'Service history is present and can be disclosed fully prior '
                'to making an appointment. Part exchange very welcome . We '
                'purchase the best examples for more! So why not try us if you '
                'have a highly spec’d car with full history! Contact our '
                'WhatsApp number directly with any questions - you will '
                'receive an instant response 07749 119841 - We pay more for '
                'your car whether you buy ours or not . Viewings are by '
                'appointment only so please do not hesitate to call with any '
                'questions or to make an appointment to view and test drive.',
 'doors_number': 2,
 'emission_standard': 'Euro 5',
 'engine': '1L',
 'engine_horse_power': 84,
 'fuel_type': 'Petrol',
 'id': '277b8649-d6f1-54f8-86d3-067b0c79f04a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202506203710190',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 66,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_277b8649-d6f1-54f8-86d3-067b0c79f04a/277b8649-d6f1-54f8-86d3-067b0c79f04a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 507178,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fee7421bc9104935aa0d1e15ca2578e3.jpg',
             'Width': 2048}],
 'price': 4240,
 'price_includes_vat': True,
 'registration_date': '2013-01-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart Fortwo 1.0 Passion Cabriolet SoftTouch Euro 5 2dr',
 'transmission': 'automatic',
 'trim': 'Passion',
 'year': 2013}
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202506203710190%27 HTTP/1.1" 200 None
2026-03-25 16:14:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202506203710190: {'created_time': 1774455261.241315, 'last_price_update_time': 1774455261.241329}
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202506203710190') HTTP/1.1" 204 0
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354177fd0>
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0407a960-1b01-52d7-90d9-8cf8f6b6cfbe/0407a960-1b01-52d7-90d9-8cf8f6b6cfbe_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd9e498397325471688f8df2cafb7788f.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d9e498397325471688f8df2cafb7788f.jpg saved to cache
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0407a960-1b01-52d7-90d9-8cf8f6b6cfbe
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0407a960-1b01-52d7-90d9-8cf8f6b6cfbe sending to next pipeline
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8354b6c810>
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 16:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862ccd4e-29df-59d9-9fa2-fec8661350ac/862ccd4e-29df-59d9-9fa2-fec8661350ac_image_0.jpg HTTP/1.1" 201 0
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F812fa522a4084b94b190b9fa5fbf43eb.jpg') HTTP/1.1" 204 0
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/812fa522a4084b94b190b9fa5fbf43eb.jpg saved to cache
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 862ccd4e-29df-59d9-9fa2-fec8661350ac
2026-03-25 16:14:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 862ccd4e-29df-59d9-9fa2-fec8661350ac sending to next pipeline
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0407a960-1b01-52d7-90d9-8cf8f6b6cfbe with identifier 202509166382274
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0407a960-1b01-52d7-90d9-8cf8f6b6cfbe
2026-03-25 16:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d9e498397325471688f8df2cafb7788f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'Black',
 'currency': 'GBP',
 'description': 'John Hammick Cars are delighted to offer This 2011 Volkswagen '
                'Polo TSI GTI WITH A TOTAL OF 11 SERVICES AND JUST 52,000 '
                'MILES FROM NEW!!! This GTI presents an exceptional '
                'opportunity with its remarkably low mileage of just 52,000 '
                'miles, a significant advantage for a vehicle of its age. This '
                'particular model boasts the sporty GTI trim and is powered by '
                'an efficient 1.4 litre petrol engine. For your peace of mind, '
                'the vehicle history check is clear, confirming its well '
                'maintained status. Inside, you will find the comfort of '
                'Climatic semi automatic air conditioning, ensuring a pleasant '
                'driving environment in all conditions.\n'
                '\n'
                'The performance of this Polo TSI GTI is truly a standout '
                'feature, with its ability to accelerate from 0 to 62 miles '
                'per hour in a swift 6.9 seconds. This impressive acceleration '
                'indicates a more dynamic and engaging driving experience '
                'compared to many other vehicles in its class. Combined with '
                'its low mileage and clear history, this Volkswagen Polo '
                'offers a compelling package of performance, comfort, and '
                'reliability.',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.4L',
 'engine_horse_power': 178,
 'fuel_type': 'Petrol',
 'id': '0407a960-1b01-52d7-90d9-8cf8f6b6cfbe',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509166382274',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 52000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0407a960-1b01-52d7-90d9-8cf8f6b6cfbe/0407a960-1b01-52d7-90d9-8cf8f6b6cfbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 717309,
             'Height': 1536,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d9e498397325471688f8df2cafb7788f.jpg',
             'Width': 2048}],
 'price': 7790,
 'price_includes_vat': True,
 'registration_date': '2011-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TSI GTI DSG Euro 5 5dr',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2011}
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509166382274%27 HTTP/1.1" 200 None
2026-03-25 16:14:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509166382274: {'created_time': 1774455261.429956, 'last_price_update_time': 1774455261.429969}
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509166382274') HTTP/1.1" 204 0
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 862ccd4e-29df-59d9-9fa2-fec8661350ac with identifier 202511218057036
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 862ccd4e-29df-59d9-9fa2-fec8661350ac
2026-03-25 16:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/812fa522a4084b94b190b9fa5fbf43eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Blue',
 'currency': 'GBP',
 'description': 'This 2015 MINI Hatch Cooper D offers an exceptional blend of '
                'style and efficiency, boasting an impressive fuel economy of '
                '79 miles per gallon. This particular model, registered in '
                '2015, features the Cooper D trim and is powered by a 1.5 '
                'litre diesel engine, meeting the Euro 6 emission class. It '
                'comes equipped with stylish 16 inch Victory Spoke alloy '
                'wheels in silver, a Visual Boost Radio for your entertainment '
                'needs, and a comfortable Diamond Cloth Leather interior in '
                'Carbon Black. For your comfort, it includes automatic dual '
                'zone air conditioning with climate control, and connectivity '
                'is made easy with Bluetooth hands free function and USB '
                'audio.\n'
                '\n'
                'The MINI Hatch Cooper D stands out with its remarkable '
                'performance figures, achieving 0 to 62 miles per hour in just '
                '9.4 seconds. Its low CO2 emissions further highlight its '
                'efficiency, making it a more environmentally conscious choice '
                'compared to similar vehicles. This combination of brisk '
                'acceleration and outstanding fuel economy ensures a driving '
                'experience that is both engaging and economical.',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 114,
 'fuel_type': 'Diesel',
 'id': '862ccd4e-29df-59d9-9fa2-fec8661350ac',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511218057036',
 'listing': 'directbuy',
 'location': 'Ongar, Essex',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 101000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862ccd4e-29df-59d9-9fa2-fec8661350ac/862ccd4e-29df-59d9-9fa2-fec8661350ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 221028,
             'Height': 860,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/812fa522a4084b94b190b9fa5fbf43eb.jpg',
             'Width': 1290}],
 'price': 4240,
 'price_includes_vat': True,
 'registration_date': '2015-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Hatch 1.5 Cooper D Euro 6 (s/s) 5dr',
 'transmission': 'manual',
 'trim': 'Cooper D',
 'year': 2015}
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511218057036%27 HTTP/1.1" 200 None
2026-03-25 16:14:21 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511218057036: {'created_time': 1774455261.479075, 'last_price_update_time': 1774455261.479082}
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511218057036') HTTP/1.1" 204 0
2026-03-25 16:14:21 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 16:14:21 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-25 16:14:21 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 16:14:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 8d990332286511f18f76c264925fbcfa
2026-03-25 16:14:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-25 16:14:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-25 16:14:21 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 16:14:21 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 16:14:21 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-25 16:14:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-25 16:14:22 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 3, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-25 16:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773159262 HTTP/1.1" 200 None
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512308838420') HTTP/1.1" 204 0
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250199927') HTTP/1.1" 204 0
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602250213323') HTTP/1.1" 204 0
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603010305230') HTTP/1.1" 204 0
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603010313633') HTTP/1.1" 204 0
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060457596') HTTP/1.1" 204 0
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060461976') HTTP/1.1" 204 0
2026-03-25 16:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603070500714') HTTP/1.1" 204 0
2026-03-25 16:14:23 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (63 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/8d990332286511f18f76c264925fbcfa.jl
2026-03-25 16:14:23 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 512776,
 'downloader/request_count': 74,
 'downloader/request_method_count/GET': 63,
 'downloader/request_method_count/POST': 11,
 'downloader/response_bytes': 38291938,
 'downloader/response_count': 74,
 'downloader/response_status_count/200': 74,
 'elapsed_time_seconds': 53.50403,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 25, 16, 14, 23, 387255, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 63,
 'log_count/DEBUG': 1131,
 'log_count/INFO': 960,
 'memusage/max': 147058688,
 'memusage/startup': 147058688,
 'photo_download_count': 63,
 'request_depth_max': 5,
 'response_received_count': 11,
 'scheduler/dequeued': 74,
 'scheduler/dequeued/memory': 74,
 'scheduler/enqueued': 74,
 'scheduler/enqueued/memory': 74,
 'scrape_type/new': 63,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 11,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 6.043597627515821,
 'scrapy-zyte-api/mean_response_seconds': 6.299580538941717,
 'scrapy-zyte-api/processed': 11,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 11,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 10,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 11,
 'scrapy-zyte-api/request_args/httpRequestBody': 11,
 'scrapy-zyte-api/request_args/httpRequestMethod': 11,
 'scrapy-zyte-api/request_args/httpResponseBody': 11,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 11,
 'scrapy-zyte-api/request_args/url': 11,
 'scrapy-zyte-api/status_codes/200': 11,
 'scrapy-zyte-api/success': 11,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 25, 16, 13, 29, 883225, tzinfo=datetime.timezone.utc)}
2026-03-25 16:14:23 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-25 16:14:23 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8357d83490>
2026-03-25 16:14:23 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8357d83d10>