2026-03-25 17:05:54 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 17:05:54 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 17:05:54 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-25 17:05:54 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-25 17:05:54 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-25 17:05:54 [auto_selling_autotrader.co.uk] INFO: _job: df51bec4286c11f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-25 17:05:54 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 17:05:54 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 17:05:54 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 17:05:54 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 17:05:54 [scrapy.extensions.telnet] INFO: Telnet Password: adfd9ae8e846ba57
2026-03-25 17:05:54 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-25 17:05:54 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/df51bec4286c11f18f76c264925fbcfa.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-25 17:05:54 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 17:05:54 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 17:05:54 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 17:05:54 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-25 17:05:54 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 17:05:54 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-25 17:05:54 [scrapy.core.engine] INFO: Spider opened
2026-03-25 17:05:54 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 17:05:54 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-25 17:05:54 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-25 17:05:54 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 17:05:54 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-25 17:05:54 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-25 17:05:54 [scrapy-playwright] INFO: Starting download handler
2026-03-25 17:05:54 [scrapy-playwright] INFO: Starting download handler
2026-03-25 17:05:59 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 10043638 and multipost_profile_id: ff949942-b32c-46ec-836b-74ab6bf44526 and job_id: df51bec4286c11f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/paxton-motors-10043638
2026-03-25 17:05:59 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10043638, page: 1
2026-03-25 17:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Page: 1/2, total results: 32
2026-03-25 17:06:01 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-25 17:06:01 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230938132%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230938132: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210899285%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210899285: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210899140%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210899140: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160752134%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160752134: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140708890%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603140708890: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130686686%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130686686: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120642389%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120642389: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120641915%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603120641915: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110617424%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110617424: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050450511%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050450511: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050447271%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050447271: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040411519%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040411519: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040410664%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040410664: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260240071%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260240071: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260240035%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260240035: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240161978%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602240161978: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230154891%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230154891: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200089393%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200089393: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602170006754%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602170006754: 1
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199249903%27 HTTP/1.1" 200 None
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601199249903: 1
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 17:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-25 17:06:01 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 10043638, page: 2
2026-03-25 17:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3719a84a-690d-541a-bf03-45b89a936f9f with identifier: 202603230938132
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3719a84a-690d-541a-bf03-45b89a936f9f
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F685c0f4f371243479803971b20d26e0f.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/685c0f4f371243479803971b20d26e0f.jpg not downloaded yet
2026-03-25 17:06:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7334c1a3-d7f7-53fd-bcaf-fd173e266dc1 with identifier: 202603210899285
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7334c1a3-d7f7-53fd-bcaf-fd173e266dc1
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ca8d89faf42413bb7ef4b27c41f6c84.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ca8d89faf42413bb7ef4b27c41f6c84.jpg not downloaded yet
2026-03-25 17:06:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b4cf10e2-d832-52dd-9b6f-1235ddc91b36 with identifier: 202603210899140
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b4cf10e2-d832-52dd-9b6f-1235ddc91b36
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdc25f485f00468e9209691b9aebe9ee.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdc25f485f00468e9209691b9aebe9ee.jpg not downloaded yet
2026-03-25 17:06:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9 with identifier: 202603160752134
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0040e0a92a2c4b2c8090aff750fddbdc.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0040e0a92a2c4b2c8090aff750fddbdc.jpg not downloaded yet
2026-03-25 17:06:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d74eb1cc-1a70-5730-91a9-241ccc81aced with identifier: 202603140708890
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d74eb1cc-1a70-5730-91a9-241ccc81aced
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40a6ec9241a04e4399fbb49664a5e81b.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40a6ec9241a04e4399fbb49664a5e81b.jpg not downloaded yet
2026-03-25 17:06:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ea7d4ef4-2aae-524d-a901-a66eaca522d4 with identifier: 202603130686686
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ea7d4ef4-2aae-524d-a901-a66eaca522d4
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F817670bc7dd243be9d45452b64706530.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/817670bc7dd243be9d45452b64706530.jpg not downloaded yet
2026-03-25 17:06:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7346a7f2-c534-5ad9-9306-309167f2eac1 with identifier: 202603120642389
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7346a7f2-c534-5ad9-9306-309167f2eac1
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4f37cdd54b348539c7fcc7c7a8b6028.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4f37cdd54b348539c7fcc7c7a8b6028.jpg not downloaded yet
2026-03-25 17:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:03 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:03 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b with identifier: 202603120641915
2026-03-25 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b
2026-03-25 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc9dfd9a3c4044bc879404b6c49eb5d9.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc9dfd9a3c4044bc879404b6c49eb5d9.jpg not downloaded yet
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f53ecdef-111e-5382-8ce5-71b746d67ba9 with identifier: 202603110617424
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f53ecdef-111e-5382-8ce5-71b746d67ba9
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90e8f27af9c243df8a5bafac8dcfac93.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90e8f27af9c243df8a5bafac8dcfac93.jpg not downloaded yet
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f with identifier: 202603050450511
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9fce1a8f4e0d46bc947074ad7462b2e6.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9fce1a8f4e0d46bc947074ad7462b2e6.jpg not downloaded yet
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 64dd948e-d37a-5819-bd51-cdca53c9cb66 with identifier: 202603050447271
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 64dd948e-d37a-5819-bd51-cdca53c9cb66
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1581b582ac584ed39fcb09440ee0a8a9.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1581b582ac584ed39fcb09440ee0a8a9.jpg not downloaded yet
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: afcfe50d-daf6-5350-8044-75c9110f5049 with identifier: 202603040411519
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item afcfe50d-daf6-5350-8044-75c9110f5049
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68ae3d79ad2f460eb36c1e236d3219a8.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68ae3d79ad2f460eb36c1e236d3219a8.jpg not downloaded yet
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c92131b5-1760-5b82-a03f-e29e9a91de5f with identifier: 202603040410664
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c92131b5-1760-5b82-a03f-e29e9a91de5f
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a313b7dee914cbb8912bafad2a7fd09.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a313b7dee914cbb8912bafad2a7fd09.jpg not downloaded yet
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f4de8a8-5c3c-5f51-ab3b-46208915600b with identifier: 202602260240071
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0f4de8a8-5c3c-5f51-ab3b-46208915600b
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63ce6f765dee472abfbc15266f700dd0.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63ce6f765dee472abfbc15266f700dd0.jpg not downloaded yet
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cdc25f485f00468e9209691b9aebe9ee.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4ca8d89faf42413bb7ef4b27c41f6c84.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/685c0f4f371243479803971b20d26e0f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8df74ecb-1e2e-5a24-a477-656b21e96b4e with identifier: 202602260240035
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8df74ecb-1e2e-5a24-a477-656b21e96b4e
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed8b56a1085b4dfda2b9e3b8cdcb4118.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed8b56a1085b4dfda2b9e3b8cdcb4118.jpg not downloaded yet
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 803cbe99-c547-569b-9fbb-8e6abd29eaa5 with identifier: 202602240161978
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 803cbe99-c547-569b-9fbb-8e6abd29eaa5
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8ff4f202d604d5da64b0d3b0ae05c36.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8ff4f202d604d5da64b0d3b0ae05c36.jpg not downloaded yet
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/817670bc7dd243be9d45452b64706530.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 52eddf75-13fa-5633-a079-c3eb712d7a47 with identifier: 202602230154891
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 52eddf75-13fa-5633-a079-c3eb712d7a47
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79a72c68b5dc48b8b8540cd6e00e35af.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79a72c68b5dc48b8b8540cd6e00e35af.jpg not downloaded yet
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/40a6ec9241a04e4399fbb49664a5e81b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 68fe2fce-4697-5844-bc70-f176c3dc2dac with identifier: 202602200089393
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 68fe2fce-4697-5844-bc70-f176c3dc2dac
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8706199b47f744b09b0e342724200818.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8706199b47f744b09b0e342724200818.jpg not downloaded yet
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Page: 2/2, total results: 32
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601129088905%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601129088905: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601099039680%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601099039680: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127845225%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511127845225: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127837893%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511127837893: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510137118195%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202510137118195: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509276686221%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509276686221: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509206500419%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202509206500419: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507054203683%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202507054203683: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202504051008568%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202504051008568: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202502279572139%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202502279572139: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202502219360324%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202502219360324: 1
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202501218256291%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202501218256291: 1
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bfbc8f-ac9e-5179-81aa-73bda29f5b07 with identifier: 202602170006754
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 73bfbc8f-ac9e-5179-81aa-73bda29f5b07
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f76f38fed7c44519bcac3e46c7c6124.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f76f38fed7c44519bcac3e46c7c6124.jpg not downloaded yet
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0040e0a92a2c4b2c8090aff750fddbdc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/90e8f27af9c243df8a5bafac8dcfac93.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/68ae3d79ad2f460eb36c1e236d3219a8.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0a313b7dee914cbb8912bafad2a7fd09.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 2 detail requests (batch 2)
2026-03-25 17:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1581b582ac584ed39fcb09440ee0a8a9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:04 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fb67bb0-2aa4-5214-9dbd-278d7224671d with identifier: 202601199249903
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9fb67bb0-2aa4-5214-9dbd-278d7224671d
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60f69973da9944689d1c7740350ba800.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60f69973da9944689d1c7740350ba800.jpg not downloaded yet
2026-03-25 17:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 17:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 17:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42e2335510>
2026-03-25 17:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4cf10e2-d832-52dd-9b6f-1235ddc91b36/b4cf10e2-d832-52dd-9b6f-1235ddc91b36_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcdc25f485f00468e9209691b9aebe9ee.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cdc25f485f00468e9209691b9aebe9ee.jpg saved to cache
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4cf10e2-d832-52dd-9b6f-1235ddc91b36
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4cf10e2-d832-52dd-9b6f-1235ddc91b36 sending to next pipeline
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc3743d0>
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7334c1a3-d7f7-53fd-bcaf-fd173e266dc1/7334c1a3-d7f7-53fd-bcaf-fd173e266dc1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ca8d89faf42413bb7ef4b27c41f6c84.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ca8d89faf42413bb7ef4b27c41f6c84.jpg saved to cache
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7334c1a3-d7f7-53fd-bcaf-fd173e266dc1
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7334c1a3-d7f7-53fd-bcaf-fd173e266dc1 sending to next pipeline
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc382a90>
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3719a84a-690d-541a-bf03-45b89a936f9f/3719a84a-690d-541a-bf03-45b89a936f9f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F685c0f4f371243479803971b20d26e0f.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/685c0f4f371243479803971b20d26e0f.jpg saved to cache
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3719a84a-690d-541a-bf03-45b89a936f9f
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3719a84a-690d-541a-bf03-45b89a936f9f sending to next pipeline
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc36fc10>
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d4ef4-2aae-524d-a901-a66eaca522d4/ea7d4ef4-2aae-524d-a901-a66eaca522d4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F817670bc7dd243be9d45452b64706530.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/817670bc7dd243be9d45452b64706530.jpg saved to cache
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea7d4ef4-2aae-524d-a901-a66eaca522d4
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea7d4ef4-2aae-524d-a901-a66eaca522d4 sending to next pipeline
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc35db90>
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d74eb1cc-1a70-5730-91a9-241ccc81aced/d74eb1cc-1a70-5730-91a9-241ccc81aced_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F40a6ec9241a04e4399fbb49664a5e81b.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/40a6ec9241a04e4399fbb49664a5e81b.jpg saved to cache
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d74eb1cc-1a70-5730-91a9-241ccc81aced
2026-03-25 17:06:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d74eb1cc-1a70-5730-91a9-241ccc81aced sending to next pipeline
2026-03-25 17:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/bc9dfd9a3c4044bc879404b6c49eb5d9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b4cf10e2-d832-52dd-9b6f-1235ddc91b36 with identifier 202603210899140
2026-03-25 17:06:05 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-25 17:06:05 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 17:06:05 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 17:06:05 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:05 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-25 17:06:05 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2022
2026-03-25 17:06:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774458365
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774458365
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b4cf10e2-d832-52dd-9b6f-1235ddc91b36
2026-03-25 17:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cdc25f485f00468e9209691b9aebe9ee.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Red',
'currency': 'GBP',
'description': 'This 2015 Ford Fiesta ST-2 boasts exceptionally low mileage '
'for its age, having covered just 33,000 miles. This '
'particular example has had only two owners and comes with a '
'full documented dealership service history, with the last '
'service completed on 2026-03-13 at 33,005 miles. A clear '
'vehicle history check provides further peace of mind, and it '
'will be supplied with a 12 month MOT. This 1.6L petrol Euro 6 '
'compliant model also features manual air conditioning, heated '
'driver and passenger seats, and Bluetooth hands free phone '
'connectivity. A 3 month warranty is included for your '
'assurance, with extension options available.\n'
'\n'
'The performance of this Fiesta ST-2 is a standout feature, '
'with an impressive 0-62mph acceleration time of just 6.9 '
'seconds. This brisk acceleration indicates a more dynamic '
'driving experience compared to many other vehicles in its '
'class. Combined with its comprehensive service history and '
'low ownership, this Fiesta ST-2 represents a well maintained '
'and engaging option for any driver.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 180,
'fuel_type': 'Petrol',
'id': 'b4cf10e2-d832-52dd-9b6f-1235ddc91b36',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210899140',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 33000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4cf10e2-d832-52dd-9b6f-1235ddc91b36/b4cf10e2-d832-52dd-9b6f-1235ddc91b36_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64269,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cdc25f485f00468e9209691b9aebe9ee.jpg',
'Width': 1024}],
'price': 9900,
'price_includes_vat': True,
'registration_date': '2015-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.6T EcoBoost ST-2 Euro 6 3dr',
'transmission': 'manual',
'trim': 'ST-2',
'year': 2015}
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210899140%27 HTTP/1.1" 200 None
2026-03-25 17:06:05 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210899140: {'created_time': 1774458365.923047, 'last_price_update_time': 1774458365.923058}
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210899140') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7334c1a3-d7f7-53fd-bcaf-fd173e266dc1 with identifier 202603210899285
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7334c1a3-d7f7-53fd-bcaf-fd173e266dc1
2026-03-25 17:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4ca8d89faf42413bb7ef4b27c41f6c84.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'Blue',
'currency': 'GBP',
'description': 'This 2009 Ford Fiesta Titanium boasts a full service history '
'and a clear vehicle history check, offering you peace of '
'mind. Powered by a reliable 1.4 litre petrol engine, this '
'popular model comes with a 3 month warranty for added '
'security. You will also receive 12 months MOT upon purchase, '
'ensuring its roadworthiness.\n'
'\n'
'The Titanium trim level of this Fiesta includes a range of '
'desirable features, making it stand out from other vehicles '
'in its class. Its low insurance group rating is a significant '
'advantage, contributing to lower running costs. This well '
'maintained Ford Fiesta Titanium is a practical and economical '
'choice for everyday driving. In',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.4L',
'engine_horse_power': 94,
'fuel_type': 'Petrol',
'id': '7334c1a3-d7f7-53fd-bcaf-fd173e266dc1',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210899285',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 88000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7334c1a3-d7f7-53fd-bcaf-fd173e266dc1/7334c1a3-d7f7-53fd-bcaf-fd173e266dc1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71316,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ca8d89faf42413bb7ef4b27c41f6c84.jpg',
'Width': 1024}],
'price': 3999,
'price_includes_vat': True,
'registration_date': '2009-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Titanium 5dr',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2009}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210899285%27 HTTP/1.1" 200 None
2026-03-25 17:06:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210899285: {'created_time': 1774458366.394776, 'last_price_update_time': 1774458366.394784}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210899285') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3719a84a-690d-541a-bf03-45b89a936f9f with identifier 202603230938132
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3719a84a-690d-541a-bf03-45b89a936f9f
2026-03-25 17:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/685c0f4f371243479803971b20d26e0f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': 'Benefit from the peace of mind offered by a full service '
'history and a clear vehicle history check on this 2016 Ford '
'Fiesta T Zetec S. This well maintained example is powered by '
'an efficient 1.0L Petrol engine, meeting Euro 6 emissions '
'standards. It comes equipped with a Ford Navigation System '
'featuring DAB radio and Ford SYNC, along with Bluetooth hands '
'free connectivity for seamless calls and music streaming. '
'Enjoy added comfort and style with manual air conditioning, '
'rear privacy glass, and striking 17 inch alloy wheels.\n'
'\n'
'This Fiesta Zetec S offers impressive performance, '
'accelerating from 0 to 62mph in just 9.4 seconds, '
'demonstrating its capability. Its fuel economy is a standout '
'feature, achieving an excellent 66 mpg, and it also boasts '
'low CO2 emissions, making it an economical choice. A 12 month '
'MOT will be provided on purchase, and the vehicle is covered '
'by a 3 month warranty, ensuring your confidence in this well '
'presented and capable Ford Fiesta.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '3719a84a-690d-541a-bf03-45b89a936f9f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230938132',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 97000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3719a84a-690d-541a-bf03-45b89a936f9f/3719a84a-690d-541a-bf03-45b89a936f9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58122,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/685c0f4f371243479803971b20d26e0f.jpg',
'Width': 1024}],
'price': 3900,
'price_includes_vat': True,
'registration_date': '2016-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost Zetec S Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'Zetec S',
'year': 2016}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230938132%27 HTTP/1.1" 200 None
2026-03-25 17:06:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230938132: {'created_time': 1774458366.443127, 'last_price_update_time': 1774458366.443137}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230938132') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ea7d4ef4-2aae-524d-a901-a66eaca522d4 with identifier 202603130686686
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ea7d4ef4-2aae-524d-a901-a66eaca522d4
2026-03-25 17:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/817670bc7dd243be9d45452b64706530.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2011 Ford Ka Titanium presents a superb ownership '
'proposition with its remarkably low mileage of just 65,000 '
'miles for its age. This particular Ka is powered by an '
'efficient 1.2 litre petrol engine and comes with a clear '
'vehicle history check, a full service history, and a 3 month '
'warranty for your peace of mind. Furthermore, it will be '
'supplied with 12 months MOT upon purchase, ensuring its '
'roadworthiness.\n'
'\n'
'The Ford Ka Titanium is a smart choice for those seeking '
'economical motoring. Its low insurance group rating means '
'lower running costs, and with an impressive fuel economy of '
'55 miles per gallon, it is exceptionally kind to your wallet. '
'The low CO2 emissions also contribute to its appeal, making '
'it a more environmentally conscious option compared to many '
'other vehicles in its class.',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1.2L',
'engine_horse_power': 68,
'fuel_type': 'Petrol',
'id': 'ea7d4ef4-2aae-524d-a901-a66eaca522d4',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130686686',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Ka',
'odometer': 65000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d4ef4-2aae-524d-a901-a66eaca522d4/ea7d4ef4-2aae-524d-a901-a66eaca522d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57632,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/817670bc7dd243be9d45452b64706530.jpg',
'Width': 1024}],
'price': 2490,
'price_includes_vat': True,
'registration_date': '2011-03-16',
'seats_number': 4,
'seller_name': None,
'title': 'Ford KA 1.2 Titanium Euro 5 3dr',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130686686%27 HTTP/1.1" 200 None
2026-03-25 17:06:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130686686: {'created_time': 1774458366.489042, 'last_price_update_time': 1774458366.48905}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130686686') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d74eb1cc-1a70-5730-91a9-241ccc81aced with identifier 202603140708890
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d74eb1cc-1a70-5730-91a9-241ccc81aced
2026-03-25 17:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/40a6ec9241a04e4399fbb49664a5e81b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Grey',
'currency': 'GBP',
'description': 'Boasting exceptionally low mileage for its age, this 2014 '
'Ford Fiesta Titanium presents a remarkable find. With only '
'30,000 miles on the clock and a clear vehicle history check, '
'this petrol model benefits from a full service history, '
'ensuring its provenance is in excellent order. The Titanium '
'trim level offers a refined driving experience, complemented '
'by a 1.6 litre engine that provides a responsive 0-62mph time '
'of 10.5 seconds.\n'
'\n'
'This Fiesta Titanium is equipped with desirable features that '
'enhance its practicality and comfort. The City Pack includes '
'rear parking assistance, making urban manoeuvring easier, '
'while automatic headlights and electronic automatic '
'temperature control provide added convenience. Furthermore, '
'its low insurance group rating indicates that running costs '
'are kept to a minimum, making it an economical choice. A 3 '
'month warranty and 12 months MOT provided on purchase offer '
'peace of mind for the new owner.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Petrol',
'id': 'd74eb1cc-1a70-5730-91a9-241ccc81aced',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603140708890',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 30000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d74eb1cc-1a70-5730-91a9-241ccc81aced/d74eb1cc-1a70-5730-91a9-241ccc81aced_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59894,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/40a6ec9241a04e4399fbb49664a5e81b.jpg',
'Width': 1024}],
'price': 8400,
'price_includes_vat': True,
'registration_date': '2014-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.6 Titanium Powershift Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2014}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140708890%27 HTTP/1.1" 200 None
2026-03-25 17:06:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603140708890: {'created_time': 1774458366.552865, 'last_price_update_time': 1774458366.552875}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603140708890') HTTP/1.1" 204 0
2026-03-25 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c4f37cdd54b348539c7fcc7c7a8b6028.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/63ce6f765dee472abfbc15266f700dd0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/b8ff4f202d604d5da64b0d3b0ae05c36.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ed8b56a1085b4dfda2b9e3b8cdcb4118.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9fce1a8f4e0d46bc947074ad7462b2e6.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc45cd90>
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9/37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0040e0a92a2c4b2c8090aff750fddbdc.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0040e0a92a2c4b2c8090aff750fddbdc.jpg saved to cache
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9 sending to next pipeline
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc4cfc90>
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53ecdef-111e-5382-8ce5-71b746d67ba9/f53ecdef-111e-5382-8ce5-71b746d67ba9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90e8f27af9c243df8a5bafac8dcfac93.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90e8f27af9c243df8a5bafac8dcfac93.jpg saved to cache
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f53ecdef-111e-5382-8ce5-71b746d67ba9
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f53ecdef-111e-5382-8ce5-71b746d67ba9 sending to next pipeline
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc4302d0>
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afcfe50d-daf6-5350-8044-75c9110f5049/afcfe50d-daf6-5350-8044-75c9110f5049_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F68ae3d79ad2f460eb36c1e236d3219a8.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/68ae3d79ad2f460eb36c1e236d3219a8.jpg saved to cache
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afcfe50d-daf6-5350-8044-75c9110f5049
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afcfe50d-daf6-5350-8044-75c9110f5049 sending to next pipeline
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc427b10>
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c92131b5-1760-5b82-a03f-e29e9a91de5f/c92131b5-1760-5b82-a03f-e29e9a91de5f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a313b7dee914cbb8912bafad2a7fd09.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a313b7dee914cbb8912bafad2a7fd09.jpg saved to cache
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c92131b5-1760-5b82-a03f-e29e9a91de5f
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c92131b5-1760-5b82-a03f-e29e9a91de5f sending to next pipeline
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc4bc210>
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64dd948e-d37a-5819-bd51-cdca53c9cb66/64dd948e-d37a-5819-bd51-cdca53c9cb66_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1581b582ac584ed39fcb09440ee0a8a9.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1581b582ac584ed39fcb09440ee0a8a9.jpg saved to cache
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64dd948e-d37a-5819-bd51-cdca53c9cb66
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64dd948e-d37a-5819-bd51-cdca53c9cb66 sending to next pipeline
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc437350>
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b/39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbc9dfd9a3c4044bc879404b6c49eb5d9.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bc9dfd9a3c4044bc879404b6c49eb5d9.jpg saved to cache
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b
2026-03-25 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b sending to next pipeline
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9 with identifier 202603160752134
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9
2026-03-25 17:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0040e0a92a2c4b2c8090aff750fddbdc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': '*NEW WETBELT FITTED* This 2017 Ford Fiesta Zetec T Zetec '
'boasts a full service history, ensuring excellent provenance '
'for this popular model. It features a responsive 1.0L petrol '
"engine and meets Euro 6 emissions standards. You'll find it "
'equipped with a Ford Navigation System complete with DAB '
'radio and Ford SYNC, along with Bluetooth handsfree '
'connectivity. Comfort and style are enhanced by the rear '
'privacy glass and 16 inch multi spoke alloy wheels, all part '
'of the appealing Zetec trim.\n'
'\n'
'This Fiesta is designed for efficiency, achieving an '
'impressive 66 miles per gallon, which is a significant '
'advantage for your running costs compared to many other '
'vehicles. Its low CO2 emissions further contribute to its '
'economical and environmentally conscious profile. To provide '
'peace of mind, this vehicle comes with a 3 month warranty and '
'will have a 12 month MOT provided upon purchase, '
'demonstrating its roadworthiness.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': '37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160752134',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 66000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9/37fa4192-f2f8-5d54-a897-4dc3ee5cc3c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69222,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0040e0a92a2c4b2c8090aff750fddbdc.jpg',
'Width': 1024}],
'price': 4894,
'price_includes_vat': True,
'registration_date': '2017-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost Zetec Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2017}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160752134%27 HTTP/1.1" 200 None
2026-03-25 17:06:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160752134: {'created_time': 1774458366.907486, 'last_price_update_time': 1774458366.907495}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160752134') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f53ecdef-111e-5382-8ce5-71b746d67ba9 with identifier 202603110617424
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f53ecdef-111e-5382-8ce5-71b746d67ba9
2026-03-25 17:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/90e8f27af9c243df8a5bafac8dcfac93.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2019 Ford Fiesta ST Line boasts a full service history '
'and a clear vehicle history check, offering you peace of '
'mind. This T ST Line model is equipped with a 1.0L petrol '
'engine and meets Euro 6 emissions standards, contributing to '
'its low CO2 emissions. For your convenience, it comes with a '
'3 month warranty and a 12 month MOT provided on purchase. '
'Notable features include the NCAP Pack with automatic '
'headlights, Ford SYNC with a touchscreen offering DAB radio, '
'Apple CarPlay, and Android Auto, as well as manual air '
'conditioning.\n'
'\n'
'Experience responsive performance with this Fiesta, achieving '
'0-62mph in just 10.0 seconds. These highlights demonstrate '
'how this particular Ford Fiesta ST Line stands out from other '
'similar vehicles, offering a well maintained and feature rich '
'driving experience.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': 'f53ecdef-111e-5382-8ce5-71b746d67ba9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110617424',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 75000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53ecdef-111e-5382-8ce5-71b746d67ba9/f53ecdef-111e-5382-8ce5-71b746d67ba9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55699,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/90e8f27af9c243df8a5bafac8dcfac93.jpg',
'Width': 1024}],
'price': 6990,
'price_includes_vat': True,
'registration_date': '2019-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost ST-Line Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2019}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110617424%27 HTTP/1.1" 200 None
2026-03-25 17:06:06 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110617424: {'created_time': 1774458366.96134, 'last_price_update_time': 1774458366.961352}
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110617424') HTTP/1.1" 204 0
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: afcfe50d-daf6-5350-8044-75c9110f5049 with identifier 202603040411519
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:06 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item afcfe50d-daf6-5350-8044-75c9110f5049
2026-03-25 17:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/68ae3d79ad2f460eb36c1e236d3219a8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'White',
'currency': 'GBP',
'description': '*NEW TIMING BELT* This 2015 Ford Fiesta Titanium boasts a '
'full service history and a clear vehicle history check, '
'offering you peace of mind. This popular hatchback is '
'equipped with a 1.0L petrol engine and meets Euro 6 emissions '
'standards. Key features include the City Pack with rear '
'parking assistance, the Convenience Pack for keyless entry, '
"and automatic headlights. Inside, you'll find Electronic "
'Automatic Temperature Control for climate comfort and '
'Bluetooth hands free for seamless connectivity.\n'
'\n'
'The Ford Fiesta Titanium stands out with its impressive fuel '
'economy, achieving up to 66 miles per gallon, and its low CO2 '
'emissions. These highlights demonstrate its efficiency and '
'cost effectiveness compared to other vehicles in its class. A '
'12 month MOT will be provided on purchase, and the vehicle '
'comes with a 3 month warranty, ensuring your continued '
'satisfaction with this well maintained Fiesta.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': 'afcfe50d-daf6-5350-8044-75c9110f5049',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040411519',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 84000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afcfe50d-daf6-5350-8044-75c9110f5049/afcfe50d-daf6-5350-8044-75c9110f5049_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58521,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/68ae3d79ad2f460eb36c1e236d3219a8.jpg',
'Width': 1024}],
'price': 4200,
'price_includes_vat': True,
'registration_date': '2015-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost Titanium Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040411519%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040411519: {'created_time': 1774458367.010886, 'last_price_update_time': 1774458367.010896}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040411519') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c92131b5-1760-5b82-a03f-e29e9a91de5f with identifier 202603040410664
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c92131b5-1760-5b82-a03f-e29e9a91de5f
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0a313b7dee914cbb8912bafad2a7fd09.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'White',
'currency': 'GBP',
'description': '“CHAIN DRIVEN NOT WETBELT” This 2019 Ford Focus Zetec T '
'benefits from a full service history, ensuring its provenance '
'is well documented. This popular hatchback is equipped with a '
'1.0 litre petrol engine and meets Euro 6 emission standards. '
'Notable features include automatic headlights for convenience '
'and the Ford SYNC3 DAB radio system, complete with a 6.5 inch '
'touchscreen that supports both Android Auto and Apple '
'CarPlay, allowing seamless integration of your smartphone.\n'
'\n'
'You will appreciate the impressive fuel economy of this '
'Focus, achieving up to 53 miles per gallon, which is a '
'significant advantage over many other vehicles. Its low CO2 '
'emissions also contribute to its appeal, and it sits in a low '
'insurance group, making it an economical choice for many '
'drivers. Furthermore, the generous boot space offers '
'practicality for everyday needs and longer journeys. A 12 '
'month MOT will be provided on purchase, and the vehicle comes '
'with a 3 month warranty for your peace of mind.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': 'c92131b5-1760-5b82-a03f-e29e9a91de5f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040410664',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 64000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92131b5-1760-5b82-a03f-e29e9a91de5f/c92131b5-1760-5b82-a03f-e29e9a91de5f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62265,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a313b7dee914cbb8912bafad2a7fd09.jpg',
'Width': 1024}],
'price': 7800,
'price_includes_vat': True,
'registration_date': '2019-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost Zetec Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2019}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040410664%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040410664: {'created_time': 1774458367.063187, 'last_price_update_time': 1774458367.063198}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040410664') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 64dd948e-d37a-5819-bd51-cdca53c9cb66 with identifier 202603050447271
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 64dd948e-d37a-5819-bd51-cdca53c9cb66
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1581b582ac584ed39fcb09440ee0a8a9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2018 Ford Focus TDCi ST-3 boasts a full service history '
'and a clear vehicle history check, offering you peace of '
'mind. This particular model is equipped with the desirable '
'Driver Assistance Pack, featuring Active City Stop for '
'enhanced safety, and the ST Style Pack for a more striking '
"appearance. You'll also appreciate the convenience of the "
'Ford KeyFree System, allowing for keyless entry, and the '
'sporty feel of the paddle shift gear selection.\n'
'\n'
'Experience impressive performance with this Focus, capable of '
'accelerating from 0 to 62mph in just 7.8 seconds, a speed '
'that indicates its capability compared to similar vehicles. '
'Furthermore, its fuel economy is a standout feature, '
'achieving an excellent 61 mpg, demonstrating its efficiency. '
'This Euro 6 compliant diesel engine ensures it meets modern '
'emission standards. The vehicle comes with a 3 month warranty '
'and a 12 month MOT provided on purchase, further enhancing '
'its appeal.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 182,
'fuel_type': 'Diesel',
'id': '64dd948e-d37a-5819-bd51-cdca53c9cb66',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050447271',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 103000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64dd948e-d37a-5819-bd51-cdca53c9cb66/64dd948e-d37a-5819-bd51-cdca53c9cb66_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66021,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1581b582ac584ed39fcb09440ee0a8a9.jpg',
'Width': 1024}],
'price': 9990,
'price_includes_vat': True,
'registration_date': '2018-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi ST-3 Powershift Euro 6 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'ST-3',
'year': 2018}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050447271%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050447271: {'created_time': 1774458367.112312, 'last_price_update_time': 1774458367.11232}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050447271') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b with identifier 202603120641915
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/bc9dfd9a3c4044bc879404b6c49eb5d9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'White',
'currency': 'GBP',
'description': 'This 2015 Ford Ka Zetec White Edition offers exceptional '
'value with its remarkably low mileage of just 44,000 miles '
'and a full service history. This particular Ka is a Euro 6 '
'compliant model, powered by an efficient 1.2 litre petrol '
'engine. It comes with a clear vehicle history check and will '
'be supplied with 12 months MOT for your peace of mind, '
'alongside a 3 month warranty. Notable features include rear '
'parking sensors for easier manoeuvring, manual air '
'conditioning to keep you comfortable, and Bluetooth '
'hands-free phone connectivity for safe and convenient calls '
'on the go.\n'
'\n'
'The Ford Ka Zetec White Edition stands out from similar '
'vehicles thanks to its impressive fuel economy, achieving an '
'excellent 58 miles per gallon. This, combined with its low '
'CO2 emissions and low insurance group rating, makes it a very '
'economical choice for everyday driving. The low mileage for '
'its age further enhances its appeal, suggesting it has been '
'well cared for and is ready for many more miles of reliable '
'service.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 68,
'fuel_type': 'Petrol',
'id': '39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120641915',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Ka',
'odometer': 44000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b/39b4cc2c-472a-5f41-afb6-b6a8fefe5e1b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115321,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bc9dfd9a3c4044bc879404b6c49eb5d9.jpg',
'Width': 1024}],
'price': 4995,
'price_includes_vat': True,
'registration_date': '2015-08-17',
'seats_number': 4,
'seller_name': None,
'title': 'Ford KA 1.2 Zetec White Edition Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'Zetec White Edition',
'year': 2015}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120641915%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120641915: {'created_time': 1774458367.16105, 'last_price_update_time': 1774458367.161059}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120641915') HTTP/1.1" 204 0
2026-03-25 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5f76f38fed7c44519bcac3e46c7c6124.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/60f69973da9944689d1c7740350ba800.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc425410>
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7346a7f2-c534-5ad9-9306-309167f2eac1/7346a7f2-c534-5ad9-9306-309167f2eac1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4f37cdd54b348539c7fcc7c7a8b6028.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4f37cdd54b348539c7fcc7c7a8b6028.jpg saved to cache
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7346a7f2-c534-5ad9-9306-309167f2eac1
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7346a7f2-c534-5ad9-9306-309167f2eac1 sending to next pipeline
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dcf570d0>
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f4de8a8-5c3c-5f51-ab3b-46208915600b/0f4de8a8-5c3c-5f51-ab3b-46208915600b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F63ce6f765dee472abfbc15266f700dd0.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/63ce6f765dee472abfbc15266f700dd0.jpg saved to cache
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f4de8a8-5c3c-5f51-ab3b-46208915600b
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f4de8a8-5c3c-5f51-ab3b-46208915600b sending to next pipeline
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc5a0890>
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_803cbe99-c547-569b-9fbb-8e6abd29eaa5/803cbe99-c547-569b-9fbb-8e6abd29eaa5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8ff4f202d604d5da64b0d3b0ae05c36.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8ff4f202d604d5da64b0d3b0ae05c36.jpg saved to cache
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 803cbe99-c547-569b-9fbb-8e6abd29eaa5
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 803cbe99-c547-569b-9fbb-8e6abd29eaa5 sending to next pipeline
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dcf55650>
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8df74ecb-1e2e-5a24-a477-656b21e96b4e/8df74ecb-1e2e-5a24-a477-656b21e96b4e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed8b56a1085b4dfda2b9e3b8cdcb4118.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed8b56a1085b4dfda2b9e3b8cdcb4118.jpg saved to cache
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8df74ecb-1e2e-5a24-a477-656b21e96b4e
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8df74ecb-1e2e-5a24-a477-656b21e96b4e sending to next pipeline
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc36fe50>
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f/1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9fce1a8f4e0d46bc947074ad7462b2e6.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9fce1a8f4e0d46bc947074ad7462b2e6.jpg saved to cache
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f sending to next pipeline
2026-03-25 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/79a72c68b5dc48b8b8540cd6e00e35af.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7346a7f2-c534-5ad9-9306-309167f2eac1 with identifier 202603120642389
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7346a7f2-c534-5ad9-9306-309167f2eac1
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c4f37cdd54b348539c7fcc7c7a8b6028.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'White',
'currency': 'GBP',
'description': 'This 2014 Ford Fiesta Titanium boasts exceptionally low '
'mileage for its age, having covered just 46,000 miles. This '
'well maintained example comes with a full service history and '
'a clear vehicle history check, ensuring peace of mind. The '
'1.6 litre petrol engine offers a responsive drive, achieving '
'0-62mph in 10.5 seconds. As a Titanium model, it includes '
'desirable features such as the City Pack with rear parking '
'assistance, Electronic Automatic Temperature Control for '
'effortless climate management, and automatic headlights that '
'switch on when needed.\n'
'\n'
'Further enhancing its appeal, this Fiesta Titanium is in a '
'low insurance group, making it an economical choice for many '
'drivers. The 12 months MOT provided on purchase and a 3 month '
'warranty offer additional reassurance. These factors, '
'combined with its efficient performance and comfortable '
'features, demonstrate why this particular Ford Fiesta stands '
'out from other vehicles in its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Petrol',
'id': '7346a7f2-c534-5ad9-9306-309167f2eac1',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603120642389',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 46000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7346a7f2-c534-5ad9-9306-309167f2eac1/7346a7f2-c534-5ad9-9306-309167f2eac1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420221,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c4f37cdd54b348539c7fcc7c7a8b6028.jpg',
'Width': 2048}],
'price': 7500,
'price_includes_vat': True,
'registration_date': '2014-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.6 Titanium Powershift Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2014}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603120642389%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603120642389: {'created_time': 1774458367.533135, 'last_price_update_time': 1774458367.533143}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603120642389') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0f4de8a8-5c3c-5f51-ab3b-46208915600b with identifier 202602260240071
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0f4de8a8-5c3c-5f51-ab3b-46208915600b
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/63ce6f765dee472abfbc15266f700dd0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'Black',
'currency': 'GBP',
'description': '‘NEW TIMING BELT’ £20 TAX This 2015 Ford Fiesta Titanium '
'boasts a full service history and a clear vehicle history '
'check, offering you peace of mind. This popular hatchback is '
'equipped with a 1.0 litre petrol engine and meets Euro 6 '
"emissions standards. Inside, you'll find Electronic Automatic "
'Temperature Control for effortless climate management, '
'automatic headlights for convenience, and Bluetooth '
'hands-free connectivity for safe and easy communication on '
'the go.\n'
'\n'
'The Ford Fiesta Titanium stands out with its impressive fuel '
'economy, achieving up to 66 miles per gallon, which is a '
'significant advantage for your running costs. Its low CO2 '
'emissions also contribute to its appeal. This vehicle comes '
'with a 3 month warranty and a 12 month MOT provided on '
'purchase, ensuring it is ready for the road ahead.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': '0f4de8a8-5c3c-5f51-ab3b-46208915600b',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260240071',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 90000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f4de8a8-5c3c-5f51-ab3b-46208915600b/0f4de8a8-5c3c-5f51-ab3b-46208915600b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60578,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/63ce6f765dee472abfbc15266f700dd0.jpg',
'Width': 1024}],
'price': 3990,
'price_includes_vat': True,
'registration_date': '2015-09-02',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost Titanium Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260240071%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260240071: {'created_time': 1774458367.575667, 'last_price_update_time': 1774458367.575679}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260240071') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 803cbe99-c547-569b-9fbb-8e6abd29eaa5 with identifier 202602240161978
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 803cbe99-c547-569b-9fbb-8e6abd29eaa5
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/b8ff4f202d604d5da64b0d3b0ae05c36.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2018 Ford Focus ST-Line X boasts a remarkably low '
'mileage of just 44,000 miles for its age, coupled with a full '
'service history, offering excellent provenance. This 1.0 '
'litre petrol model, meeting Euro 6 emissions standards, comes '
'with a 3 month warranty and a 12 month MOT provided on '
"purchase. Inside, you'll find the Premium Ford SYNC3 DAB "
'Navigation System, automatic headlights, rear parking '
'distance sensors, and DEATC dual zone electronic automatic '
'temperature control, ensuring a comfortable and convenient '
'driving experience.\n'
'\n'
'The Ford Focus ST-Line X stands out with its impressive fuel '
'economy, achieving a highlighted 58 miles per gallon, which '
'is better than many similar vehicles. Its acceleration from '
'0-62mph in 10.4 seconds is also a strong point, and it offers '
'generous boot space for all your needs. Furthermore, its low '
'CO2 emissions are a benefit, making it a more environmentally '
'conscious choice compared to other cars in its class.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': '803cbe99-c547-569b-9fbb-8e6abd29eaa5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602240161978',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 44000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803cbe99-c547-569b-9fbb-8e6abd29eaa5/803cbe99-c547-569b-9fbb-8e6abd29eaa5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71393,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b8ff4f202d604d5da64b0d3b0ae05c36.jpg',
'Width': 1024}],
'price': 9750,
'price_includes_vat': True,
'registration_date': '2018-04-23',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost ST-Line X Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2018}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602240161978%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602240161978: {'created_time': 1774458367.619003, 'last_price_update_time': 1774458367.619014}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240161978') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8df74ecb-1e2e-5a24-a477-656b21e96b4e with identifier 202602260240035
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8df74ecb-1e2e-5a24-a477-656b21e96b4e
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ed8b56a1085b4dfda2b9e3b8cdcb4118.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'Black',
'currency': 'GBP',
'description': 'This 2012 Ford Fiesta Metal is a standout choice, boasting a '
'full service history and remarkably low mileage for its age '
'at just 86,000 miles. This popular hatchback is equipped with '
'a responsive 1.6 litre petrol engine, offering an enjoyable '
'driving experience. You can drive away with confidence, as it '
'comes with a 12 month MOT and a 3 month warranty for your '
'peace of mind.\n'
'\n'
'The Ford Fiesta Metal is known for its appealing design and '
'this particular model benefits from being in a low insurance '
'group, making it an economical option for many drivers. Its '
'comprehensive service history indicates diligent maintenance, '
'and the low mileage further suggests it has been well cared '
'for. This combination of factors makes this Fiesta a '
'compelling proposition for anyone seeking a reliable and '
'affordable used car.',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 133,
'fuel_type': 'Petrol',
'id': '8df74ecb-1e2e-5a24-a477-656b21e96b4e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260240035',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 86000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 4,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8df74ecb-1e2e-5a24-a477-656b21e96b4e/8df74ecb-1e2e-5a24-a477-656b21e96b4e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66597,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed8b56a1085b4dfda2b9e3b8cdcb4118.jpg',
'Width': 1024}],
'price': 3450,
'price_includes_vat': True,
'registration_date': '2012-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.6 Metal 3dr',
'transmission': 'manual',
'trim': 'Metal',
'year': 2012}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260240035%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260240035: {'created_time': 1774458367.661852, 'last_price_update_time': 1774458367.661859}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260240035') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f with identifier 202603050450511
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9fce1a8f4e0d46bc947074ad7462b2e6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2013 Ford Fiesta Titanium boasts an exceptionally low '
'mileage of just 63,000 miles for its age, complemented by a '
'full service history and a clear vehicle history check. This '
'well maintained example features a responsive 1.6 litre '
'petrol engine and comes with a 3 month warranty for your '
'peace of mind. The Titanium trim level includes desirable '
'features such as the City Pack with rear parking assistance, '
'Electronic Automatic Temperature Control for effortless '
'climate control, and automatic headlights that switch on when '
'needed.\n'
'\n'
'The Ford Fiesta Titanium offers a compelling package, with '
'its 0-62mph acceleration in just 10.5 seconds providing a '
'lively driving experience. This particular model also '
'benefits from a low insurance group, making it an economical '
'choice for many drivers. Furthermore, a 12 month MOT will be '
'provided on purchase, ensuring the vehicle is roadworthy and '
'ready for its new owner. These aspects collectively highlight '
'how this Fiesta stands out from other vehicles of its kind.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Petrol',
'id': '1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050450511',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 63000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f/1dfe1a8b-5c6f-5fd4-be6c-1255849d9e7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444292,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9fce1a8f4e0d46bc947074ad7462b2e6.jpg',
'Width': 2048}],
'price': 6300,
'price_includes_vat': True,
'registration_date': '2013-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.6 Titanium Powershift Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2013}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050450511%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050450511: {'created_time': 1774458367.702798, 'last_price_update_time': 1774458367.702807}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050450511') HTTP/1.1" 204 0
2026-03-25 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8706199b47f744b09b0e342724200818.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dce0b590>
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73bfbc8f-ac9e-5179-81aa-73bda29f5b07/73bfbc8f-ac9e-5179-81aa-73bda29f5b07_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5f76f38fed7c44519bcac3e46c7c6124.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5f76f38fed7c44519bcac3e46c7c6124.jpg saved to cache
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73bfbc8f-ac9e-5179-81aa-73bda29f5b07
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73bfbc8f-ac9e-5179-81aa-73bda29f5b07 sending to next pipeline
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc5d9a10>
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fb67bb0-2aa4-5214-9dbd-278d7224671d/9fb67bb0-2aa4-5214-9dbd-278d7224671d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F60f69973da9944689d1c7740350ba800.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/60f69973da9944689d1c7740350ba800.jpg saved to cache
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fb67bb0-2aa4-5214-9dbd-278d7224671d
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fb67bb0-2aa4-5214-9dbd-278d7224671d sending to next pipeline
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc467c50>
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52eddf75-13fa-5633-a079-c3eb712d7a47/52eddf75-13fa-5633-a079-c3eb712d7a47_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F79a72c68b5dc48b8b8540cd6e00e35af.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/79a72c68b5dc48b8b8540cd6e00e35af.jpg saved to cache
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52eddf75-13fa-5633-a079-c3eb712d7a47
2026-03-25 17:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52eddf75-13fa-5633-a079-c3eb712d7a47 sending to next pipeline
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 73bfbc8f-ac9e-5179-81aa-73bda29f5b07 with identifier 202602170006754
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 73bfbc8f-ac9e-5179-81aa-73bda29f5b07
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5f76f38fed7c44519bcac3e46c7c6124.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'Black',
'currency': 'GBP',
'description': 'Discover this exceptional 2011 Ford Fiesta Zetec, boasting '
'remarkably low mileage for its age at just 46,000 miles. This '
'well maintained example comes with a full service history and '
'a clear vehicle history check, offering peace of mind. '
'Finished in attractive metallic paint, this Fiesta Zetec also '
'benefits from the convenient City Pack, enhancing its '
'practicality for everyday driving.\n'
'\n'
'This particular Ford Fiesta Zetec stands out with its low '
'insurance group rating, making it an economical choice for '
'many drivers. You will also receive 12 months MOT provided on '
'purchase, ensuring its roadworthiness. A 3 month warranty is '
'included, providing further confidence in this reliable and '
'popular model. Hi',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 94,
'fuel_type': 'Petrol',
'id': '73bfbc8f-ac9e-5179-81aa-73bda29f5b07',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602170006754',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 46000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73bfbc8f-ac9e-5179-81aa-73bda29f5b07/73bfbc8f-ac9e-5179-81aa-73bda29f5b07_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77621,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5f76f38fed7c44519bcac3e46c7c6124.jpg',
'Width': 1024}],
'price': 6600,
'price_includes_vat': True,
'registration_date': '2011-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Zetec 5dr',
'transmission': 'automatic',
'trim': 'Zetec',
'year': 2011}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602170006754%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602170006754: {'created_time': 1774458367.913132, 'last_price_update_time': 1774458367.913143}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602170006754') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9fb67bb0-2aa4-5214-9dbd-278d7224671d with identifier 202601199249903
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9fb67bb0-2aa4-5214-9dbd-278d7224671d
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/60f69973da9944689d1c7740350ba800.jpg>
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'Silver',
'currency': 'GBP',
'description': 'This 2010 Ford Fiesta Zetec is a great find, boasting a clear '
'vehicle history check for your peace of mind. Powered by a '
'reliable 1.4L petrol engine, this model comes in a stylish '
"metallic paint finish. Inside, you'll appreciate the "
'convenience of the Blu. Hands Free Tech. with Voice Control '
'and a USB port, perfect for staying connected on the go. The '
'Zetec trim also includes the City Pack, adding further '
'practicality to your driving experience.\n'
'\n'
'The Ford Fiesta Zetec is renowned for its affordability, and '
'this particular model stands out with its low insurance '
'group, making it an economical choice for many drivers. This '
'means you can enjoy the benefits of this well equipped and '
'well maintained vehicle without the worry of high running '
'costs, setting it apart from other cars in its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.4L',
'engine_horse_power': 94,
'fuel_type': 'Petrol',
'id': '9fb67bb0-2aa4-5214-9dbd-278d7224671d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601199249903',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 71000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fb67bb0-2aa4-5214-9dbd-278d7224671d/9fb67bb0-2aa4-5214-9dbd-278d7224671d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77819,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/60f69973da9944689d1c7740350ba800.jpg',
'Width': 1024}],
'price': 4995,
'price_includes_vat': True,
'registration_date': '2010-07-09',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Zetec 5dr',
'transmission': 'automatic',
'trim': 'Zetec',
'year': 2010}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601199249903%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601199249903: {'created_time': 1774458367.955851, 'last_price_update_time': 1774458367.955861}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601199249903') HTTP/1.1" 204 0
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 52eddf75-13fa-5633-a079-c3eb712d7a47 with identifier 202602230154891
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 52eddf75-13fa-5633-a079-c3eb712d7a47
2026-03-25 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/79a72c68b5dc48b8b8540cd6e00e35af.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'Blue',
'currency': 'GBP',
'description': '*NEW FRONT BRAKES AND SUSPENSION* Discover this exceptional '
'2014 Ford Fiesta Zetec, boasting remarkably low mileage for '
'its age, with only 43,000 miles on the clock. This well '
'maintained example has had just two owners and comes with a '
'full service history, ensuring its provenance is clear. A '
'clear vehicle history check provides further peace of mind. '
"Under the bonnet, you'll find a responsive 1.6 litre petrol "
'engine, paired with manual air conditioning for your '
'comfort.\n'
'\n'
'This Fiesta Zetec offers a compelling package, indicated by '
'its low insurance group, making it an economical choice. Its '
'acceleration is also noteworthy, achieving 0 to 62 miles per '
'hour in just 10.5 seconds, demonstrating its spirited '
'performance. To ensure your confidence, the vehicle will be '
'provided with 12 months MOT and a 3 month warranty.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 104,
'fuel_type': 'Petrol',
'id': '52eddf75-13fa-5633-a079-c3eb712d7a47',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230154891',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 43000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52eddf75-13fa-5633-a079-c3eb712d7a47/52eddf75-13fa-5633-a079-c3eb712d7a47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440763,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/79a72c68b5dc48b8b8540cd6e00e35af.jpg',
'Width': 2048}],
'price': 6990,
'price_includes_vat': True,
'registration_date': '2014-01-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.6 Zetec Powershift Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Zetec',
'year': 2014}
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230154891%27 HTTP/1.1" 200 None
2026-03-25 17:06:07 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230154891: {'created_time': 1774458367.997915, 'last_price_update_time': 1774458367.997923}
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230154891') HTTP/1.1" 204 0
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dce0aa10>
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68fe2fce-4697-5844-bc70-f176c3dc2dac/68fe2fce-4697-5844-bc70-f176c3dc2dac_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8706199b47f744b09b0e342724200818.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8706199b47f744b09b0e342724200818.jpg saved to cache
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68fe2fce-4697-5844-bc70-f176c3dc2dac
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68fe2fce-4697-5844-bc70-f176c3dc2dac sending to next pipeline
2026-03-25 17:06:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 68fe2fce-4697-5844-bc70-f176c3dc2dac with identifier 202602200089393
2026-03-25 17:06:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 68fe2fce-4697-5844-bc70-f176c3dc2dac
2026-03-25 17:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8706199b47f744b09b0e342724200818.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'Black',
'currency': 'GBP',
'description': '*NEW ARRIVAL*This 2014 SEAT Alhambra TDI SE Lux offers '
'excellent provenance with a full service history and a clear '
'vehicle history check, all supported by a 3 month warranty '
'for your peace of mind. This 7 seat MPV is powered by an '
'efficient 2.0 litre diesel engine and boasts a low mileage of '
'just 96,000 miles for its age. It comes equipped with the '
'SEAT Media System v3.2, featuring a rear view camera for '
'easier parking, and integrated Bluetooth for handsfree calls. '
'Comfort is enhanced with heated front seats, and convenience '
'is provided by auto on headlights with a light sensor.\n'
'\n'
'The Alhambra TDI SE Lux is a practical choice for families, '
'offering ample space for seven occupants and a substantial '
'towing weight of 2200 kg. Its performance is highlighted by '
'an acceleration of 0-62mph in 10.9 seconds, demonstrating a '
'capable drive. With 12 months MOT provided on purchase, this '
'vehicle is ready for its next adventure, offering a well '
'maintained and feature rich option compared to other similar '
'vehicles on the market.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'id': '68fe2fce-4697-5844-bc70-f176c3dc2dac',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200089393',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'SEAT',
'model': 'Alhambra',
'odometer': 96000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 47,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fe2fce-4697-5844-bc70-f176c3dc2dac/68fe2fce-4697-5844-bc70-f176c3dc2dac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418380,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8706199b47f744b09b0e342724200818.jpg',
'Width': 2048}],
'price': 9000,
'price_includes_vat': True,
'registration_date': '2014-08-01',
'seats_number': 7,
'seller_name': None,
'title': 'SEAT Alhambra 2.0 TDI CR SE Lux DSG Euro 5 (s/s) 5dr',
'transmission': 'automatic',
'trim': 'SE Lux',
'year': 2014}
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200089393%27 HTTP/1.1" 200 None
2026-03-25 17:06:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200089393: {'created_time': 1774458368.156033, 'last_price_update_time': 1774458368.156042}
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200089393') HTTP/1.1" 204 0
2026-03-25 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a0026cc0-3940-5d33-9e2a-ed4b4ff336c2 with identifier: 202502219360324
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a0026cc0-3940-5d33-9e2a-ed4b4ff336c2
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf16263b23104282a3a3ac433cd8f3d2.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf16263b23104282a3a3ac433cd8f3d2.jpg not downloaded yet
2026-03-25 17:06:08 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e31c9c2-0de6-52e8-8835-706ca686e702 with identifier: 202501218256291
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e31c9c2-0de6-52e8-8835-706ca686e702
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F439bfd1910044f3ab79dea353978f1a9.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/439bfd1910044f3ab79dea353978f1a9.jpg not downloaded yet
2026-03-25 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/439bfd1910044f3ab79dea353978f1a9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cf16263b23104282a3a3ac433cd8f3d2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc5d83d0>
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e31c9c2-0de6-52e8-8835-706ca686e702/2e31c9c2-0de6-52e8-8835-706ca686e702_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F439bfd1910044f3ab79dea353978f1a9.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/439bfd1910044f3ab79dea353978f1a9.jpg saved to cache
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e31c9c2-0de6-52e8-8835-706ca686e702
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e31c9c2-0de6-52e8-8835-706ca686e702 sending to next pipeline
2026-03-25 17:06:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2e31c9c2-0de6-52e8-8835-706ca686e702 with identifier 202501218256291
2026-03-25 17:06:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2e31c9c2-0de6-52e8-8835-706ca686e702
2026-03-25 17:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/439bfd1910044f3ab79dea353978f1a9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'Black',
'currency': 'GBP',
'description': 'Awaiting preparation professional HD pictures coming '
"soon.Paxton Motors 'Ford specialist’s' are proud to offer "
'this high specification Ford Focus ST-Line X, first '
'registered 31/01/2019, Low insurance group and running costs! '
'ULEZ compliant! [no congestion charges] Euro 6! Super smooth '
'power delivery from the outstanding 125 BHP 1.0T! 6 speed '
'manual. Fords 1.0 litre 3 cylinder engine delivers '
'exceptional power and economy both around town and on longer '
'motorway journeys. Lovely example supplied with a Full '
'Service History, New 12 Months MOT, plus 3 MONTHS AUTOGAURD '
'WARRANTY [Extendable up to 2 years] nationwide parts/labour '
'inc, roadside cover optional. Very well presented throughout, '
'beautiful in metallic black paintwork with tidy 17 inch '
'alloys on x4 good tires, striking LED daytime lights help you '
'stand out on the road. Great Titanium X specification comes '
'packed full of comfort and convenience features from factory '
'- satnav, parking sensors, heated leather seats, quick-clear '
'heated front windscreen [for all them cold winter starts], '
'hill assist, FordSYNC [helps your mobile seamlessly '
'connect],air conditioning with climate control, cruise '
'control, DAB digital radio, bluetooth so you can make phone '
'calls to your nearest and dearest safely whilst out on the '
'road, rear privacy glass. Interior features Black/Grey '
'heated part leather seats & adjustable multi-function leather '
'steering wheel, AUX, USB and 12V power points. Fully valeted '
'and sanitized. Non smoking owner. HPI CLEAR with report '
'provided. All handbooks in owner pack with service book, 2 '
'keys. FOR FURTHER INFORMATION please call JUSTIN on: 07861 '
'766367. P/X, Finance, Extended Warranties & Home Delivery '
'options available.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '2e31c9c2-0de6-52e8-8835-706ca686e702',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202501218256291',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 51377,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 4,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e31c9c2-0de6-52e8-8835-706ca686e702/2e31c9c2-0de6-52e8-8835-706ca686e702_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57081,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/439bfd1910044f3ab79dea353978f1a9.jpg',
'Width': 1024}],
'price': 10995,
'price_includes_vat': True,
'registration_date': '2019-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost ST-Line X Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2019}
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202501218256291%27 HTTP/1.1" 200 None
2026-03-25 17:06:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202501218256291: {'created_time': 1774458368.683655, 'last_price_update_time': 1774458368.683665}
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202501218256291') HTTP/1.1" 204 0
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42debcdad0>
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0026cc0-3940-5d33-9e2a-ed4b4ff336c2/a0026cc0-3940-5d33-9e2a-ed4b4ff336c2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf16263b23104282a3a3ac433cd8f3d2.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf16263b23104282a3a3ac433cd8f3d2.jpg saved to cache
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0026cc0-3940-5d33-9e2a-ed4b4ff336c2
2026-03-25 17:06:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0026cc0-3940-5d33-9e2a-ed4b4ff336c2 sending to next pipeline
2026-03-25 17:06:08 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a0026cc0-3940-5d33-9e2a-ed4b4ff336c2 with identifier 202502219360324
2026-03-25 17:06:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:08 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:08 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a0026cc0-3940-5d33-9e2a-ed4b4ff336c2
2026-03-25 17:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cf16263b23104282a3a3ac433cd8f3d2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'Grey',
'currency': 'GBP',
'description': 'Paxton Motors ‘Ford specialist’s’ are very pleased to offer '
'this lovely high specification Ford Focus Titanium X, first '
'registered 31/01/2019, Low insurance! ULEZ compliant! [no '
'congestion charges] Euro 6! The Ford Focus 1.0 T EcoBoost ST '
'line X is a higher-spec variant of the popular Ford Focus '
'hatchback, featuring the smaller but efficient 1.0-liter '
"EcoBoost engine. This car is a part of Ford's lineup offering "
'a blend of performance, economy, and comfort, with the "ST '
'LINE X" trim representing a well-equipped and premium sport '
'version of the Focus. The 1.0 EcoBoost engine, despite its '
'smaller displacement, offers a lively driving experience '
'thanks to the turbocharged power delivery. This lovely '
'example supplied with a Full Service History [Recent service '
'], New 12 Months MOT, plus 3 MONTHS AUTOGAURD WARRANTY '
'[Extendable up to 2 years] nationwide parts/labour inc, '
'roadside cover optional. Very well presented throughout, '
'beautiful in metallic grey paintwork with tidy diamond cut '
'alloys on x4 good tires, striking LED daytime lights help you '
'stand out on the road. Great ST line X specification comes '
'packed full of comfort and convenience features from factory, '
'satnav, heated leather seats, quick-clear heated front '
'windscreen [for all them cold winter starts], hill assist, '
'FordSYNC [helps your mobile seamlessly connect],air '
'conditioning with climate control, cruise control, DAB '
'digital radio, bluetooth so you can make phone calls to your '
'nearest and dearest safely whilst out on the road, rear '
'privacy glass. Interior features Black/Grey heated part '
'leather seats & adjustable multi-function leather steering '
'wheel, AUX, USB and 12V power points. Fully valeted and '
'sanitized. Non smoking owner. HPI CLEAR with report provided. '
'All handbooks in owner pack with service book, 2 keys. FOR '
'FURTHER INFORMATION please call JUSTIN on: 07861 766367. P/X, '
'Finance, Extended Warranties & Home Delivery options '
'available.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': 'a0026cc0-3940-5d33-9e2a-ed4b4ff336c2',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202502219360324',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 46000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 70,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0026cc0-3940-5d33-9e2a-ed4b4ff336c2/a0026cc0-3940-5d33-9e2a-ed4b4ff336c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615194,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf16263b23104282a3a3ac433cd8f3d2.jpg',
'Width': 2048}],
'price': 12000,
'price_includes_vat': True,
'registration_date': '2019-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost ST-Line X Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2019}
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202502219360324%27 HTTP/1.1" 200 None
2026-03-25 17:06:08 [auto_selling_autotrader.co.uk] INFO: Saving data for 202502219360324: {'created_time': 1774458368.826596, 'last_price_update_time': 1774458368.82661}
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202502219360324') HTTP/1.1" 204 0
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b725194c-301a-5c7e-b526-44e1c6b177ea with identifier: 202601129088905
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b725194c-301a-5c7e-b526-44e1c6b177ea
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F175e68fc23f44731a1c45c885bf5db46.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/175e68fc23f44731a1c45c885bf5db46.jpg not downloaded yet
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b30d6485-6ff4-530b-a35c-932673f8d796 with identifier: 202601099039680
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b30d6485-6ff4-530b-a35c-932673f8d796
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa78fc71218534be2b6592dc3ff18ad7d.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a78fc71218534be2b6592dc3ff18ad7d.jpg not downloaded yet
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a09edcfe-f965-57d2-b2fc-e78ffa3c083e with identifier: 202511127845225
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a09edcfe-f965-57d2-b2fc-e78ffa3c083e
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F142fadb03a264e56a8610d2cf0b55e02.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/142fadb03a264e56a8610d2cf0b55e02.jpg not downloaded yet
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 312a1912-9f8d-5093-ae87-12648fe38e41 with identifier: 202511127837893
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 312a1912-9f8d-5093-ae87-12648fe38e41
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1240d517535a4bd281edb608fb7d97ac.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1240d517535a4bd281edb608fb7d97ac.jpg not downloaded yet
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e6edad0e-749c-5a87-b9bb-cf142bdf5494 with identifier: 202510137118195
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e6edad0e-749c-5a87-b9bb-cf142bdf5494
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38ebdeeeb9664fce87f6c2d25bd2d4ae.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38ebdeeeb9664fce87f6c2d25bd2d4ae.jpg not downloaded yet
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6705fadd-9554-5318-a5cd-00dc99c62997 with identifier: 202509276686221
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6705fadd-9554-5318-a5cd-00dc99c62997
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4745d83952c4c3d997c9e5b5b0eef4f.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4745d83952c4c3d997c9e5b5b0eef4f.jpg not downloaded yet
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c532224-0159-5b3a-9753-7b899fdfb9ef with identifier: 202509206500419
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6c532224-0159-5b3a-9753-7b899fdfb9ef
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11b7d2b3e3994d3e95ae6563590300ee.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11b7d2b3e3994d3e95ae6563590300ee.jpg not downloaded yet
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fc27181e-87ee-5212-9b41-a9488157cefe with identifier: 202507054203683
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fc27181e-87ee-5212-9b41-a9488157cefe
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26aed024d39b4dc994c5aed9df08c7ed.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26aed024d39b4dc994c5aed9df08c7ed.jpg not downloaded yet
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/175e68fc23f44731a1c45c885bf5db46.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1988ae38-fd3c-5029-8d44-065f59ae466c with identifier: 202504051008568
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1988ae38-fd3c-5029-8d44-065f59ae466c
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39469135c1af495d928bcf82011db5b7.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39469135c1af495d928bcf82011db5b7.jpg not downloaded yet
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:06:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 76e41370-f33f-55e1-acc7-4da48be493c1 with identifier: 202502279572139
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 76e41370-f33f-55e1-acc7-4da48be493c1
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20796783841b427ab01e6a4e42c498da.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20796783841b427ab01e6a4e42c498da.jpg not downloaded yet
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a78fc71218534be2b6592dc3ff18ad7d.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/142fadb03a264e56a8610d2cf0b55e02.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dcf57290>
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b725194c-301a-5c7e-b526-44e1c6b177ea/b725194c-301a-5c7e-b526-44e1c6b177ea_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F175e68fc23f44731a1c45c885bf5db46.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/175e68fc23f44731a1c45c885bf5db46.jpg saved to cache
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b725194c-301a-5c7e-b526-44e1c6b177ea
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b725194c-301a-5c7e-b526-44e1c6b177ea sending to next pipeline
2026-03-25 17:06:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b725194c-301a-5c7e-b526-44e1c6b177ea with identifier 202601129088905
2026-03-25 17:06:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b725194c-301a-5c7e-b526-44e1c6b177ea
2026-03-25 17:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/175e68fc23f44731a1c45c885bf5db46.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2018 Ford Fiesta ST Line boasts a full service history, '
'ensuring excellent provenance for this popular model. Powered '
'by a responsive 1.0 litre petrol engine, this Euro 6 '
'compliant vehicle offers an engaging driving experience. The '
'ST Line trim level enhances its sporty appeal, and you can '
'enjoy peace of mind with a 3 month warranty and a 12 month '
"MOT provided on purchase. Inside, you'll find the impressive "
'B and O PLAY In-Car Audio Premium Sound System, complete with '
'Ford SYNC 3 Navigation, Android Auto and Apple CarPlay for '
'seamless connectivity. The NCAP Pack includes automatic '
'headlights, which are also featured as a standalone item, '
'alongside manual air conditioning and a Ford DAB radio.\n'
'\n'
'Experience the efficiency and performance of this Ford '
'Fiesta, with a remarkable fuel economy of 55 miles per gallon '
'and low CO2 emissions. Its acceleration from 0 to 62 miles '
'per hour in just 9.0 seconds demonstrates its spirited '
'nature, indicating it performs better than many similar '
'vehicles. These highlights combined with its comprehensive '
'features and strong provenance make this Fiesta ST Line a '
'compelling choice.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': 'b725194c-301a-5c7e-b526-44e1c6b177ea',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601129088905',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 83000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b725194c-301a-5c7e-b526-44e1c6b177ea/b725194c-301a-5c7e-b526-44e1c6b177ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66722,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/175e68fc23f44731a1c45c885bf5db46.jpg',
'Width': 1024}],
'price': 6990,
'price_includes_vat': True,
'registration_date': '2018-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost ST-Line Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601129088905%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601129088905: {'created_time': 1774458369.580091, 'last_price_update_time': 1774458369.5801}
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601129088905') HTTP/1.1" 204 0
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/26aed024d39b4dc994c5aed9df08c7ed.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dcf550d0>
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b30d6485-6ff4-530b-a35c-932673f8d796/b30d6485-6ff4-530b-a35c-932673f8d796_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa78fc71218534be2b6592dc3ff18ad7d.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a78fc71218534be2b6592dc3ff18ad7d.jpg saved to cache
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b30d6485-6ff4-530b-a35c-932673f8d796
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b30d6485-6ff4-530b-a35c-932673f8d796 sending to next pipeline
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dce26710>
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a09edcfe-f965-57d2-b2fc-e78ffa3c083e/a09edcfe-f965-57d2-b2fc-e78ffa3c083e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F142fadb03a264e56a8610d2cf0b55e02.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/142fadb03a264e56a8610d2cf0b55e02.jpg saved to cache
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a09edcfe-f965-57d2-b2fc-e78ffa3c083e
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a09edcfe-f965-57d2-b2fc-e78ffa3c083e sending to next pipeline
2026-03-25 17:06:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b30d6485-6ff4-530b-a35c-932673f8d796 with identifier 202601099039680
2026-03-25 17:06:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b30d6485-6ff4-530b-a35c-932673f8d796
2026-03-25 17:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a78fc71218534be2b6592dc3ff18ad7d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'White',
'currency': 'GBP',
'description': 'This 2016 Ford Ka Zetec White Edition boasts a full service '
'history and has had only two owners, offering excellent '
'provenance. This stylish hatchback is powered by an efficient '
'1.2 litre petrol engine, meeting Euro 6 emissions standards. '
'It comes equipped with manual air conditioning for your '
'comfort, a Bluetooth handsfree system for easy connectivity, '
'and a sporty rear spoiler. A clear vehicle history check and '
'a 3 month warranty provide added peace of mind.\n'
'\n'
'The Ford Ka Zetec White Edition stands out with its '
'impressive fuel economy, achieving up to 58 miles per gallon, '
'which is better than many similar vehicles. Its low insurance '
'group rating also indicates lower running costs compared to '
'other cars in its class. Furthermore, the vehicle will be '
'supplied with 12 months MOT upon purchase, ensuring its '
'roadworthiness.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 68,
'fuel_type': 'Petrol',
'id': 'b30d6485-6ff4-530b-a35c-932673f8d796',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601099039680',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Ka',
'odometer': 74000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b30d6485-6ff4-530b-a35c-932673f8d796/b30d6485-6ff4-530b-a35c-932673f8d796_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51187,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a78fc71218534be2b6592dc3ff18ad7d.jpg',
'Width': 1024}],
'price': 3900,
'price_includes_vat': True,
'registration_date': '2016-01-29',
'seats_number': 4,
'seller_name': None,
'title': 'Ford KA 1.2 Zetec White Edition Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'Zetec White Edition',
'year': 2016}
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601099039680%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601099039680: {'created_time': 1774458369.714859, 'last_price_update_time': 1774458369.71487}
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601099039680') HTTP/1.1" 204 0
2026-03-25 17:06:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a09edcfe-f965-57d2-b2fc-e78ffa3c083e with identifier 202511127845225
2026-03-25 17:06:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a09edcfe-f965-57d2-b2fc-e78ffa3c083e
2026-03-25 17:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/142fadb03a264e56a8610d2cf0b55e02.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'Grey',
'currency': 'GBP',
'description': 'With a full service history and only two previous owners, '
'this 2016 Ford Fiesta ST-200 presents a compelling '
'proposition. This Euro 6 compliant 1.6L petrol model boasts '
'impressive performance, achieving 0-62mph in a swift 6.7 '
'seconds. You can drive away with confidence, as it comes with '
'a 12 month MOT and a 3 month warranty. The vehicle history '
'check is clear, and its last service was completed on '
"2025-08-15 at 94338 miles. Inside, you'll find a Sony "
'Navigation System with DAB and Ford SYNC, including Bluetooth '
'connectivity, a rear view camera, and rear parking sensors to '
'aid manoeuvrability.\n'
'\n'
'The ST-200 trim level offers a superior driving experience '
'compared to other models. Its acceleration figures highlight '
'its sporty nature, making it a more engaging drive. '
'Practicality is also considered, with an adjustable boot load '
'floor and a rear centre head restraint for added comfort and '
'versatility. This Ford Fiesta ST-200 combines exhilarating '
'performance with thoughtful features, making it a standout '
'choice for those seeking a dynamic and well maintained '
'compact car.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.6L',
'engine_horse_power': 197,
'fuel_type': 'Petrol',
'id': 'a09edcfe-f965-57d2-b2fc-e78ffa3c083e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511127845225',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 96000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a09edcfe-f965-57d2-b2fc-e78ffa3c083e/a09edcfe-f965-57d2-b2fc-e78ffa3c083e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68118,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/142fadb03a264e56a8610d2cf0b55e02.jpg',
'Width': 1024}],
'price': 8000,
'price_includes_vat': True,
'registration_date': '2016-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.6T EcoBoost ST-200 Euro 6 3dr',
'transmission': 'manual',
'trim': 'ST-200',
'year': 2016}
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127845225%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511127845225: {'created_time': 1774458369.758464, 'last_price_update_time': 1774458369.758471}
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511127845225') HTTP/1.1" 204 0
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc382ad0>
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc27181e-87ee-5212-9b41-a9488157cefe/fc27181e-87ee-5212-9b41-a9488157cefe_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26aed024d39b4dc994c5aed9df08c7ed.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26aed024d39b4dc994c5aed9df08c7ed.jpg saved to cache
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc27181e-87ee-5212-9b41-a9488157cefe
2026-03-25 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc27181e-87ee-5212-9b41-a9488157cefe sending to next pipeline
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/39469135c1af495d928bcf82011db5b7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/38ebdeeeb9664fce87f6c2d25bd2d4ae.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d4745d83952c4c3d997c9e5b5b0eef4f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fc27181e-87ee-5212-9b41-a9488157cefe with identifier 202507054203683
2026-03-25 17:06:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fc27181e-87ee-5212-9b41-a9488157cefe
2026-03-25 17:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/26aed024d39b4dc994c5aed9df08c7ed.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': 'Silver',
'currency': 'GBP',
'description': 'With a full service history and a clear vehicle history '
'check, this 2013 Ford Focus Zetec S is a great choice. The '
'Zetec S trim comes with a 1.6L petrol engine. Enjoy features '
'such as EHPAS - Electric Hydraulic Power-assisted steering, '
'Bluetooth Handsfree and Voice Control, and air conditioning. '
'For peace of mind, a 3-month warranty is included. Plus, a '
'12-month MOT will be provided on purchase, ensuring its road '
'worthiness.\n'
'\n'
'This particular model stands out with its low insurance '
'group, potentially saving you money on your premiums. In '
'addition, the Ford Focus boasts a large boot space, making it '
'more practical than other vehicles in its class.',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.6L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': 'fc27181e-87ee-5212-9b41-a9488157cefe',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202507054203683',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 107000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc27181e-87ee-5212-9b41-a9488157cefe/fc27181e-87ee-5212-9b41-a9488157cefe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66615,
'Height': 576,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/26aed024d39b4dc994c5aed9df08c7ed.jpg',
'Width': 1024}],
'price': 3990,
'price_includes_vat': True,
'registration_date': '2013-06-12',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.6 Zetec S Powershift Euro 5 5dr',
'transmission': 'automatic',
'trim': 'Zetec S',
'year': 2013}
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202507054203683%27 HTTP/1.1" 200 None
2026-03-25 17:06:09 [auto_selling_autotrader.co.uk] INFO: Saving data for 202507054203683: {'created_time': 1774458369.868391, 'last_price_update_time': 1774458369.868402}
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202507054203683') HTTP/1.1" 204 0
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1240d517535a4bd281edb608fb7d97ac.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/11b7d2b3e3994d3e95ae6563590300ee.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/20796783841b427ab01e6a4e42c498da.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc41c750>
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1988ae38-fd3c-5029-8d44-065f59ae466c/1988ae38-fd3c-5029-8d44-065f59ae466c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39469135c1af495d928bcf82011db5b7.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39469135c1af495d928bcf82011db5b7.jpg saved to cache
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1988ae38-fd3c-5029-8d44-065f59ae466c
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1988ae38-fd3c-5029-8d44-065f59ae466c sending to next pipeline
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dcf59510>
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6edad0e-749c-5a87-b9bb-cf142bdf5494/e6edad0e-749c-5a87-b9bb-cf142bdf5494_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38ebdeeeb9664fce87f6c2d25bd2d4ae.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38ebdeeeb9664fce87f6c2d25bd2d4ae.jpg saved to cache
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6edad0e-749c-5a87-b9bb-cf142bdf5494
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6edad0e-749c-5a87-b9bb-cf142bdf5494 sending to next pipeline
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1988ae38-fd3c-5029-8d44-065f59ae466c with identifier 202504051008568
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1988ae38-fd3c-5029-8d44-065f59ae466c
2026-03-25 17:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/39469135c1af495d928bcf82011db5b7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 97,
'color': 'Red',
'currency': 'GBP',
'description': 'Paxton Motors ‘Ford specialist’s’ are very pleased to offer '
'this Ford Fiesta ST-Line! Up to 70 MPG! ULEZ compliant! [no '
'congestion charges] Super smooth power delivery from the 1.0T '
'which truly delivers a lively driving experience! First '
'registered in 2018! This small but powerful engine delivers '
'excellent performance and fuel economy, the 6 speed manual '
'gearbox provides smooth and quick gear changes, enhancing '
'both fuel economy and driving comfort. The ST-Line trim, '
'specifically, offers a level of comfort and features '
'compared to the regular fiesta model, focusing on delivering '
'a great sporty package in a compact hatchback, specification '
'comes packed full of comfort and convenience features from '
'factory, touchscreen infotainment system, quick clear heated '
'front windscreen, air conditioning . Interior features '
'Black/Grey seats & adjustable multi-function leather steering '
'wheel, USB and 12 V power points. Lovely 3 owner example, '
'supplied with a Full service history, plus new 12 Months MOT '
'included with purchase and a 3 months nationwide AUTOGAURD '
'WARRANTY parts and abour included[EXTENDABLE up to 2 years]. '
'Very well presented throughout, beautiful in ‘Race Red’ with '
'tidy 18 inch gunmetal alloys on x4 good tires. Fully valeted '
'and sanitised. Non smoking owner. HPI CLEAR with report '
'provided for free. All handbook in owner pack with service '
'book, 2 keys. FOR FURTHER INFORMATION please call JUSTIN on: '
'07861 766367. P/X, Finance, Extended Warranties & Home '
'delivery available.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': '1988ae38-fd3c-5029-8d44-065f59ae466c',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202504051008568',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 51000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 58,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1988ae38-fd3c-5029-8d44-065f59ae466c/1988ae38-fd3c-5029-8d44-065f59ae466c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 614087,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/39469135c1af495d928bcf82011db5b7.jpg',
'Width': 2048}],
'price': 7500,
'price_includes_vat': True,
'registration_date': '2018-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost ST-Line Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202504051008568%27 HTTP/1.1" 200 None
2026-03-25 17:06:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202504051008568: {'created_time': 1774458370.19588, 'last_price_update_time': 1774458370.195889}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202504051008568') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e6edad0e-749c-5a87-b9bb-cf142bdf5494 with identifier 202510137118195
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e6edad0e-749c-5a87-b9bb-cf142bdf5494
2026-03-25 17:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/38ebdeeeb9664fce87f6c2d25bd2d4ae.jpg>
{'auction_title': '',
'c_o_2_emission_value': 97,
'color': 'Grey',
'currency': 'GBP',
'description': 'This 2017 Ford Fiesta T ST-Line presents a remarkable '
'opportunity with its exceptionally low mileage of just 52,000 '
'miles for its age, complemented by a full service history and '
'a clear vehicle history check. This Euro 6 compliant 1.0L '
'petrol model, registered in 2017, offers a desirable ST-Line '
'trim, ensuring a sporty aesthetic and engaging driving '
'experience. You can drive away with confidence, as it comes '
'with a 3 month warranty and a 12 month MOT provided on '
'purchase. Notable features include the Ford Navigation System '
'with Ford SYNC 3, offering seamless integration with Apple '
'CarPlay and Android Auto, alongside a premium B and O PLAY '
'In-Car Audio system for an enhanced listening experience. The '
'NCAP Pack, including automatic headlights, further adds to '
'the convenience and safety.\n'
'\n'
'Experience the efficiency and performance of this Ford '
'Fiesta, which boasts an impressive fuel economy of 66 mpg, '
'making it an economical choice for your daily journeys. Its '
'low CO2 emissions also contribute to its environmentally '
'conscious profile. The acceleration from 0-62mph in 10.5 '
'seconds demonstrates a responsive performance that is better '
'than many other vehicles in its class. The Ford DAB Radio, '
'also featuring Ford SYNC3 with Apple CarPlay and Android '
'Auto, ensures you stay connected and entertained on every '
'trip.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': 'e6edad0e-749c-5a87-b9bb-cf142bdf5494',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202510137118195',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 52000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6edad0e-749c-5a87-b9bb-cf142bdf5494/e6edad0e-749c-5a87-b9bb-cf142bdf5494_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618424,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/38ebdeeeb9664fce87f6c2d25bd2d4ae.jpg',
'Width': 2048}],
'price': 7500,
'price_includes_vat': True,
'registration_date': '2017-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost ST-Line Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2017}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202510137118195%27 HTTP/1.1" 200 None
2026-03-25 17:06:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202510137118195: {'created_time': 1774458370.243262, 'last_price_update_time': 1774458370.24327}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202510137118195') HTTP/1.1" 204 0
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42deb4b7d0>
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6705fadd-9554-5318-a5cd-00dc99c62997/6705fadd-9554-5318-a5cd-00dc99c62997_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4745d83952c4c3d997c9e5b5b0eef4f.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4745d83952c4c3d997c9e5b5b0eef4f.jpg saved to cache
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6705fadd-9554-5318-a5cd-00dc99c62997
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6705fadd-9554-5318-a5cd-00dc99c62997 sending to next pipeline
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6705fadd-9554-5318-a5cd-00dc99c62997 with identifier 202509276686221
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6705fadd-9554-5318-a5cd-00dc99c62997
2026-03-25 17:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d4745d83952c4c3d997c9e5b5b0eef4f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'color': 'Black',
'currency': 'GBP',
'description': 'X4 NEW PIRELLI TYRES + FRONT DISCS AND PADS. This 2017 Ford '
'Fiesta ST Line boasts a full service history and a clear '
'vehicle history check, offering you peace of mind. This 1.0L '
'petrol model, registered in 2017, is a Euro 6 compliant '
'vehicle. It comes with a 3 month warranty and a 12 month MOT '
"provided on purchase. Inside, you'll find the Ford DAB Radio "
'with Ford SYNC3, which includes Apple CarPlay and Android '
'Auto, allowing seamless integration with your smartphone. The '
'NCAP Pack adds extra safety features, including automatic '
'headlights that switch on and off as needed, and manual air '
'conditioning to keep you comfortable.\n'
'\n'
'This Ford Fiesta ST Line offers impressive performance and '
'efficiency. Its fuel economy is a notable 63 mpg, and it also '
'boasts low CO2 emissions, making it an economical choice. The '
'acceleration is brisk, reaching 0-62mph in just 9.0 seconds. '
'These highlights demonstrate how this Fiesta stands out from '
'other vehicles in its class, offering a compelling '
'combination of features, performance, and economy.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 138,
'fuel_type': 'Petrol',
'id': '6705fadd-9554-5318-a5cd-00dc99c62997',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509276686221',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 59000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6705fadd-9554-5318-a5cd-00dc99c62997/6705fadd-9554-5318-a5cd-00dc99c62997_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388932,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d4745d83952c4c3d997c9e5b5b0eef4f.jpg',
'Width': 2048}],
'price': 7500,
'price_includes_vat': True,
'registration_date': '2017-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost ST-Line Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2017}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509276686221%27 HTTP/1.1" 200 None
2026-03-25 17:06:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509276686221: {'created_time': 1774458370.432685, 'last_price_update_time': 1774458370.432694}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509276686221') HTTP/1.1" 204 0
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc5d9bd0>
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_312a1912-9f8d-5093-ae87-12648fe38e41/312a1912-9f8d-5093-ae87-12648fe38e41_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1240d517535a4bd281edb608fb7d97ac.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1240d517535a4bd281edb608fb7d97ac.jpg saved to cache
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 312a1912-9f8d-5093-ae87-12648fe38e41
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 312a1912-9f8d-5093-ae87-12648fe38e41 sending to next pipeline
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc423390>
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c532224-0159-5b3a-9753-7b899fdfb9ef/6c532224-0159-5b3a-9753-7b899fdfb9ef_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F11b7d2b3e3994d3e95ae6563590300ee.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/11b7d2b3e3994d3e95ae6563590300ee.jpg saved to cache
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c532224-0159-5b3a-9753-7b899fdfb9ef
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c532224-0159-5b3a-9753-7b899fdfb9ef sending to next pipeline
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f42dc467350>
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76e41370-f33f-55e1-acc7-4da48be493c1/76e41370-f33f-55e1-acc7-4da48be493c1_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F20796783841b427ab01e6a4e42c498da.jpg') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/20796783841b427ab01e6a4e42c498da.jpg saved to cache
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76e41370-f33f-55e1-acc7-4da48be493c1
2026-03-25 17:06:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76e41370-f33f-55e1-acc7-4da48be493c1 sending to next pipeline
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 312a1912-9f8d-5093-ae87-12648fe38e41 with identifier 202511127837893
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 312a1912-9f8d-5093-ae87-12648fe38e41
2026-03-25 17:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1240d517535a4bd281edb608fb7d97ac.jpg>
{'auction_title': '',
'c_o_2_emission_value': 97,
'color': 'Black',
'currency': 'GBP',
'description': 'Boasting a full service history right up to July 2025 at '
'74,439 miles, this 2018 Ford Fiesta T ST Line offers '
'excellent provenance. This Euro 6 compliant 1.0L petrol model '
'comes with a clear vehicle history check and a 3 month '
'warranty for your peace of mind. The ST Line trim level '
'enhances its sporty appeal, complemented by a striking Shadow '
"Black Contrast Roof and Mirrors. Inside, you'll find the "
'convenient Ford Navigation System with Ford SYNC 3, offering '
'seamless integration with Apple CarPlay and Android Auto. The '
'City Pack adds rear parking sensors for easier manoeuvring, '
'and automatic headlights ensure optimal visibility.\n'
'\n'
'This Ford Fiesta stands out with its impressive fuel economy, '
'achieving a highlight of 59 mpg, which is better than many '
'similar vehicles. Its low CO2 emissions also contribute to '
'its appeal. For those who enjoy a responsive drive, it '
'accelerates from 0 to 62 mph in 10.6 seconds, demonstrating a '
'good balance of performance and efficiency. The Ford DAB '
'radio, also featuring Ford SYNC3 with Apple CarPlay and '
'Android Auto, ensures your journeys are always entertaining '
'and connected. A 12 month MOT will be provided on purchase, '
'further assuring you of its roadworthiness.',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 99,
'fuel_type': 'Petrol',
'id': '312a1912-9f8d-5093-ae87-12648fe38e41',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511127837893',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 79000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 39,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_312a1912-9f8d-5093-ae87-12648fe38e41/312a1912-9f8d-5093-ae87-12648fe38e41_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563115,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1240d517535a4bd281edb608fb7d97ac.jpg',
'Width': 2048}],
'price': 6450,
'price_includes_vat': True,
'registration_date': '2018-07-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0T EcoBoost ST-Line Euro 6 (s/s) 3dr',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511127837893%27 HTTP/1.1" 200 None
2026-03-25 17:06:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511127837893: {'created_time': 1774458370.703792, 'last_price_update_time': 1774458370.703801}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511127837893') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6c532224-0159-5b3a-9753-7b899fdfb9ef with identifier 202509206500419
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6c532224-0159-5b3a-9753-7b899fdfb9ef
2026-03-25 17:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/11b7d2b3e3994d3e95ae6563590300ee.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'White',
'currency': 'GBP',
'description': 'This 2018 Ford Focus Titanium X boasts a full service '
'history, ensuring excellent provenance for this popular '
'model. Powered by an efficient 1.0 litre petrol engine, this '
'Euro 6 compliant vehicle is registered in 2018 and comes with '
'a clear vehicle history check. The Titanium X trim level '
'includes desirable features such as 18 inch alloy wheels, the '
'Premium Ford SYNC3 DAB Navigation System, and a Driver '
'Assistance Pack. For added convenience, it also features a '
'rear view camera for easier parking and DEATC dual zone '
'electronic automatic temperature control.\n'
'\n'
'You can expect impressive fuel economy with this Focus, '
'achieving up to 60 miles per gallon, which is a significant '
'advantage for running costs. Its low CO2 emissions further '
'contribute to its economical profile. This vehicle also '
'offers generous boot space, making it practical for everyday '
'use and longer journeys. A 12 month MOT will be provided on '
'purchase, and the car is covered by a 3 month warranty, '
'offering peace of mind.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 123,
'fuel_type': 'Petrol',
'id': '6c532224-0159-5b3a-9753-7b899fdfb9ef',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202509206500419',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 65,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c532224-0159-5b3a-9753-7b899fdfb9ef/6c532224-0159-5b3a-9753-7b899fdfb9ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583850,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/11b7d2b3e3994d3e95ae6563590300ee.jpg',
'Width': 2048}],
'price': 7695,
'price_includes_vat': True,
'registration_date': '2018-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.0T EcoBoost Titanium X Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Titanium X',
'year': 2018}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202509206500419%27 HTTP/1.1" 200 None
2026-03-25 17:06:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202509206500419: {'created_time': 1774458370.746819, 'last_price_update_time': 1774458370.746826}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202509206500419') HTTP/1.1" 204 0
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 76e41370-f33f-55e1-acc7-4da48be493c1 with identifier 202502279572139
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 76e41370-f33f-55e1-acc7-4da48be493c1
2026-03-25 17:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/20796783841b427ab01e6a4e42c498da.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'color': 'White',
'currency': 'GBP',
'description': 'Boasting a remarkably low mileage for its age, this 2015 Ford '
'Focus T ST-3 presents a compelling proposition for any '
'discerning driver. With only 66,000 miles on the clock, this '
'Euro 6 compliant model comes with a full service history and '
'a clear vehicle history check, ensuring peace of mind. The '
'ST-3 trim level is enhanced by the ST Black Style Pack, and '
"you'll appreciate the convenience of the KeyFree System for "
'keyless entry and the automatic headlights. Inside, the '
'Premium Ford SYNC2 DAB Navigation System keeps you connected '
'and informed, while Bluetooth handsfree allows for seamless '
'communication on the go.\n'
'\n'
'This Ford Focus ST-3 is designed to impress, offering a '
'thrilling driving experience with its 2.0L petrol engine '
'capable of accelerating from 0-62mph in a swift 6.5 seconds, '
'a performance that sets it apart from many other vehicles in '
'its class. Furthermore, the generous boot space provides '
'ample room for all your luggage or shopping needs. To ensure '
'your confidence in this purchase, a 12 month MOT will be '
'provided on purchase, and the vehicle also comes with a 12 '
'month warranty.',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '2L',
'engine_horse_power': 247,
'fuel_type': 'Petrol',
'id': '76e41370-f33f-55e1-acc7-4da48be493c1',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202502279572139',
'listing': 'directbuy',
'location': 'Derby, Derbyshire',
'make': 'Ford',
'model': 'Focus',
'odometer': 67000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76e41370-f33f-55e1-acc7-4da48be493c1/76e41370-f33f-55e1-acc7-4da48be493c1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463180,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/20796783841b427ab01e6a4e42c498da.jpg',
'Width': 2048}],
'price': 10995,
'price_includes_vat': True,
'registration_date': '2015-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 2.0T EcoBoost ST-3 Euro 6 (s/s) 5dr',
'transmission': 'manual',
'trim': 'ST-3',
'year': 2015}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202502279572139%27 HTTP/1.1" 200 None
2026-03-25 17:06:10 [auto_selling_autotrader.co.uk] INFO: Saving data for 202502279572139: {'created_time': 1774458370.789302, 'last_price_update_time': 1774458370.789311}
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202502279572139') HTTP/1.1" 204 0
2026-03-25 17:06:10 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 17:06:10 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-25 17:06:10 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:06:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item df51bec4286c11f18f76c264925fbcfa
2026-03-25 17:06:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-25 17:06:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-25 17:06:10 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:06:10 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:06:10 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-25 17:06:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-25 17:06:11 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-25 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773162371 HTTP/1.1" 200 None
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511258118703') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512088442014') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512188680730') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512188693451') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601219310592') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602019591659') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230147536') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240165462') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602240180593') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260225538') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260244073') HTTP/1.1" 204 0
2026-03-25 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100553802') HTTP/1.1" 204 0
2026-03-25 17:06:12 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (32 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/df51bec4286c11f18f76c264925fbcfa.jl
2026-03-25 17:06:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 258768,
'downloader/request_count': 38,
'downloader/request_method_count/GET': 32,
'downloader/request_method_count/POST': 6,
'downloader/response_bytes': 8282944,
'downloader/response_count': 38,
'downloader/response_status_count/200': 38,
'elapsed_time_seconds': 17.36134,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 25, 17, 6, 12, 311017, tzinfo=datetime.timezone.utc),
'item_scraped_count': 32,
'log_count/DEBUG': 596,
'log_count/INFO': 517,
'memusage/max': 147472384,
'memusage/startup': 147472384,
'photo_download_count': 32,
'request_depth_max': 3,
'response_received_count': 6,
'scheduler/dequeued': 38,
'scheduler/dequeued/memory': 38,
'scheduler/enqueued': 38,
'scheduler/enqueued/memory': 38,
'scrape_type/new': 32,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 6,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.3882970292276395,
'scrapy-zyte-api/mean_response_seconds': 2.5489709788622954,
'scrapy-zyte-api/processed': 6,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 6,
'scrapy-zyte-api/request_args/experimental.requestCookies': 5,
'scrapy-zyte-api/request_args/experimental.responseCookies': 6,
'scrapy-zyte-api/request_args/httpRequestBody': 6,
'scrapy-zyte-api/request_args/httpRequestMethod': 6,
'scrapy-zyte-api/request_args/httpResponseBody': 6,
'scrapy-zyte-api/request_args/httpResponseHeaders': 6,
'scrapy-zyte-api/request_args/url': 6,
'scrapy-zyte-api/status_codes/200': 6,
'scrapy-zyte-api/success': 6,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 25, 17, 5, 54, 949677, tzinfo=datetime.timezone.utc)}
2026-03-25 17:06:12 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-25 17:06:12 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f42e03776d0>
2026-03-25 17:06:12 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f42e0377f10>