2026-03-25 17:47:19 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-25 17:47:19 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-25 17:47:19 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-25 17:47:19 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-25 17:47:19 [auto_selling_autotrader.co.uk] INFO: Limiting photo downloads to 1 per item
2026-03-25 17:47:19 [auto_selling_autotrader.co.uk] INFO: _job: a9e31110287211f18f76c264925fbcfa, SCRAPY_JOB: None
2026-03-25 17:47:19 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-25 17:47:19 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-25 17:47:19 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-25 17:47:19 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-25 17:47:19 [scrapy.extensions.telnet] INFO: Telnet Password: 0d22d34b28c39c53
2026-03-25 17:47:19 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-25 17:47:19 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/a9e31110287211f18f76c264925fbcfa.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-25 17:47:19 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 17:47:19 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-25 17:47:19 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-25 17:47:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-25 17:47:19 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-25 17:47:19 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-25 17:47:19 [scrapy.core.engine] INFO: Spider opened
2026-03-25 17:47:19 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 17:47:19 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-25 17:47:19 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2-quickmode
2026-03-25 17:47:19 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-25 17:47:19 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-25 17:47:19 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-25 17:47:19 [scrapy-playwright] INFO: Starting download handler
2026-03-25 17:47:19 [scrapy-playwright] INFO: Starting download handler
2026-03-25 17:47:24 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 5598 and multipost_profile_id: efc745ea-8432-4bde-9202-dfdfe650bc0f and job_id: a9e31110287211f18f76c264925fbcfa and url: https://www.autotrader.co.uk/dealers/transauto-5598
2026-03-25 17:47:24 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 5598, page: 1
2026-03-25 17:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Page: 1/3, total results: 60
2026-03-25 17:47:26 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2119
2026-03-25 17:47:26 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250996763%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250996763: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250996073%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603250996073: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240977845%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240977845: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240977620%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603240977620: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230934312%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230934312: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230927767%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230927767: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230926885%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230926885: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230920604%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603230920604: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210888203%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210888203: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210888055%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603210888055: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200875327%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200875327: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200860993%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200860993: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200859519%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200859519: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200859235%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603200859235: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190829880%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190829880: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180798747%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603180798747: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180798475%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603180798475: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170776177%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170776177: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160736099%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160736099: 1
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160733024%27 HTTP/1.1" 200 None
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160733024: 1
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 17:47:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Getting next page: 2
2026-03-25 17:47:26 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 5598, page: 2
2026-03-25 17:47:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4 with identifier: 202603250996763
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F270e6337945a4b9d8aa6d23e3a066279.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 59fc732b-5b42-58cf-84b3-1db2616130c6 with identifier: 202603250996073
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 59fc732b-5b42-58cf-84b3-1db2616130c6
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F270e6337945a4b9d8aa6d23e3a066279.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 54e3b9bb-2d41-52f3-a754-f4ae30f52df0 with identifier: 202603240977845
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 54e3b9bb-2d41-52f3-a754-f4ae30f52df0
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89bd3e42f7e04eea89e7b909c1c82b20.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89bd3e42f7e04eea89e7b909c1c82b20.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 83ea0390-135f-52d7-bb8b-312fccd1983a with identifier: 202603240977620
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 83ea0390-135f-52d7-bb8b-312fccd1983a
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe7d5fbab78f3457a8594e358a722cbc7.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e7d5fbab78f3457a8594e358a722cbc7.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: efd5bf7d-94b9-5730-b102-fea14ac14170 with identifier: 202603230934312
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item efd5bf7d-94b9-5730-b102-fea14ac14170
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F322b12667b9747a5844766a098497c7a.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/322b12667b9747a5844766a098497c7a.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 61ab405a-fe60-5795-8986-6d639b6713c8 with identifier: 202603230927767
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 61ab405a-fe60-5795-8986-6d639b6713c8
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F882678bc967d42469d1e523e4a350a4b.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/882678bc967d42469d1e523e4a350a4b.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 31987084-5cab-5dd3-99da-90cda3230f00 with identifier: 202603230926885
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 31987084-5cab-5dd3-99da-90cda3230f00
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc878ffe8d82e45d38f097557276da914.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c878ffe8d82e45d38f097557276da914.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ceacc21-9116-561c-9d98-980c83c9b751 with identifier: 202603230920604
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7ceacc21-9116-561c-9d98-980c83c9b751
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa02efc18f0194839b6c38ebda265f4b0.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a02efc18f0194839b6c38ebda265f4b0.jpg not downloaded yet
2026-03-25 17:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 375d67e5-f640-53ab-8e5b-bd2306bcaf71 with identifier: 202603210888203
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 375d67e5-f640-53ab-8e5b-bd2306bcaf71
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F891d8ec6fbfe460690d0e3d3c4e8da47.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/891d8ec6fbfe460690d0e3d3c4e8da47.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c95f951-0d11-5b5d-9b2a-aa9952f269eb with identifier: 202603210888055
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 4c95f951-0d11-5b5d-9b2a-aa9952f269eb
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc2871381c69d4ed3b4d045c364e7086f.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c2871381c69d4ed3b4d045c364e7086f.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5508e79c-388b-54d8-915a-a74dbe0a5581 with identifier: 202603200875327
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5508e79c-388b-54d8-915a-a74dbe0a5581
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0ca5a70aaea434da6dc4ee0d57f8e08.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0ca5a70aaea434da6dc4ee0d57f8e08.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2 with identifier: 202603200860993
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa6ccf33cda484347b33aa68ac3e2709b.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a6ccf33cda484347b33aa68ac3e2709b.jpg not downloaded yet
2026-03-25 17:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f55dfd87-1693-56c5-9069-2003ec5d4e91 with identifier: 202603200859519
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item f55dfd87-1693-56c5-9069-2003ec5d4e91
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F270e6337945a4b9d8aa6d23e3a066279.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 01a130e2-3062-5921-a86d-f8a20d50af12 with identifier: 202603200859235
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 01a130e2-3062-5921-a86d-f8a20d50af12
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bf44c879c634ac9a71c8b723f3928ea.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bf44c879c634ac9a71c8b723f3928ea.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 72168325-e0fe-5bf2-83f1-d47cadbb6585 with identifier: 202603190829880
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 72168325-e0fe-5bf2-83f1-d47cadbb6585
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff14393a202664ff099f5e9bb0c9fe382.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f14393a202664ff099f5e9bb0c9fe382.jpg not downloaded yet
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cbd09d6-a551-5003-823b-5bef5b8ec624 with identifier: 202603180798747
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 3cbd09d6-a551-5003-823b-5bef5b8ec624
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8912b8660f1e4f579427f0aab4fb7393.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8912b8660f1e4f579427f0aab4fb7393.jpg not downloaded yet
2026-03-25 17:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/89bd3e42f7e04eea89e7b909c1c82b20.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fed3e94-c9b6-54ab-8aac-69ac7453d9da with identifier: 202603180798475
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2fed3e94-c9b6-54ab-8aac-69ac7453d9da
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b88308a7ed749258d574484a11e0b85.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b88308a7ed749258d574484a11e0b85.jpg not downloaded yet
2026-03-25 17:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e7d5fbab78f3457a8594e358a722cbc7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a02efc18f0194839b6c38ebda265f4b0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:28 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1520b553-4355-559f-b051-8bc9d7dbf9f6 with identifier: 202603170776177
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1520b553-4355-559f-b051-8bc9d7dbf9f6
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F453d5fed57d44b0dba2a2f417d589610.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/453d5fed57d44b0dba2a2f417d589610.jpg not downloaded yet
2026-03-25 17:47:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-25 17:47:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-25 17:47:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c266e0490>
2026-03-25 17:47:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4/1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F270e6337945a4b9d8aa6d23e3a066279.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg saved to cache
2026-03-25 17:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4
2026-03-25 17:47:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4 sending to next pipeline
2026-03-25 17:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/322b12667b9747a5844766a098497c7a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/891d8ec6fbfe460690d0e3d3c4e8da47.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:29 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:29 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 420299c3-3acc-572c-af4e-cb1300f8218d with identifier: 202603160736099
2026-03-25 17:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 420299c3-3acc-572c-af4e-cb1300f8218d
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa697086ba03b4e59b9d52e6f5048c3c2.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a697086ba03b4e59b9d52e6f5048c3c2.jpg not downloaded yet
2026-03-25 17:47:29 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4 with identifier 202603250996763
2026-03-25 17:47:29 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-25 17:47:29 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 17:47:29 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-25 17:47:29 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:47:29 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-25 17:47:29 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-25 17:47:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2029
2026-03-25 17:47:29 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-25 17:47:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774460849
2026-03-25 17:47:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774460849
2026-03-25 17:47:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-25 17:47:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:29 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-25 17:47:29 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4
2026-03-25 17:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250996763',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 58000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4/1f59bf64-70d9-5f62-9c3d-acb2ad5ff8a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 15451,
             'Height': 480,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg',
             'Width': 640}],
 'price': 6499,
 'price_includes_vat': True,
 'registration_date': '2017-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Flair Hatchback 5dr Petrol Manual Euro 6 '
          '(s/s) (110 ps) Economical .Navigation.',
 'transmission': 'manual',
 'trim': 'Flair',
 'year': 2017}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250996763%27 HTTP/1.1" 200 None
2026-03-25 17:47:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250996763: {'created_time': 1774460850.052252, 'last_price_update_time': 1774460850.052262}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250996763') HTTP/1.1" 204 0
2026-03-25 17:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/882678bc967d42469d1e523e4a350a4b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c878ffe8d82e45d38f097557276da914.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c2871381c69d4ed3b4d045c364e7086f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e0ca5a70aaea434da6dc4ee0d57f8e08.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:30 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:30 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe209b5-423f-505f-83a5-b0bb5065430f with identifier: 202603160733024
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ffe209b5-423f-505f-83a5-b0bb5065430f
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2ad541ea6d54ec0a3427f45fb211af1.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2ad541ea6d54ec0a3427f45fb211af1.jpg not downloaded yet
2026-03-25 17:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a6ccf33cda484347b33aa68ac3e2709b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26fe9490>
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54e3b9bb-2d41-52f3-a754-f4ae30f52df0/54e3b9bb-2d41-52f3-a754-f4ae30f52df0_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89bd3e42f7e04eea89e7b909c1c82b20.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89bd3e42f7e04eea89e7b909c1c82b20.jpg saved to cache
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54e3b9bb-2d41-52f3-a754-f4ae30f52df0
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54e3b9bb-2d41-52f3-a754-f4ae30f52df0 sending to next pipeline
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c25c4c1d0>
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59fc732b-5b42-58cf-84b3-1db2616130c6/59fc732b-5b42-58cf-84b3-1db2616130c6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F270e6337945a4b9d8aa6d23e3a066279.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg saved to cache
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59fc732b-5b42-58cf-84b3-1db2616130c6
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59fc732b-5b42-58cf-84b3-1db2616130c6 sending to next pipeline
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c25c4eb10>
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83ea0390-135f-52d7-bb8b-312fccd1983a/83ea0390-135f-52d7-bb8b-312fccd1983a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe7d5fbab78f3457a8594e358a722cbc7.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e7d5fbab78f3457a8594e358a722cbc7.jpg saved to cache
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83ea0390-135f-52d7-bb8b-312fccd1983a
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83ea0390-135f-52d7-bb8b-312fccd1983a sending to next pipeline
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c25c56750>
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ceacc21-9116-561c-9d98-980c83c9b751/7ceacc21-9116-561c-9d98-980c83c9b751_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa02efc18f0194839b6c38ebda265f4b0.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a02efc18f0194839b6c38ebda265f4b0.jpg saved to cache
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ceacc21-9116-561c-9d98-980c83c9b751
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ceacc21-9116-561c-9d98-980c83c9b751 sending to next pipeline
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c25c57790>
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd5bf7d-94b9-5730-b102-fea14ac14170/efd5bf7d-94b9-5730-b102-fea14ac14170_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F322b12667b9747a5844766a098497c7a.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/322b12667b9747a5844766a098497c7a.jpg saved to cache
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efd5bf7d-94b9-5730-b102-fea14ac14170
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efd5bf7d-94b9-5730-b102-fea14ac14170 sending to next pipeline
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c25c5cbd0>
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_375d67e5-f640-53ab-8e5b-bd2306bcaf71/375d67e5-f640-53ab-8e5b-bd2306bcaf71_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F891d8ec6fbfe460690d0e3d3c4e8da47.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/891d8ec6fbfe460690d0e3d3c4e8da47.jpg saved to cache
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 375d67e5-f640-53ab-8e5b-bd2306bcaf71
2026-03-25 17:47:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 375d67e5-f640-53ab-8e5b-bd2306bcaf71 sending to next pipeline
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 54e3b9bb-2d41-52f3-a754-f4ae30f52df0 with identifier 202603240977845
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 54e3b9bb-2d41-52f3-a754-f4ae30f52df0
2026-03-25 17:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/89bd3e42f7e04eea89e7b909c1c82b20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'fuel_type': 'Petrol',
 'id': '54e3b9bb-2d41-52f3-a754-f4ae30f52df0',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240977845',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 59000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54e3b9bb-2d41-52f3-a754-f4ae30f52df0/54e3b9bb-2d41-52f3-a754-f4ae30f52df0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208089,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/89bd3e42f7e04eea89e7b909c1c82b20.jpg',
             'Width': 1280}],
 'price': 7499,
 'price_includes_vat': True,
 'registration_date': '2014-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman 1.6 Cooper SUV 5dr Petrol Manual ALL4 Euro 6 (s/s) '
          '(122 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Cooper',
 'year': 2014}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240977845%27 HTTP/1.1" 200 None
2026-03-25 17:47:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240977845: {'created_time': 1774460850.861918, 'last_price_update_time': 1774460850.861927}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240977845') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 59fc732b-5b42-58cf-84b3-1db2616130c6 with identifier 202603250996073
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 59fc732b-5b42-58cf-84b3-1db2616130c6
2026-03-25 17:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 178,
 'fuel_type': 'Diesel',
 'id': '59fc732b-5b42-58cf-84b3-1db2616130c6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603250996073',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 36000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59fc732b-5b42-58cf-84b3-1db2616130c6/59fc732b-5b42-58cf-84b3-1db2616130c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 15880,
             'Height': 480,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg',
             'Width': 640}],
 'price': 16999,
 'price_includes_vat': True,
 'registration_date': '2018-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.0 TD4 HSE Dynamic SUV 5dr Diesel '
          'Auto 4WD Euro 6 (s/s) (180 ps) Full Specification. Euro 6',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2018}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603250996073%27 HTTP/1.1" 200 None
2026-03-25 17:47:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603250996073: {'created_time': 1774460850.906042, 'last_price_update_time': 1774460850.906049}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603250996073') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 83ea0390-135f-52d7-bb8b-312fccd1983a with identifier 202603240977620
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 83ea0390-135f-52d7-bb8b-312fccd1983a
2026-03-25 17:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e7d5fbab78f3457a8594e358a722cbc7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '83ea0390-135f-52d7-bb8b-312fccd1983a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603240977620',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 16000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83ea0390-135f-52d7-bb8b-312fccd1983a/83ea0390-135f-52d7-bb8b-312fccd1983a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189759,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e7d5fbab78f3457a8594e358a722cbc7.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2017-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ecosport 1.0T EcoBoost Titanium S SUV 5dr Petrol Manual 2WD '
          'Euro 6 (s/s) (140 ps) Economical .',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2017}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603240977620%27 HTTP/1.1" 200 None
2026-03-25 17:47:30 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603240977620: {'created_time': 1774460850.957361, 'last_price_update_time': 1774460850.957369}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603240977620') HTTP/1.1" 204 0
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7ceacc21-9116-561c-9d98-980c83c9b751 with identifier 202603230920604
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7ceacc21-9116-561c-9d98-980c83c9b751
2026-03-25 17:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a02efc18f0194839b6c38ebda265f4b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'fuel_type': 'Petrol',
 'id': '7ceacc21-9116-561c-9d98-980c83c9b751',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230920604',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ceacc21-9116-561c-9d98-980c83c9b751/7ceacc21-9116-561c-9d98-980c83c9b751_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88043,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a02efc18f0194839b6c38ebda265f4b0.jpg',
             'Width': 1280}],
 'price': 9499,
 'price_includes_vat': True,
 'registration_date': '2012-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman 1.6 Cooper S SUV 5dr Petrol Steptronic ALL4 Euro 5 '
          '(184 ps) Leather, Pan Roof.',
 'transmission': 'automatic',
 'trim': 'Cooper S',
 'year': 2012}
2026-03-25 17:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230920604%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230920604: {'created_time': 1774460851.003966, 'last_price_update_time': 1774460851.003977}
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230920604') HTTP/1.1" 204 0
2026-03-25 17:47:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: efd5bf7d-94b9-5730-b102-fea14ac14170 with identifier 202603230934312
2026-03-25 17:47:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item efd5bf7d-94b9-5730-b102-fea14ac14170
2026-03-25 17:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/322b12667b9747a5844766a098497c7a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': 'efd5bf7d-94b9-5730-b102-fea14ac14170',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230934312',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Crossland X',
 'odometer': 49000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd5bf7d-94b9-5730-b102-fea14ac14170/efd5bf7d-94b9-5730-b102-fea14ac14170_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102091,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/322b12667b9747a5844766a098497c7a.jpg',
             'Width': 1280}],
 'price': 6999,
 'price_includes_vat': True,
 'registration_date': '2017-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Crossland X 1.2 Turbo ecoTEC Elite Nav SUV 5dr Petrol '
          'Manual Euro 6 (s/s) (110 ps) Economical .Navigation.',
 'transmission': 'manual',
 'trim': 'Elite Nav',
 'year': 2017}
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230934312%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230934312: {'created_time': 1774460851.048398, 'last_price_update_time': 1774460851.048406}
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230934312') HTTP/1.1" 204 0
2026-03-25 17:47:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 375d67e5-f640-53ab-8e5b-bd2306bcaf71 with identifier 202603210888203
2026-03-25 17:47:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 375d67e5-f640-53ab-8e5b-bd2306bcaf71
2026-03-25 17:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/891d8ec6fbfe460690d0e3d3c4e8da47.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '375d67e5-f640-53ab-8e5b-bd2306bcaf71',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210888203',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 49000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_375d67e5-f640-53ab-8e5b-bd2306bcaf71/375d67e5-f640-53ab-8e5b-bd2306bcaf71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83246,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/891d8ec6fbfe460690d0e3d3c4e8da47.jpg',
             'Width': 1280}],
 'price': 9499,
 'price_includes_vat': True,
 'registration_date': '2017-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES 1.5 118i SE Hatchback 5dr Petrol Manual Euro 6 (s/s) '
          '(136 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2017}
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210888203%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210888203: {'created_time': 1774460851.103464, 'last_price_update_time': 1774460851.103473}
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210888203') HTTP/1.1" 204 0
2026-03-25 17:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8912b8660f1e4f579427f0aab4fb7393.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4bf44c879c634ac9a71c8b723f3928ea.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f14393a202664ff099f5e9bb0c9fe382.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/453d5fed57d44b0dba2a2f417d589610.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3b88308a7ed749258d574484a11e0b85.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a697086ba03b4e59b9d52e6f5048c3c2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c386b4910>
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61ab405a-fe60-5795-8986-6d639b6713c8/61ab405a-fe60-5795-8986-6d639b6713c8_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F882678bc967d42469d1e523e4a350a4b.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/882678bc967d42469d1e523e4a350a4b.jpg saved to cache
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61ab405a-fe60-5795-8986-6d639b6713c8
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61ab405a-fe60-5795-8986-6d639b6713c8 sending to next pipeline
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26594750>
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31987084-5cab-5dd3-99da-90cda3230f00/31987084-5cab-5dd3-99da-90cda3230f00_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc878ffe8d82e45d38f097557276da914.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c878ffe8d82e45d38f097557276da914.jpg saved to cache
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31987084-5cab-5dd3-99da-90cda3230f00
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31987084-5cab-5dd3-99da-90cda3230f00 sending to next pipeline
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c2659e4d0>
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f55dfd87-1693-56c5-9069-2003ec5d4e91/f55dfd87-1693-56c5-9069-2003ec5d4e91_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F270e6337945a4b9d8aa6d23e3a066279.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg saved to cache
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f55dfd87-1693-56c5-9069-2003ec5d4e91
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f55dfd87-1693-56c5-9069-2003ec5d4e91 sending to next pipeline
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26658390>
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c95f951-0d11-5b5d-9b2a-aa9952f269eb/4c95f951-0d11-5b5d-9b2a-aa9952f269eb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc2871381c69d4ed3b4d045c364e7086f.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c2871381c69d4ed3b4d045c364e7086f.jpg saved to cache
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c95f951-0d11-5b5d-9b2a-aa9952f269eb
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c95f951-0d11-5b5d-9b2a-aa9952f269eb sending to next pipeline
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26586b90>
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5508e79c-388b-54d8-915a-a74dbe0a5581/5508e79c-388b-54d8-915a-a74dbe0a5581_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0ca5a70aaea434da6dc4ee0d57f8e08.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0ca5a70aaea434da6dc4ee0d57f8e08.jpg saved to cache
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5508e79c-388b-54d8-915a-a74dbe0a5581
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5508e79c-388b-54d8-915a-a74dbe0a5581 sending to next pipeline
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Page: 2/3, total results: 60
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140700269%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603140700269: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130675866%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130675866: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130669618%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130669618: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130668855%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130668855: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110598053%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110598053: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100568955%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100568955: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100555944%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603100555944: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090522613%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090522613: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090522604%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603090522604: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070488395%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603070488395: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050441829%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050441829: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393338%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603040393338: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270266769%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270266769: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270266767%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270266767: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270266719%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602270266719: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231826%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260231826: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231763%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602260231763: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230150178%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602230150178: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200084029%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602200084029: 1
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190054738%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602190054738: 1
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c2659a790>
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2/bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa6ccf33cda484347b33aa68ac3e2709b.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a6ccf33cda484347b33aa68ac3e2709b.jpg saved to cache
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2
2026-03-25 17:47:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2 sending to next pipeline
2026-03-25 17:47:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 61ab405a-fe60-5795-8986-6d639b6713c8 with identifier 202603230927767
2026-03-25 17:47:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:31 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:31 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 61ab405a-fe60-5795-8986-6d639b6713c8
2026-03-25 17:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/882678bc967d42469d1e523e4a350a4b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.4L',
 'engine_horse_power': 84,
 'fuel_type': 'Petrol',
 'id': '61ab405a-fe60-5795-8986-6d639b6713c8',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230927767',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 52000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 64,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61ab405a-fe60-5795-8986-6d639b6713c8/61ab405a-fe60-5795-8986-6d639b6713c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184999,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/882678bc967d42469d1e523e4a350a4b.jpg',
             'Width': 1280}],
 'price': 6999,
 'price_includes_vat': True,
 'registration_date': '2012-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Match Hatchback 5dr Petrol Manual Euro 5 (85 '
          'ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230927767%27 HTTP/1.1" 200 None
2026-03-25 17:47:31 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230927767: {'created_time': 1774460851.811665, 'last_price_update_time': 1774460851.811674}
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230927767') HTTP/1.1" 204 0
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 31987084-5cab-5dd3-99da-90cda3230f00 with identifier 202603230926885
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 31987084-5cab-5dd3-99da-90cda3230f00
2026-03-25 17:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c878ffe8d82e45d38f097557276da914.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'color': 'Orange',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '31987084-5cab-5dd3-99da-90cda3230f00',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603230926885',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Mokka X',
 'odometer': 33000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 57,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31987084-5cab-5dd3-99da-90cda3230f00/31987084-5cab-5dd3-99da-90cda3230f00_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209186,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c878ffe8d82e45d38f097557276da914.jpg',
             'Width': 1280}],
 'price': 10999,
 'price_includes_vat': True,
 'registration_date': '2018-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka X 1.4i Turbo Active SUV 5dr Petrol Auto Euro 6 (140 '
          'ps) Economical Estate.',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2018}
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603230926885%27 HTTP/1.1" 200 None
2026-03-25 17:47:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603230926885: {'created_time': 1774460852.842818, 'last_price_update_time': 1774460852.842829}
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603230926885') HTTP/1.1" 204 0
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f55dfd87-1693-56c5-9069-2003ec5d4e91 with identifier 202603200859519
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f55dfd87-1693-56c5-9069-2003ec5d4e91
2026-03-25 17:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': 'f55dfd87-1693-56c5-9069-2003ec5d4e91',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200859519',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 52000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f55dfd87-1693-56c5-9069-2003ec5d4e91/f55dfd87-1693-56c5-9069-2003ec5d4e91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 15451,
             'Height': 480,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/270e6337945a4b9d8aa6d23e3a066279.jpg',
             'Width': 640}],
 'price': 7499,
 'price_includes_vat': True,
 'registration_date': '2017-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 DIG-T Tekna SUV 5dr Petrol Manual Euro 6 (s/s) (115 '
          'ps) Economical .',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2017}
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200859519%27 HTTP/1.1" 200 None
2026-03-25 17:47:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200859519: {'created_time': 1774460852.888874, 'last_price_update_time': 1774460852.888882}
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200859519') HTTP/1.1" 204 0
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4c95f951-0d11-5b5d-9b2a-aa9952f269eb with identifier 202603210888055
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4c95f951-0d11-5b5d-9b2a-aa9952f269eb
2026-03-25 17:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c2871381c69d4ed3b4d045c364e7086f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '4c95f951-0d11-5b5d-9b2a-aa9952f269eb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603210888055',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Zafira Tourer',
 'odometer': 23000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c95f951-0d11-5b5d-9b2a-aa9952f269eb/4c95f951-0d11-5b5d-9b2a-aa9952f269eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85683,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c2871381c69d4ed3b4d045c364e7086f.jpg',
             'Width': 1280}],
 'price': 10699,
 'price_includes_vat': True,
 'registration_date': '2017-06-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Vauxhall Zafira Tourer 1.4i Turbo Design MPV 5dr Petrol Auto Euro 6 '
          '(140 ps) 7 Seats',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2017}
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603210888055%27 HTTP/1.1" 200 None
2026-03-25 17:47:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603210888055: {'created_time': 1774460852.9339, 'last_price_update_time': 1774460852.933907}
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603210888055') HTTP/1.1" 204 0
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5508e79c-388b-54d8-915a-a74dbe0a5581 with identifier 202603200875327
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5508e79c-388b-54d8-915a-a74dbe0a5581
2026-03-25 17:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e0ca5a70aaea434da6dc4ee0d57f8e08.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'fuel_type': 'Petrol',
 'id': '5508e79c-388b-54d8-915a-a74dbe0a5581',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200875327',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Crossland X',
 'odometer': 59000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5508e79c-388b-54d8-915a-a74dbe0a5581/5508e79c-388b-54d8-915a-a74dbe0a5581_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90678,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0ca5a70aaea434da6dc4ee0d57f8e08.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2020-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Crossland X 1.2 SRi Nav SUV 5dr Petrol Manual Euro 6 (s/s) '
          '(83 ps) Euro 6,Navigation.',
 'transmission': 'manual',
 'trim': 'SRi Nav',
 'year': 2020}
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200875327%27 HTTP/1.1" 200 None
2026-03-25 17:47:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200875327: {'created_time': 1774460852.978581, 'last_price_update_time': 1774460852.978587}
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200875327') HTTP/1.1" 204 0
2026-03-25 17:47:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2 with identifier 202603200860993
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2
2026-03-25 17:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a6ccf33cda484347b33aa68ac3e2709b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 129,
 'fuel_type': 'Petrol',
 'id': 'bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200860993',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 46000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2/bdb44aec-e6ae-5ae3-9d1c-95d49b1f5cc2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92428,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a6ccf33cda484347b33aa68ac3e2709b.jpg',
             'Width': 1280}],
 'price': 8499,
 'price_includes_vat': True,
 'registration_date': '2019-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech GPF Allure Hatchback 5dr Petrol Manual '
          'Euro 6 (s/s) (130 ps) Euro 6, Navigation.Panoramic Roof.',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200860993%27 HTTP/1.1" 200 None
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200860993: {'created_time': 1774460853.024826, 'last_price_update_time': 1774460853.024832}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200860993') HTTP/1.1" 204 0
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 17:47:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/d2ad541ea6d54ec0a3427f45fb211af1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Getting next page: 3
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 5598, page: 3
2026-03-25 17:47:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c2657dd10>
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cbd09d6-a551-5003-823b-5bef5b8ec624/3cbd09d6-a551-5003-823b-5bef5b8ec624_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8912b8660f1e4f579427f0aab4fb7393.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8912b8660f1e4f579427f0aab4fb7393.jpg saved to cache
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cbd09d6-a551-5003-823b-5bef5b8ec624
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cbd09d6-a551-5003-823b-5bef5b8ec624 sending to next pipeline
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26f7ad10>
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01a130e2-3062-5921-a86d-f8a20d50af12/01a130e2-3062-5921-a86d-f8a20d50af12_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4bf44c879c634ac9a71c8b723f3928ea.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4bf44c879c634ac9a71c8b723f3928ea.jpg saved to cache
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01a130e2-3062-5921-a86d-f8a20d50af12
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01a130e2-3062-5921-a86d-f8a20d50af12 sending to next pipeline
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c265c2e90>
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72168325-e0fe-5bf2-83f1-d47cadbb6585/72168325-e0fe-5bf2-83f1-d47cadbb6585_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff14393a202664ff099f5e9bb0c9fe382.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f14393a202664ff099f5e9bb0c9fe382.jpg saved to cache
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72168325-e0fe-5bf2-83f1-d47cadbb6585
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72168325-e0fe-5bf2-83f1-d47cadbb6585 sending to next pipeline
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c2a355d10>
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1520b553-4355-559f-b051-8bc9d7dbf9f6/1520b553-4355-559f-b051-8bc9d7dbf9f6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F453d5fed57d44b0dba2a2f417d589610.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/453d5fed57d44b0dba2a2f417d589610.jpg saved to cache
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1520b553-4355-559f-b051-8bc9d7dbf9f6
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1520b553-4355-559f-b051-8bc9d7dbf9f6 sending to next pipeline
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26f52d10>
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2fed3e94-c9b6-54ab-8aac-69ac7453d9da/2fed3e94-c9b6-54ab-8aac-69ac7453d9da_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3b88308a7ed749258d574484a11e0b85.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3b88308a7ed749258d574484a11e0b85.jpg saved to cache
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2fed3e94-c9b6-54ab-8aac-69ac7453d9da
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2fed3e94-c9b6-54ab-8aac-69ac7453d9da sending to next pipeline
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c265eb550>
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420299c3-3acc-572c-af4e-cb1300f8218d/420299c3-3acc-572c-af4e-cb1300f8218d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa697086ba03b4e59b9d52e6f5048c3c2.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a697086ba03b4e59b9d52e6f5048c3c2.jpg saved to cache
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 420299c3-3acc-572c-af4e-cb1300f8218d
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 420299c3-3acc-572c-af4e-cb1300f8218d sending to next pipeline
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3cbd09d6-a551-5003-823b-5bef5b8ec624 with identifier 202603180798747
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3cbd09d6-a551-5003-823b-5bef5b8ec624
2026-03-25 17:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8912b8660f1e4f579427f0aab4fb7393.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '3cbd09d6-a551-5003-823b-5bef5b8ec624',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603180798747',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 48000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cbd09d6-a551-5003-823b-5bef5b8ec624/3cbd09d6-a551-5003-823b-5bef5b8ec624_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104229,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8912b8660f1e4f579427f0aab4fb7393.jpg',
             'Width': 1280}],
 'price': 7699,
 'price_includes_vat': True,
 'registration_date': '2016-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.4T MultiAirII Longitude SUV 5dr Petrol Manual Euro '
          '6 (s/s) (140 ps) Economical .Navigation.Euro 6',
 'transmission': 'manual',
 'trim': 'Longitude',
 'year': 2016}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180798747%27 HTTP/1.1" 200 None
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603180798747: {'created_time': 1774460853.323031, 'last_price_update_time': 1774460853.323041}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603180798747') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 01a130e2-3062-5921-a86d-f8a20d50af12 with identifier 202603200859235
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 01a130e2-3062-5921-a86d-f8a20d50af12
2026-03-25 17:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4bf44c879c634ac9a71c8b723f3928ea.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '01a130e2-3062-5921-a86d-f8a20d50af12',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603200859235',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Astra',
 'odometer': 56000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01a130e2-3062-5921-a86d-f8a20d50af12/01a130e2-3062-5921-a86d-f8a20d50af12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101583,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4bf44c879c634ac9a71c8b723f3928ea.jpg',
             'Width': 1280}],
 'price': 7499,
 'price_includes_vat': True,
 'registration_date': '2017-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Astra 1.4i Turbo SRi Hatchback 5dr Petrol Manual Euro 6 '
          '(150 ps) Economical .Hatchback.',
 'transmission': 'manual',
 'trim': 'SRi',
 'year': 2017}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603200859235%27 HTTP/1.1" 200 None
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603200859235: {'created_time': 1774460853.375665, 'last_price_update_time': 1774460853.375672}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603200859235') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 72168325-e0fe-5bf2-83f1-d47cadbb6585 with identifier 202603190829880
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 72168325-e0fe-5bf2-83f1-d47cadbb6585
2026-03-25 17:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f14393a202664ff099f5e9bb0c9fe382.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 178,
 'fuel_type': 'Diesel',
 'id': '72168325-e0fe-5bf2-83f1-d47cadbb6585',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190829880',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Land Rover',
 'model': 'Range Rover Evoque',
 'odometer': 35000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72168325-e0fe-5bf2-83f1-d47cadbb6585/72168325-e0fe-5bf2-83f1-d47cadbb6585_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100049,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f14393a202664ff099f5e9bb0c9fe382.jpg',
             'Width': 1280}],
 'price': 17999,
 'price_includes_vat': True,
 'registration_date': '2020-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque 2.0 D180 MHEV R-Dynamic S SUV 5dr '
          'Diesel Auto 4WD Euro 6 (s/s) (180 ps) Leather, Navigation.',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2020}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190829880%27 HTTP/1.1" 200 None
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190829880: {'created_time': 1774460853.419228, 'last_price_update_time': 1774460853.419236}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190829880') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1520b553-4355-559f-b051-8bc9d7dbf9f6 with identifier 202603170776177
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1520b553-4355-559f-b051-8bc9d7dbf9f6
2026-03-25 17:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/453d5fed57d44b0dba2a2f417d589610.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 108,
 'fuel_type': 'Petrol',
 'id': '1520b553-4355-559f-b051-8bc9d7dbf9f6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170776177',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 42000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1520b553-4355-559f-b051-8bc9d7dbf9f6/1520b553-4355-559f-b051-8bc9d7dbf9f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89387,
             'Height': 767,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/453d5fed57d44b0dba2a2f417d589610.jpg',
             'Width': 1280}],
 'price': 8499,
 'price_includes_vat': True,
 'registration_date': '2015-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI BlueMotion Tech SEL Hatchback 3dr Petrol '
          'Manual Euro 6 (s/s) (110 ps) Economical .',
 'transmission': 'manual',
 'trim': 'SEL',
 'year': 2015}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170776177%27 HTTP/1.1" 200 None
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170776177: {'created_time': 1774460853.464271, 'last_price_update_time': 1774460853.464279}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170776177') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2fed3e94-c9b6-54ab-8aac-69ac7453d9da with identifier 202603180798475
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2fed3e94-c9b6-54ab-8aac-69ac7453d9da
2026-03-25 17:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3b88308a7ed749258d574484a11e0b85.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': '2fed3e94-c9b6-54ab-8aac-69ac7453d9da',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603180798475',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 59000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2fed3e94-c9b6-54ab-8aac-69ac7453d9da/2fed3e94-c9b6-54ab-8aac-69ac7453d9da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94071,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3b88308a7ed749258d574484a11e0b85.jpg',
             'Width': 1280}],
 'price': 5999,
 'price_includes_vat': True,
 'registration_date': '2015-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.0i Turbo ecoFLEX Limited Edition Hatchback 5dr '
          'Petrol Manual Euro 6 (s/s) (115 ps) Economical .',
 'transmission': 'manual',
 'trim': 'Limited Edition',
 'year': 2015}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603180798475%27 HTTP/1.1" 200 None
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603180798475: {'created_time': 1774460853.50935, 'last_price_update_time': 1774460853.509362}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603180798475') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 420299c3-3acc-572c-af4e-cb1300f8218d with identifier 202603160736099
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 420299c3-3acc-572c-af4e-cb1300f8218d
2026-03-25 17:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a697086ba03b4e59b9d52e6f5048c3c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '420299c3-3acc-572c-af4e-cb1300f8218d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160736099',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 39000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_420299c3-3acc-572c-af4e-cb1300f8218d/420299c3-3acc-572c-af4e-cb1300f8218d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96705,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a697086ba03b4e59b9d52e6f5048c3c2.jpg',
             'Width': 1280}],
 'price': 13699,
 'price_includes_vat': True,
 'registration_date': '2019-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES 1.5 118i GPF M Sport Shadow Edition Hatchback 5dr '
          'Petrol Manual Euro 6 (s/s) (136 ps) Leather, Navigation. Euro 6.',
 'transmission': 'manual',
 'trim': 'M Sport Shadow Edition',
 'year': 2019}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160736099%27 HTTP/1.1" 200 None
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160736099: {'created_time': 1774460853.561062, 'last_price_update_time': 1774460853.561072}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160736099') HTTP/1.1" 204 0
2026-03-25 17:47:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28fd0cd0>
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffe209b5-423f-505f-83a5-b0bb5065430f/ffe209b5-423f-505f-83a5-b0bb5065430f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd2ad541ea6d54ec0a3427f45fb211af1.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d2ad541ea6d54ec0a3427f45fb211af1.jpg saved to cache
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffe209b5-423f-505f-83a5-b0bb5065430f
2026-03-25 17:47:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffe209b5-423f-505f-83a5-b0bb5065430f sending to next pipeline
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ffe209b5-423f-505f-83a5-b0bb5065430f with identifier 202603160733024
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ffe209b5-423f-505f-83a5-b0bb5065430f
2026-03-25 17:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/d2ad541ea6d54ec0a3427f45fb211af1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 129,
 'fuel_type': 'Petrol',
 'id': 'ffe209b5-423f-505f-83a5-b0bb5065430f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160733024',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 45000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe209b5-423f-505f-83a5-b0bb5065430f/ffe209b5-423f-505f-83a5-b0bb5065430f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112611,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/d2ad541ea6d54ec0a3427f45fb211af1.jpg',
             'Width': 1280}],
 'price': 8999,
 'price_includes_vat': True,
 'registration_date': '2017-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Allure Hatchback 5dr Petrol EAT Euro 6 '
          '(s/s) (130 ps) Euro 6, Navigation.Panoramic Roof.',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160733024%27 HTTP/1.1" 200 None
2026-03-25 17:47:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160733024: {'created_time': 1774460853.648629, 'last_price_update_time': 1774460853.648636}
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160733024') HTTP/1.1" 204 0
2026-03-25 17:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Page: 3/3, total results: 60
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169957143%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169957143: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119846881%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602119846881: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119845502%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602119845502: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109816138%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109816138: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079751429%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602079751429: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079751302%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602079751302: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601319573569%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601319573569: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309546285%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601309546285: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299510542%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299510542: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269424156%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601269424156: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601249391523%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601249391523: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239365449%27 HTTP/1.1" 200 None
2026-03-25 17:47:34 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239365449: 1
2026-03-25 17:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239365208%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601239365208: 1
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149131452%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601149131452: 1
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512138569346%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512138569346: 1
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512088446850%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202512088446850: 1
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208020790%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511208020790: 1
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157911105%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202511157911105: 1
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508195573497%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508195573497: 1
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505122308959%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202505122308959: 1
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 2)
2026-03-25 17:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a6b68b-3fb2-58ca-982a-450e1f14715a with identifier: 202603140700269
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a0a6b68b-3fb2-58ca-982a-450e1f14715a
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80328a3c29464d898574c0be3a3ffeba.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80328a3c29464d898574c0be3a3ffeba.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 29ecbfac-7f9f-5ba0-a4ab-8abd3664094a with identifier: 202603130675866
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 29ecbfac-7f9f-5ba0-a4ab-8abd3664094a
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F819c3e6d2440482fbc012f69dfe0f340.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/819c3e6d2440482fbc012f69dfe0f340.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc42fa6-2376-5232-880a-e8c2bf97e467 with identifier: 202603130669618
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0dc42fa6-2376-5232-880a-e8c2bf97e467
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07915ed5fcad43ee83d1e3f05d245144.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07915ed5fcad43ee83d1e3f05d245144.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ef32c4-d64c-542a-8969-b6473b3d6ace with identifier: 202603130668855
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b3ef32c4-d64c-542a-8969-b6473b3d6ace
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71d4e58777944cf08949dcdc6d4c1c20.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71d4e58777944cf08949dcdc6d4c1c20.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c573728d-d41d-5579-8cc9-b012a6e05181 with identifier: 202603110598053
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c573728d-d41d-5579-8cc9-b012a6e05181
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc01aa54054c340249d02d402c2599c59.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c01aa54054c340249d02d402c2599c59.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 767e4774-926e-5c6a-937f-adf8987bab55 with identifier: 202603050441829
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 767e4774-926e-5c6a-937f-adf8987bab55
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff64db448beb47009af82d2f746eaff9.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff64db448beb47009af82d2f746eaff9.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fb0fb4cb-00c4-553c-862f-670cf1f21a23 with identifier: 202603100568955
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fb0fb4cb-00c4-553c-862f-670cf1f21a23
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0257729bdff0427f9ee787c985e6dc83.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0257729bdff0427f9ee787c985e6dc83.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f with identifier: 202603040393338
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9df299f3ecf4b08b4dd8baf2637585b.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9df299f3ecf4b08b4dd8baf2637585b.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 78f8599a-246f-5200-bf89-de6cdc45e4fa with identifier: 202603100555944
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 78f8599a-246f-5200-bf89-de6cdc45e4fa
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c72bf8b9a64431c831e4f6e58b3b0a0.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c72bf8b9a64431c831e4f6e58b3b0a0.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cc8902a-bc03-5723-98e3-674b2cae019b with identifier: 202602270266769
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 7cc8902a-bc03-5723-98e3-674b2cae019b
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77cfa539ac584bd594b44ba8a6f67561.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77cfa539ac584bd594b44ba8a6f67561.jpg not downloaded yet
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/819c3e6d2440482fbc012f69dfe0f340.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2add016e-0679-5f78-83b1-76abe796651a with identifier: 202603090522613
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2add016e-0679-5f78-83b1-76abe796651a
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8427d9c03b046ee8355f7632e8218d4.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8427d9c03b046ee8355f7632e8218d4.jpg not downloaded yet
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/07915ed5fcad43ee83d1e3f05d245144.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1061d732-e32f-5a89-b0ac-19d4d0538f99 with identifier: 202602270266767
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1061d732-e32f-5a89-b0ac-19d4d0538f99
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5881225da4d741e9ae6b876d015a0e8f.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5881225da4d741e9ae6b876d015a0e8f.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c01bbbcf-c637-5ae5-ac15-4607fb96c786 with identifier: 202603090522604
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c01bbbcf-c637-5ae5-ac15-4607fb96c786
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a73a7754ef84556bac34d97caf7eb23.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a73a7754ef84556bac34d97caf7eb23.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e50419c-9f27-59e3-be3b-523695886b3f with identifier: 202602270266719
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2e50419c-9f27-59e3-be3b-523695886b3f
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e686d6d717a4b2cbefa1b44e55a4c79.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e686d6d717a4b2cbefa1b44e55a4c79.jpg not downloaded yet
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 939872f1-8901-5e4f-b025-1045a13015e6 with identifier: 202603070488395
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 939872f1-8901-5e4f-b025-1045a13015e6
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdca4b675017b46f192f8bc5e95eda2c7.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dca4b675017b46f192f8bc5e95eda2c7.jpg not downloaded yet
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/71d4e58777944cf08949dcdc6d4c1c20.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/80328a3c29464d898574c0be3a3ffeba.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d7006896-bea4-52c4-9238-3f2c69cf887e with identifier: 202602260231826
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item d7006896-bea4-52c4-9238-3f2c69cf887e
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F869c67c6b4f740d09e1df92bbfa025ac.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/869c67c6b4f740d09e1df92bbfa025ac.jpg not downloaded yet
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/ff64db448beb47009af82d2f746eaff9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0257729bdff0427f9ee787c985e6dc83.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/c01aa54054c340249d02d402c2599c59.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b20278f-893c-5468-b019-b3ef311d918a with identifier: 202602260231763
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 2b20278f-893c-5468-b019-b3ef311d918a
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84d7fe1193794f618ac351273f8e6388.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84d7fe1193794f618ac351273f8e6388.jpg not downloaded yet
2026-03-25 17:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c265ecf50>
2026-03-25 17:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29ecbfac-7f9f-5ba0-a4ab-8abd3664094a/29ecbfac-7f9f-5ba0-a4ab-8abd3664094a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F819c3e6d2440482fbc012f69dfe0f340.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/819c3e6d2440482fbc012f69dfe0f340.jpg saved to cache
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29ecbfac-7f9f-5ba0-a4ab-8abd3664094a
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29ecbfac-7f9f-5ba0-a4ab-8abd3664094a sending to next pipeline
2026-03-25 17:47:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c265ec510>
2026-03-25 17:47:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc42fa6-2376-5232-880a-e8c2bf97e467/0dc42fa6-2376-5232-880a-e8c2bf97e467_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F07915ed5fcad43ee83d1e3f05d245144.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/07915ed5fcad43ee83d1e3f05d245144.jpg saved to cache
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dc42fa6-2376-5232-880a-e8c2bf97e467
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dc42fa6-2376-5232-880a-e8c2bf97e467 sending to next pipeline
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e9df299f3ecf4b08b4dd8baf2637585b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/2c72bf8b9a64431c831e4f6e58b3b0a0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e1f1cdac-2c94-5632-86fa-df1bb52c71d9 with identifier: 202602230150178
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item e1f1cdac-2c94-5632-86fa-df1bb52c71d9
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1316abbb7cbb4587bdac84303f81d32a.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1316abbb7cbb4587bdac84303f81d32a.jpg not downloaded yet
2026-03-25 17:47:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 29ecbfac-7f9f-5ba0-a4ab-8abd3664094a with identifier 202603130675866
2026-03-25 17:47:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 29ecbfac-7f9f-5ba0-a4ab-8abd3664094a
2026-03-25 17:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/819c3e6d2440482fbc012f69dfe0f340.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'color': 'Silver',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 4',
 'engine': '1.6L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '29ecbfac-7f9f-5ba0-a4ab-8abd3664094a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130675866',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 73000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 52,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29ecbfac-7f9f-5ba0-a4ab-8abd3664094a/29ecbfac-7f9f-5ba0-a4ab-8abd3664094a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202707,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/819c3e6d2440482fbc012f69dfe0f340.jpg',
             'Width': 1280}],
 'price': 3999,
 'price_includes_vat': True,
 'registration_date': '2010-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Zetec Hatchback 5dr Petrol Automatic (184 g/km, 99 '
          'bhp) 12 Months MOT + 6 Months Warranty',
 'transmission': 'automatic',
 'trim': 'Zetec',
 'year': 2010}
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130675866%27 HTTP/1.1" 200 None
2026-03-25 17:47:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130675866: {'created_time': 1774460855.899581, 'last_price_update_time': 1774460855.899591}
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130675866') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0dc42fa6-2376-5232-880a-e8c2bf97e467 with identifier 202603130669618
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0dc42fa6-2376-5232-880a-e8c2bf97e467
2026-03-25 17:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/07915ed5fcad43ee83d1e3f05d245144.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '0dc42fa6-2376-5232-880a-e8c2bf97e467',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130669618',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc42fa6-2376-5232-880a-e8c2bf97e467/0dc42fa6-2376-5232-880a-e8c2bf97e467_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84328,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/07915ed5fcad43ee83d1e3f05d245144.jpg',
             'Width': 1280}],
 'price': 5799,
 'price_includes_vat': True,
 'registration_date': '2016-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ecosport 1.0T EcoBoost Zetec SUV 5dr Petrol Manual 2WD Euro 6 '
          '(s/s) (125 ps) Economical .Hatchback.',
 'transmission': 'manual',
 'trim': 'Zetec',
 'year': 2016}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130669618%27 HTTP/1.1" 200 None
2026-03-25 17:47:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130669618: {'created_time': 1774460856.293514, 'last_price_update_time': 1774460856.293522}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130669618') HTTP/1.1" 204 0
2026-03-25 17:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/77cfa539ac584bd594b44ba8a6f67561.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:36 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 948769bd-efad-5e1f-8401-8398d8568674 with identifier: 202602200084029
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 948769bd-efad-5e1f-8401-8398d8568674
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff809f3b407334c9e9121ac95049da3c0.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f809f3b407334c9e9121ac95049da3c0.jpg not downloaded yet
2026-03-25 17:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0a73a7754ef84556bac34d97caf7eb23.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a8427d9c03b046ee8355f7632e8218d4.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28b4ca50>
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3ef32c4-d64c-542a-8969-b6473b3d6ace/b3ef32c4-d64c-542a-8969-b6473b3d6ace_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F71d4e58777944cf08949dcdc6d4c1c20.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/71d4e58777944cf08949dcdc6d4c1c20.jpg saved to cache
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3ef32c4-d64c-542a-8969-b6473b3d6ace
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3ef32c4-d64c-542a-8969-b6473b3d6ace sending to next pipeline
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28f7a0d0>
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0a6b68b-3fb2-58ca-982a-450e1f14715a/a0a6b68b-3fb2-58ca-982a-450e1f14715a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80328a3c29464d898574c0be3a3ffeba.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80328a3c29464d898574c0be3a3ffeba.jpg saved to cache
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0a6b68b-3fb2-58ca-982a-450e1f14715a
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0a6b68b-3fb2-58ca-982a-450e1f14715a sending to next pipeline
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26f38310>
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_767e4774-926e-5c6a-937f-adf8987bab55/767e4774-926e-5c6a-937f-adf8987bab55_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fff64db448beb47009af82d2f746eaff9.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ff64db448beb47009af82d2f746eaff9.jpg saved to cache
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 767e4774-926e-5c6a-937f-adf8987bab55
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 767e4774-926e-5c6a-937f-adf8987bab55 sending to next pipeline
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28f72090>
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb0fb4cb-00c4-553c-862f-670cf1f21a23/fb0fb4cb-00c4-553c-862f-670cf1f21a23_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0257729bdff0427f9ee787c985e6dc83.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0257729bdff0427f9ee787c985e6dc83.jpg saved to cache
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb0fb4cb-00c4-553c-862f-670cf1f21a23
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb0fb4cb-00c4-553c-862f-670cf1f21a23 sending to next pipeline
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c2657e110>
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c573728d-d41d-5579-8cc9-b012a6e05181/c573728d-d41d-5579-8cc9-b012a6e05181_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc01aa54054c340249d02d402c2599c59.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c01aa54054c340249d02d402c2599c59.jpg saved to cache
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c573728d-d41d-5579-8cc9-b012a6e05181
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c573728d-d41d-5579-8cc9-b012a6e05181 sending to next pipeline
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c265b2850>
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f/fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9df299f3ecf4b08b4dd8baf2637585b.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9df299f3ecf4b08b4dd8baf2637585b.jpg saved to cache
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f sending to next pipeline
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26f39b90>
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78f8599a-246f-5200-bf89-de6cdc45e4fa/78f8599a-246f-5200-bf89-de6cdc45e4fa_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2c72bf8b9a64431c831e4f6e58b3b0a0.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2c72bf8b9a64431c831e4f6e58b3b0a0.jpg saved to cache
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78f8599a-246f-5200-bf89-de6cdc45e4fa
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78f8599a-246f-5200-bf89-de6cdc45e4fa sending to next pipeline
2026-03-25 17:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/5881225da4d741e9ae6b876d015a0e8f.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/dca4b675017b46f192f8bc5e95eda2c7.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/3e686d6d717a4b2cbefa1b44e55a4c79.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:36 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ba8a9558-bcfd-5280-a495-09a69cb7ac16 with identifier: 202602190054738
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ba8a9558-bcfd-5280-a495-09a69cb7ac16
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe25d7851fac40998c318c1a6b21e856.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe25d7851fac40998c318c1a6b21e856.jpg not downloaded yet
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b3ef32c4-d64c-542a-8969-b6473b3d6ace with identifier 202603130668855
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b3ef32c4-d64c-542a-8969-b6473b3d6ace
2026-03-25 17:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/71d4e58777944cf08949dcdc6d4c1c20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': 'b3ef32c4-d64c-542a-8969-b6473b3d6ace',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130668855',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 53,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3ef32c4-d64c-542a-8969-b6473b3d6ace/b3ef32c4-d64c-542a-8969-b6473b3d6ace_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215048,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/71d4e58777944cf08949dcdc6d4c1c20.jpg',
             'Width': 1280}],
 'price': 5999,
 'price_includes_vat': True,
 'registration_date': '2015-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.2i Sting Hatchback 3dr Petrol Manual Euro 6 (70 '
          'ps) Economical .Hatchback.',
 'transmission': 'manual',
 'trim': 'Sting',
 'year': 2015}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130668855%27 HTTP/1.1" 200 None
2026-03-25 17:47:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130668855: {'created_time': 1774460856.81471, 'last_price_update_time': 1774460856.814719}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130668855') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a0a6b68b-3fb2-58ca-982a-450e1f14715a with identifier 202603140700269
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a0a6b68b-3fb2-58ca-982a-450e1f14715a
2026-03-25 17:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/80328a3c29464d898574c0be3a3ffeba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': 'a0a6b68b-3fb2-58ca-982a-450e1f14715a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603140700269',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Astra',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0a6b68b-3fb2-58ca-982a-450e1f14715a/a0a6b68b-3fb2-58ca-982a-450e1f14715a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102122,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/80328a3c29464d898574c0be3a3ffeba.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2018-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Astra 1.4i Turbo SRi Nav Hatchback 5dr Petrol Manual Euro '
          '6 (150 ps) 12 MONTHS MOT, 6 MONTHS WARRANTY.',
 'transmission': 'manual',
 'trim': 'SRi Nav',
 'year': 2018}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603140700269%27 HTTP/1.1" 200 None
2026-03-25 17:47:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603140700269: {'created_time': 1774460856.860854, 'last_price_update_time': 1774460856.860862}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603140700269') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 767e4774-926e-5c6a-937f-adf8987bab55 with identifier 202603050441829
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 767e4774-926e-5c6a-937f-adf8987bab55
2026-03-25 17:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/ff64db448beb47009af82d2f746eaff9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': '767e4774-926e-5c6a-937f-adf8987bab55',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050441829',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 33000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_767e4774-926e-5c6a-937f-adf8987bab55/767e4774-926e-5c6a-937f-adf8987bab55_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205974,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/ff64db448beb47009af82d2f746eaff9.jpg',
             'Width': 1280}],
 'price': 8999,
 'price_includes_vat': True,
 'registration_date': '2019-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.4i ecoTEC SE Nav Hatchback 5dr Petrol Manual Euro '
          '6 (90 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'SE Nav',
 'year': 2019}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050441829%27 HTTP/1.1" 200 None
2026-03-25 17:47:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050441829: {'created_time': 1774460856.909986, 'last_price_update_time': 1774460856.909993}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050441829') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fb0fb4cb-00c4-553c-862f-670cf1f21a23 with identifier 202603100568955
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fb0fb4cb-00c4-553c-862f-670cf1f21a23
2026-03-25 17:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0257729bdff0427f9ee787c985e6dc83.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 189,
 'fuel_type': 'Petrol',
 'id': 'fb0fb4cb-00c4-553c-862f-670cf1f21a23',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100568955',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'MINI',
 'model': 'Hatch',
 'odometer': 36000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 64,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb0fb4cb-00c4-553c-862f-670cf1f21a23/fb0fb4cb-00c4-553c-862f-670cf1f21a23_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204324,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0257729bdff0427f9ee787c985e6dc83.jpg',
             'Width': 1280}],
 'price': 17499,
 'price_includes_vat': True,
 'registration_date': '2020-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Hatch 2.0 Cooper S Sport Hatchback 5dr Petrol Steptronic Euro '
          '6 (s/s) (192 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'automatic',
 'trim': 'Cooper S Sport',
 'year': 2020}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100568955%27 HTTP/1.1" 200 None
2026-03-25 17:47:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100568955: {'created_time': 1774460856.954164, 'last_price_update_time': 1774460856.954171}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100568955') HTTP/1.1" 204 0
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c573728d-d41d-5579-8cc9-b012a6e05181 with identifier 202603110598053
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c573728d-d41d-5579-8cc9-b012a6e05181
2026-03-25 17:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/c01aa54054c340249d02d402c2599c59.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': 'c573728d-d41d-5579-8cc9-b012a6e05181',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110598053',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 23000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 54,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c573728d-d41d-5579-8cc9-b012a6e05181/c573728d-d41d-5579-8cc9-b012a6e05181_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181627,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/c01aa54054c340249d02d402c2599c59.jpg',
             'Width': 1280}],
 'price': 8299,
 'price_includes_vat': True,
 'registration_date': '2017-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.4i ecoFLEX Limited Edition Hatchback 3dr Petrol '
          'Manual Euro 6 (90 ps) Economical .Hatchback.',
 'transmission': 'manual',
 'trim': 'Limited Edition',
 'year': 2017}
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110598053%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110598053: {'created_time': 1774460857.000324, 'last_price_update_time': 1774460857.00033}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110598053') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f with identifier 202603040393338
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e9df299f3ecf4b08b4dd8baf2637585b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': 'fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603040393338',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Mokka X',
 'odometer': 43000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f/fcc7d89b-600d-59b4-bb4c-4a5ad79dfc0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178193,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9df299f3ecf4b08b4dd8baf2637585b.jpg',
             'Width': 1280}],
 'price': 8499,
 'price_includes_vat': True,
 'registration_date': '2018-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka X 1.4i Turbo ecoTEC Active SUV 5dr Petrol Manual '
          'Euro 6 (s/s) (140 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603040393338%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603040393338: {'created_time': 1774460857.054587, 'last_price_update_time': 1774460857.054594}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603040393338') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 78f8599a-246f-5200-bf89-de6cdc45e4fa with identifier 202603100555944
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 78f8599a-246f-5200-bf89-de6cdc45e4fa
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/2c72bf8b9a64431c831e4f6e58b3b0a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '78f8599a-246f-5200-bf89-de6cdc45e4fa',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603100555944',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 18000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 50,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78f8599a-246f-5200-bf89-de6cdc45e4fa/78f8599a-246f-5200-bf89-de6cdc45e4fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205823,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/2c72bf8b9a64431c831e4f6e58b3b0a0.jpg',
             'Width': 1280}],
 'price': 7499,
 'price_includes_vat': True,
 'registration_date': '2017-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ecosport 1.0T EcoBoost Titanium SUV 5dr Petrol Manual 2WD Euro '
          '5 (s/s) (125 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603100555944%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603100555944: {'created_time': 1774460857.103642, 'last_price_update_time': 1774460857.10365}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603100555944') HTTP/1.1" 204 0
2026-03-25 17:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/869c67c6b4f740d09e1df92bbfa025ac.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c266076d0>
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7cc8902a-bc03-5723-98e3-674b2cae019b/7cc8902a-bc03-5723-98e3-674b2cae019b_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F77cfa539ac584bd594b44ba8a6f67561.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/77cfa539ac584bd594b44ba8a6f67561.jpg saved to cache
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7cc8902a-bc03-5723-98e3-674b2cae019b
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7cc8902a-bc03-5723-98e3-674b2cae019b sending to next pipeline
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28ba8b10>
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c01bbbcf-c637-5ae5-ac15-4607fb96c786/c01bbbcf-c637-5ae5-ac15-4607fb96c786_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0a73a7754ef84556bac34d97caf7eb23.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0a73a7754ef84556bac34d97caf7eb23.jpg saved to cache
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c01bbbcf-c637-5ae5-ac15-4607fb96c786
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c01bbbcf-c637-5ae5-ac15-4607fb96c786 sending to next pipeline
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28baa7d0>
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2add016e-0679-5f78-83b1-76abe796651a/2add016e-0679-5f78-83b1-76abe796651a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa8427d9c03b046ee8355f7632e8218d4.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a8427d9c03b046ee8355f7632e8218d4.jpg saved to cache
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2add016e-0679-5f78-83b1-76abe796651a
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2add016e-0679-5f78-83b1-76abe796651a sending to next pipeline
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26625110>
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1061d732-e32f-5a89-b0ac-19d4d0538f99/1061d732-e32f-5a89-b0ac-19d4d0538f99_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5881225da4d741e9ae6b876d015a0e8f.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5881225da4d741e9ae6b876d015a0e8f.jpg saved to cache
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1061d732-e32f-5a89-b0ac-19d4d0538f99
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1061d732-e32f-5a89-b0ac-19d4d0538f99 sending to next pipeline
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28ba3650>
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_939872f1-8901-5e4f-b025-1045a13015e6/939872f1-8901-5e4f-b025-1045a13015e6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdca4b675017b46f192f8bc5e95eda2c7.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/dca4b675017b46f192f8bc5e95eda2c7.jpg saved to cache
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 939872f1-8901-5e4f-b025-1045a13015e6
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 939872f1-8901-5e4f-b025-1045a13015e6 sending to next pipeline
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26ff7490>
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e50419c-9f27-59e3-be3b-523695886b3f/2e50419c-9f27-59e3-be3b-523695886b3f_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e686d6d717a4b2cbefa1b44e55a4c79.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e686d6d717a4b2cbefa1b44e55a4c79.jpg saved to cache
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e50419c-9f27-59e3-be3b-523695886b3f
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e50419c-9f27-59e3-be3b-523695886b3f sending to next pipeline
2026-03-25 17:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/84d7fe1193794f618ac351273f8e6388.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7cc8902a-bc03-5723-98e3-674b2cae019b with identifier 202602270266769
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7cc8902a-bc03-5723-98e3-674b2cae019b
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/77cfa539ac584bd594b44ba8a6f67561.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.25L',
 'engine_horse_power': 81,
 'fuel_type': 'Petrol',
 'id': '7cc8902a-bc03-5723-98e3-674b2cae019b',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270266769',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 32000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cc8902a-bc03-5723-98e3-674b2cae019b/7cc8902a-bc03-5723-98e3-674b2cae019b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193061,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/77cfa539ac584bd594b44ba8a6f67561.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2017-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Zetec Hatchback 5dr Petrol Manual Euro 6 (82 ps) '
          '12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Zetec',
 'year': 2017}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270266769%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270266769: {'created_time': 1774460857.476176, 'last_price_update_time': 1774460857.476184}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270266769') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c01bbbcf-c637-5ae5-ac15-4607fb96c786 with identifier 202603090522604
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c01bbbcf-c637-5ae5-ac15-4607fb96c786
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0a73a7754ef84556bac34d97caf7eb23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': 'c01bbbcf-c637-5ae5-ac15-4607fb96c786',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090522604',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Mokka X',
 'odometer': 30000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 49,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c01bbbcf-c637-5ae5-ac15-4607fb96c786/c01bbbcf-c637-5ae5-ac15-4607fb96c786_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 187716,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0a73a7754ef84556bac34d97caf7eb23.jpg',
             'Width': 1280}],
 'price': 8499,
 'price_includes_vat': True,
 'registration_date': '2017-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka X 1.6i Active SUV 5dr Petrol Manual Euro 6 (s/s) '
          '(115 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090522604%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090522604: {'created_time': 1774460857.520753, 'last_price_update_time': 1774460857.520761}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090522604') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2add016e-0679-5f78-83b1-76abe796651a with identifier 202603090522613
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2add016e-0679-5f78-83b1-76abe796651a
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a8427d9c03b046ee8355f7632e8218d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': '2add016e-0679-5f78-83b1-76abe796651a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603090522613',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 28000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2add016e-0679-5f78-83b1-76abe796651a/2add016e-0679-5f78-83b1-76abe796651a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107684,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a8427d9c03b046ee8355f7632e8218d4.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2016-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 DIG-T N-Connecta SUV 5dr Petrol Manual Euro 6 (s/s) '
          '(115 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603090522613%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603090522613: {'created_time': 1774460857.577188, 'last_price_update_time': 1774460857.577194}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603090522613') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1061d732-e32f-5a89-b0ac-19d4d0538f99 with identifier 202602270266767
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1061d732-e32f-5a89-b0ac-19d4d0538f99
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/5881225da4d741e9ae6b876d015a0e8f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '1061d732-e32f-5a89-b0ac-19d4d0538f99',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270266767',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 42000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1061d732-e32f-5a89-b0ac-19d4d0538f99/1061d732-e32f-5a89-b0ac-19d4d0538f99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183805,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/5881225da4d741e9ae6b876d015a0e8f.jpg',
             'Width': 1280}],
 'price': 5299,
 'price_includes_vat': True,
 'registration_date': '2013-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0T EcoBoost Zetec Hatchback 5dr Petrol Manual Euro 5 '
          '(s/s) (100 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Zetec',
 'year': 2013}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270266767%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270266767: {'created_time': 1774460857.624885, 'last_price_update_time': 1774460857.624894}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270266767') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 939872f1-8901-5e4f-b025-1045a13015e6 with identifier 202603070488395
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 939872f1-8901-5e4f-b025-1045a13015e6
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/dca4b675017b46f192f8bc5e95eda2c7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': '939872f1-8901-5e4f-b025-1045a13015e6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603070488395',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Fiat',
 'model': '500',
 'odometer': 32000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 42,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_939872f1-8901-5e4f-b025-1045a13015e6/939872f1-8901-5e4f-b025-1045a13015e6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194390,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/dca4b675017b46f192f8bc5e95eda2c7.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2019-05-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge Hatchback 3dr Petrol Manual Euro 6 (s/s) (69 '
          'bhp) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603070488395%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603070488395: {'created_time': 1774460857.709459, 'last_price_update_time': 1774460857.709468}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603070488395') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2e50419c-9f27-59e3-be3b-523695886b3f with identifier 202602270266719
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2e50419c-9f27-59e3-be3b-523695886b3f
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/3e686d6d717a4b2cbefa1b44e55a4c79.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'Silver',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.2L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': '2e50419c-9f27-59e3-be3b-523695886b3f',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602270266719',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 48000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e50419c-9f27-59e3-be3b-523695886b3f/2e50419c-9f27-59e3-be3b-523695886b3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180035,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e686d6d717a4b2cbefa1b44e55a4c79.jpg',
             'Width': 1280}],
 'price': 5499,
 'price_includes_vat': True,
 'registration_date': '2015-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 DIG-T Acenta Premium SUV 5dr Petrol Manual 6Spd '
          'Euro 5 (s/s) (115 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Acenta Premium',
 'year': 2015}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602270266719%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602270266719: {'created_time': 1774460857.752069, 'last_price_update_time': 1774460857.752076}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270266719') HTTP/1.1" 204 0
2026-03-25 17:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/1316abbb7cbb4587bdac84303f81d32a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c266f6550>
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7006896-bea4-52c4-9238-3f2c69cf887e/d7006896-bea4-52c4-9238-3f2c69cf887e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F869c67c6b4f740d09e1df92bbfa025ac.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/869c67c6b4f740d09e1df92bbfa025ac.jpg saved to cache
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7006896-bea4-52c4-9238-3f2c69cf887e
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7006896-bea4-52c4-9238-3f2c69cf887e sending to next pipeline
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e84251-0c7b-5e1b-948f-6ac4cefc9c35 with identifier: 202601249391523
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 96e84251-0c7b-5e1b-948f-6ac4cefc9c35
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38ba5c9b074e42e9a5cedeae1bdb09e3.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38ba5c9b074e42e9a5cedeae1bdb09e3.jpg not downloaded yet
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28b96250>
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b20278f-893c-5468-b019-b3ef311d918a/2b20278f-893c-5468-b019-b3ef311d918a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F84d7fe1193794f618ac351273f8e6388.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/84d7fe1193794f618ac351273f8e6388.jpg saved to cache
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b20278f-893c-5468-b019-b3ef311d918a
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b20278f-893c-5468-b019-b3ef311d918a sending to next pipeline
2026-03-25 17:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/f809f3b407334c9e9121ac95049da3c0.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d7006896-bea4-52c4-9238-3f2c69cf887e with identifier 202602260231826
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d7006896-bea4-52c4-9238-3f2c69cf887e
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/869c67c6b4f740d09e1df92bbfa025ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'd7006896-bea4-52c4-9238-3f2c69cf887e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260231826',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Grandland X',
 'odometer': 50000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7006896-bea4-52c4-9238-3f2c69cf887e/d7006896-bea4-52c4-9238-3f2c69cf887e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94566,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/869c67c6b4f740d09e1df92bbfa025ac.jpg',
             'Width': 1280}],
 'price': 11499,
 'price_includes_vat': True,
 'registration_date': '2019-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Grandland X 1.2 Turbo GPF Sport Nav SUV 5dr Petrol Auto '
          'Euro 6 (s/s) (130 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'automatic',
 'trim': 'Sport Nav',
 'year': 2019}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231826%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260231826: {'created_time': 1774460857.910871, 'last_price_update_time': 1774460857.910879}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260231826') HTTP/1.1" 204 0
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2b20278f-893c-5468-b019-b3ef311d918a with identifier 202602260231763
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2b20278f-893c-5468-b019-b3ef311d918a
2026-03-25 17:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/84d7fe1193794f618ac351273f8e6388.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.4L',
 'engine_horse_power': 98,
 'fuel_type': 'Petrol',
 'id': '2b20278f-893c-5468-b019-b3ef311d918a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602260231763',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 33000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b20278f-893c-5468-b019-b3ef311d918a/2b20278f-893c-5468-b019-b3ef311d918a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196660,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/84d7fe1193794f618ac351273f8e6388.jpg',
             'Width': 1280}],
 'price': 5999,
 'price_includes_vat': True,
 'registration_date': '2012-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Jazz 1.4 i-VTEC ES Hatchback 5dr Petrol Manual Euro 5 (99 ps) '
          '12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'ES',
 'year': 2012}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602260231763%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602260231763: {'created_time': 1774460857.957252, 'last_price_update_time': 1774460857.957261}
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602260231763') HTTP/1.1" 204 0
2026-03-25 17:47:37 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 07226770-c776-5e1f-a81b-f1a14c0ceddb with identifier: 202601239365449
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 07226770-c776-5e1f-a81b-f1a14c0ceddb
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f73272c4b37461aaf7192f82def7e82.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f73272c4b37461aaf7192f82def7e82.jpg not downloaded yet
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dc7e5b9-36ab-5971-a1f0-2f306e33b93a with identifier: 202601239365208
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 1dc7e5b9-36ab-5971-a1f0-2f306e33b93a
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4173403f5b4144039d9b8af08505e5a9.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4173403f5b4144039d9b8af08505e5a9.jpg not downloaded yet
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28b8d950>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1f1cdac-2c94-5632-86fa-df1bb52c71d9/e1f1cdac-2c94-5632-86fa-df1bb52c71d9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1316abbb7cbb4587bdac84303f81d32a.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1316abbb7cbb4587bdac84303f81d32a.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1f1cdac-2c94-5632-86fa-df1bb52c71d9
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1f1cdac-2c94-5632-86fa-df1bb52c71d9 sending to next pipeline
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26581e50>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_948769bd-efad-5e1f-8401-8398d8568674/948769bd-efad-5e1f-8401-8398d8568674_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff809f3b407334c9e9121ac95049da3c0.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f809f3b407334c9e9121ac95049da3c0.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 948769bd-efad-5e1f-8401-8398d8568674
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 948769bd-efad-5e1f-8401-8398d8568674 sending to next pipeline
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fe25d7851fac40998c318c1a6b21e856.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d4fff38-e30c-5d2a-8241-db2fe33c578d with identifier: 202601149131452
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5d4fff38-e30c-5d2a-8241-db2fe33c578d
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffca5d95f72dc482b841d02eb00574ecc.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fca5d95f72dc482b841d02eb00574ecc.jpg not downloaded yet
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e1f1cdac-2c94-5632-86fa-df1bb52c71d9 with identifier 202602230150178
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e1f1cdac-2c94-5632-86fa-df1bb52c71d9
2026-03-25 17:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/1316abbb7cbb4587bdac84303f81d32a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'fuel_type': 'Petrol',
 'id': 'e1f1cdac-2c94-5632-86fa-df1bb52c71d9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602230150178',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Crossland X',
 'odometer': 22000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1f1cdac-2c94-5632-86fa-df1bb52c71d9/e1f1cdac-2c94-5632-86fa-df1bb52c71d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186725,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/1316abbb7cbb4587bdac84303f81d32a.jpg',
             'Width': 1280}],
 'price': 10999,
 'price_includes_vat': True,
 'registration_date': '2019-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Crossland X 1.2 Turbo Elite SUV 5dr Petrol Auto Euro 6 '
          '(s/s) (130 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'automatic',
 'trim': 'Elite',
 'year': 2019}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602230150178%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602230150178: {'created_time': 1774460858.167485, 'last_price_update_time': 1774460858.167493}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602230150178') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 948769bd-efad-5e1f-8401-8398d8568674 with identifier 202602200084029
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 948769bd-efad-5e1f-8401-8398d8568674
2026-03-25 17:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/f809f3b407334c9e9121ac95049da3c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': '948769bd-efad-5e1f-8401-8398d8568674',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602200084029',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Fiat',
 'model': '500',
 'odometer': 37000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 48,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_948769bd-efad-5e1f-8401-8398d8568674/948769bd-efad-5e1f-8401-8398d8568674_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198733,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/f809f3b407334c9e9121ac95049da3c0.jpg',
             'Width': 1280}],
 'price': 6599,
 'price_includes_vat': True,
 'registration_date': '2017-10-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 ECO Pop Star Hatchback 3dr Petrol Manual Euro 6 (s/s) '
          '(69 bhp) 12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2017}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602200084029%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602200084029: {'created_time': 1774460858.208899, 'last_price_update_time': 1774460858.208905}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602200084029') HTTP/1.1" 204 0
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ff0526a6-0f94-50a0-a7c0-e64292f01c47 with identifier: 202512138569346
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ff0526a6-0f94-50a0-a7c0-e64292f01c47
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4c68ee19c81f40ddb1d617b07786ee50.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4c68ee19c81f40ddb1d617b07786ee50.jpg not downloaded yet
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28bdba50>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba8a9558-bcfd-5280-a495-09a69cb7ac16/ba8a9558-bcfd-5280-a495-09a69cb7ac16_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffe25d7851fac40998c318c1a6b21e856.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fe25d7851fac40998c318c1a6b21e856.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba8a9558-bcfd-5280-a495-09a69cb7ac16
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba8a9558-bcfd-5280-a495-09a69cb7ac16 sending to next pipeline
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/38ba5c9b074e42e9a5cedeae1bdb09e3.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a743f997-4f46-5375-b50a-406a37546ec6 with identifier: 202512088446850
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a743f997-4f46-5375-b50a-406a37546ec6
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd3e4795e94b4bb68cdec3bd965460c9.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd3e4795e94b4bb68cdec3bd965460c9.jpg not downloaded yet
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ba8a9558-bcfd-5280-a495-09a69cb7ac16 with identifier 202602190054738
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ba8a9558-bcfd-5280-a495-09a69cb7ac16
2026-03-25 17:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fe25d7851fac40998c318c1a6b21e856.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 129,
 'fuel_type': 'Petrol',
 'id': 'ba8a9558-bcfd-5280-a495-09a69cb7ac16',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602190054738',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 33000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 65,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba8a9558-bcfd-5280-a495-09a69cb7ac16/ba8a9558-bcfd-5280-a495-09a69cb7ac16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199303,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fe25d7851fac40998c318c1a6b21e856.jpg',
             'Width': 1280}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2019-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech GPF GT Line Hatchback 5dr Petrol Manual '
          'Euro 6 (s/s) (130 ps) Euro 6, Navigation.Panoramic Roof.',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602190054738%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602190054738: {'created_time': 1774460858.35485, 'last_price_update_time': 1774460858.354857}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602190054738') HTTP/1.1" 204 0
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5db182f4-adf0-5a4c-ab59-acaabea87977 with identifier: 202511208020790
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5db182f4-adf0-5a4c-ab59-acaabea87977
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2350ff2f86a44a890fdce46db2f9022.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2350ff2f86a44a890fdce46db2f9022.jpg not downloaded yet
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4173403f5b4144039d9b8af08505e5a9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c992789-ebdc-54f2-949b-beb83d2b03f5 with identifier: 202511157911105
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9c992789-ebdc-54f2-949b-beb83d2b03f5
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F409d01dfe978427dba5dccce9d864331.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/409d01dfe978427dba5dccce9d864331.jpg not downloaded yet
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c569e8b4-e653-51fc-8b4f-a3424fc2c251 with identifier: 202508195573497
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item c569e8b4-e653-51fc-8b4f-a3424fc2c251
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4341f8068c254e69a453b09f9f42f2a1.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4341f8068c254e69a453b09f9f42f2a1.jpg not downloaded yet
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28b15a50>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96e84251-0c7b-5e1b-948f-6ac4cefc9c35/96e84251-0c7b-5e1b-948f-6ac4cefc9c35_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F38ba5c9b074e42e9a5cedeae1bdb09e3.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/38ba5c9b074e42e9a5cedeae1bdb09e3.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96e84251-0c7b-5e1b-948f-6ac4cefc9c35
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96e84251-0c7b-5e1b-948f-6ac4cefc9c35 sending to next pipeline
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:38 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bb8453e-605c-5769-ac46-2f1adedf5776 with identifier: 202505122308959
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 8bb8453e-605c-5769-ac46-2f1adedf5776
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0566e67e769c49609d871a04e2b774ef.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0566e67e769c49609d871a04e2b774ef.jpg not downloaded yet
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 96e84251-0c7b-5e1b-948f-6ac4cefc9c35 with identifier 202601249391523
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 96e84251-0c7b-5e1b-948f-6ac4cefc9c35
2026-03-25 17:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/38ba5c9b074e42e9a5cedeae1bdb09e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 123,
 'fuel_type': 'Petrol',
 'id': '96e84251-0c7b-5e1b-948f-6ac4cefc9c35',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601249391523',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 44000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96e84251-0c7b-5e1b-948f-6ac4cefc9c35/96e84251-0c7b-5e1b-948f-6ac4cefc9c35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205777,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/38ba5c9b074e42e9a5cedeae1bdb09e3.jpg',
             'Width': 1280}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2019-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ecosport 1.0T EcoBoost GPF Zetec SUV 5dr Petrol Auto Euro 6 '
          '(s/s) (125 ps) Economical .Navigation.',
 'transmission': 'automatic',
 'trim': 'Zetec',
 'year': 2019}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601249391523%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601249391523: {'created_time': 1774460858.52077, 'last_price_update_time': 1774460858.520778}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601249391523') HTTP/1.1" 204 0
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8f73272c4b37461aaf7192f82def7e82.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4c68ee19c81f40ddb1d617b07786ee50.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28bdb9d0>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dc7e5b9-36ab-5971-a1f0-2f306e33b93a/1dc7e5b9-36ab-5971-a1f0-2f306e33b93a_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4173403f5b4144039d9b8af08505e5a9.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4173403f5b4144039d9b8af08505e5a9.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dc7e5b9-36ab-5971-a1f0-2f306e33b93a
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dc7e5b9-36ab-5971-a1f0-2f306e33b93a sending to next pipeline
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/fca5d95f72dc482b841d02eb00574ecc.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1dc7e5b9-36ab-5971-a1f0-2f306e33b93a with identifier 202601239365208
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1dc7e5b9-36ab-5971-a1f0-2f306e33b93a
2026-03-25 17:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4173403f5b4144039d9b8af08505e5a9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 134,
 'fuel_type': 'Petrol',
 'id': '1dc7e5b9-36ab-5971-a1f0-2f306e33b93a',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601239365208',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'BMW',
 'model': '1 Series',
 'odometer': 38000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 63,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dc7e5b9-36ab-5971-a1f0-2f306e33b93a/1dc7e5b9-36ab-5971-a1f0-2f306e33b93a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184727,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4173403f5b4144039d9b8af08505e5a9.jpg',
             'Width': 1280}],
 'price': 11499,
 'price_includes_vat': True,
 'registration_date': '2017-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1 SERIES 1.5 118i SE Hatchback 5dr Petrol Auto Euro 6 (s/s) '
          '(136 ps) Euro 6, Navigation.',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2017}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239365208%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601239365208: {'created_time': 1774460858.61341, 'last_price_update_time': 1774460858.613417}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239365208') HTTP/1.1" 204 0
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/cd3e4795e94b4bb68cdec3bd965460c9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a2350ff2f86a44a890fdce46db2f9022.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28fde390>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07226770-c776-5e1f-a81b-f1a14c0ceddb/07226770-c776-5e1f-a81b-f1a14c0ceddb_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f73272c4b37461aaf7192f82def7e82.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f73272c4b37461aaf7192f82def7e82.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07226770-c776-5e1f-a81b-f1a14c0ceddb
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07226770-c776-5e1f-a81b-f1a14c0ceddb sending to next pipeline
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 07226770-c776-5e1f-a81b-f1a14c0ceddb with identifier 202601239365449
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 07226770-c776-5e1f-a81b-f1a14c0ceddb
2026-03-25 17:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8f73272c4b37461aaf7192f82def7e82.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': '07226770-c776-5e1f-a81b-f1a14c0ceddb',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601239365449',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 44000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07226770-c776-5e1f-a81b-f1a14c0ceddb/07226770-c776-5e1f-a81b-f1a14c0ceddb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199896,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f73272c4b37461aaf7192f82def7e82.jpg',
             'Width': 1280}],
 'price': 8499,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 DIG-T Tekna SUV 5dr Petrol Manual Euro 6 (s/s) (115 '
          'ps) Economical .Navigation.',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2018}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601239365449%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601239365449: {'created_time': 1774460858.708631, 'last_price_update_time': 1774460858.708642}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601239365449') HTTP/1.1" 204 0
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c265ec9d0>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff0526a6-0f94-50a0-a7c0-e64292f01c47/ff0526a6-0f94-50a0-a7c0-e64292f01c47_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4c68ee19c81f40ddb1d617b07786ee50.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4c68ee19c81f40ddb1d617b07786ee50.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff0526a6-0f94-50a0-a7c0-e64292f01c47
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff0526a6-0f94-50a0-a7c0-e64292f01c47 sending to next pipeline
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c2a3554d0>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d4fff38-e30c-5d2a-8241-db2fe33c578d/5d4fff38-e30c-5d2a-8241-db2fe33c578d_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffca5d95f72dc482b841d02eb00574ecc.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fca5d95f72dc482b841d02eb00574ecc.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d4fff38-e30c-5d2a-8241-db2fe33c578d
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d4fff38-e30c-5d2a-8241-db2fe33c578d sending to next pipeline
2026-03-25 17:47:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0566e67e769c49609d871a04e2b774ef.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ff0526a6-0f94-50a0-a7c0-e64292f01c47 with identifier 202512138569346
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ff0526a6-0f94-50a0-a7c0-e64292f01c47
2026-03-25 17:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4c68ee19c81f40ddb1d617b07786ee50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'fuel_type': 'Petrol',
 'id': 'ff0526a6-0f94-50a0-a7c0-e64292f01c47',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512138569346',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 27000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff0526a6-0f94-50a0-a7c0-e64292f01c47/ff0526a6-0f94-50a0-a7c0-e64292f01c47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202523,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4c68ee19c81f40ddb1d617b07786ee50.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2015-12-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ecosport 1.5 Titanium SUV 5dr Petrol Powershift 2WD Euro 5 '
          '(112 ps) 12 Months MOT + 6 Months Warranty',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512138569346%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512138569346: {'created_time': 1774460858.849086, 'last_price_update_time': 1774460858.849099}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512138569346') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5d4fff38-e30c-5d2a-8241-db2fe33c578d with identifier 202601149131452
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5d4fff38-e30c-5d2a-8241-db2fe33c578d
2026-03-25 17:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/fca5d95f72dc482b841d02eb00574ecc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '5d4fff38-e30c-5d2a-8241-db2fe33c578d',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601149131452',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Mokka X',
 'odometer': 44000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 62,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d4fff38-e30c-5d2a-8241-db2fe33c578d/5d4fff38-e30c-5d2a-8241-db2fe33c578d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208819,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/fca5d95f72dc482b841d02eb00574ecc.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2017-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Mokka X 1.4i Turbo Design Nav SUV 5dr Petrol Manual Euro 6 '
          '(s/s) (140 ps) Economical .',
 'transmission': 'manual',
 'trim': 'Design Nav',
 'year': 2017}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601149131452%27 HTTP/1.1" 200 None
2026-03-25 17:47:38 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601149131452: {'created_time': 1774460858.901754, 'last_price_update_time': 1774460858.901761}
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149131452') HTTP/1.1" 204 0
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26614c90>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a743f997-4f46-5375-b50a-406a37546ec6/a743f997-4f46-5375-b50a-406a37546ec6_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcd3e4795e94b4bb68cdec3bd965460c9.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cd3e4795e94b4bb68cdec3bd965460c9.jpg saved to cache
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a743f997-4f46-5375-b50a-406a37546ec6
2026-03-25 17:47:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a743f997-4f46-5375-b50a-406a37546ec6 sending to next pipeline
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c25b3e6d0>
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5db182f4-adf0-5a4c-ab59-acaabea87977/5db182f4-adf0-5a4c-ab59-acaabea87977_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa2350ff2f86a44a890fdce46db2f9022.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a2350ff2f86a44a890fdce46db2f9022.jpg saved to cache
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5db182f4-adf0-5a4c-ab59-acaabea87977
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5db182f4-adf0-5a4c-ab59-acaabea87977 sending to next pipeline
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a743f997-4f46-5375-b50a-406a37546ec6 with identifier 202512088446850
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a743f997-4f46-5375-b50a-406a37546ec6
2026-03-25 17:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/cd3e4795e94b4bb68cdec3bd965460c9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': 'a743f997-4f46-5375-b50a-406a37546ec6',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202512088446850',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 46000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 55,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a743f997-4f46-5375-b50a-406a37546ec6/a743f997-4f46-5375-b50a-406a37546ec6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204289,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/cd3e4795e94b4bb68cdec3bd965460c9.jpg',
             'Width': 1280}],
 'price': 4999,
 'price_includes_vat': True,
 'registration_date': '2016-11-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge Hatchback 5dr Petrol Manual Euro 6 (69 bhp) '
          '12 Months MOT + 6 Months Warranty',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202512088446850%27 HTTP/1.1" 200 None
2026-03-25 17:47:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202512088446850: {'created_time': 1774460859.029676, 'last_price_update_time': 1774460859.029683}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202512088446850') HTTP/1.1" 204 0
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5db182f4-adf0-5a4c-ab59-acaabea87977 with identifier 202511208020790
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5db182f4-adf0-5a4c-ab59-acaabea87977
2026-03-25 17:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a2350ff2f86a44a890fdce46db2f9022.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.5L',
 'engine_horse_power': 148,
 'fuel_type': 'Petrol',
 'id': '5db182f4-adf0-5a4c-ab59-acaabea87977',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511208020790',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 51000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5db182f4-adf0-5a4c-ab59-acaabea87977/5db182f4-adf0-5a4c-ab59-acaabea87977_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 198936,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a2350ff2f86a44a890fdce46db2f9022.jpg',
             'Width': 1280}],
 'price': 16499,
 'price_includes_vat': True,
 'registration_date': '2021-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.5 TFSI CoD 35 S line SUV 5dr Petrol S Tronic Euro 6 (s/s) '
          '(150 ps) Economical. Half Leather,Navigation',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511208020790%27 HTTP/1.1" 200 None
2026-03-25 17:47:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511208020790: {'created_time': 1774460859.07498, 'last_price_update_time': 1774460859.074988}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511208020790') HTTP/1.1" 204 0
2026-03-25 17:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4341f8068c254e69a453b09f9f42f2a1.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/409d01dfe978427dba5dccce9d864331.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c25b3cb50>
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bb8453e-605c-5769-ac46-2f1adedf5776/8bb8453e-605c-5769-ac46-2f1adedf5776_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0566e67e769c49609d871a04e2b774ef.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0566e67e769c49609d871a04e2b774ef.jpg saved to cache
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bb8453e-605c-5769-ac46-2f1adedf5776
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bb8453e-605c-5769-ac46-2f1adedf5776 sending to next pipeline
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 8bb8453e-605c-5769-ac46-2f1adedf5776 with identifier 202505122308959
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 8bb8453e-605c-5769-ac46-2f1adedf5776
2026-03-25 17:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0566e67e769c49609d871a04e2b774ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 196,
 'color': 'Silver',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 187,
 'fuel_type': 'Diesel',
 'id': '8bb8453e-605c-5769-ac46-2f1adedf5776',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202505122308959',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 46,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bb8453e-605c-5769-ac46-2f1adedf5776/8bb8453e-605c-5769-ac46-2f1adedf5776_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215264,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0566e67e769c49609d871a04e2b774ef.jpg',
             'Width': 1280}],
 'price': 59999,
 'price_includes_vat': True,
 'registration_date': '2023-09-01',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 2.0 119 CDI SELECT Tourer Double Cab 5dr Diesel '
          'G-Tronic RWD L3 Euro 6 (s/s) (190 ps) XLWB, PRIVACY GLASS, ALLOYS',
 'transmission': 'automatic',
 'trim': 'SELECT',
 'year': 2023}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202505122308959%27 HTTP/1.1" 200 None
2026-03-25 17:47:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202505122308959: {'created_time': 1774460859.168522, 'last_price_update_time': 1774460859.168529}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202505122308959') HTTP/1.1" 204 0
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26576f50>
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c569e8b4-e653-51fc-8b4f-a3424fc2c251/c569e8b4-e653-51fc-8b4f-a3424fc2c251_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4341f8068c254e69a453b09f9f42f2a1.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4341f8068c254e69a453b09f9f42f2a1.jpg saved to cache
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c569e8b4-e653-51fc-8b4f-a3424fc2c251
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c569e8b4-e653-51fc-8b4f-a3424fc2c251 sending to next pipeline
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28f60b90>
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c992789-ebdc-54f2-949b-beb83d2b03f5/9c992789-ebdc-54f2-949b-beb83d2b03f5_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F409d01dfe978427dba5dccce9d864331.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/409d01dfe978427dba5dccce9d864331.jpg saved to cache
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c992789-ebdc-54f2-949b-beb83d2b03f5
2026-03-25 17:47:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c992789-ebdc-54f2-949b-beb83d2b03f5 sending to next pipeline
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c569e8b4-e653-51fc-8b4f-a3424fc2c251 with identifier 202508195573497
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c569e8b4-e653-51fc-8b4f-a3424fc2c251
2026-03-25 17:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4341f8068c254e69a453b09f9f42f2a1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'Silver',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '0.9L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': 'c569e8b4-e653-51fc-8b4f-a3424fc2c251',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508195573497',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 51000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c569e8b4-e653-51fc-8b4f-a3424fc2c251/c569e8b4-e653-51fc-8b4f-a3424fc2c251_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216531,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4341f8068c254e69a453b09f9f42f2a1.jpg',
             'Width': 1280}],
 'price': 6499,
 'price_includes_vat': True,
 'registration_date': '2017-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 0.9 TCe ENERGY Dynamique Nav SUV 5dr Petrol Manual '
          'Euro 6 (s/s) (90 ps) 2 Owners',
 'transmission': 'manual',
 'trim': 'Dynamique Nav',
 'year': 2017}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508195573497%27 HTTP/1.1" 200 None
2026-03-25 17:47:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508195573497: {'created_time': 1774460859.304804, 'last_price_update_time': 1774460859.304812}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508195573497') HTTP/1.1" 204 0
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9c992789-ebdc-54f2-949b-beb83d2b03f5 with identifier 202511157911105
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9c992789-ebdc-54f2-949b-beb83d2b03f5
2026-03-25 17:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/409d01dfe978427dba5dccce9d864331.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 5',
 'engine': '1.2L',
 'engine_horse_power': 104,
 'fuel_type': 'Petrol',
 'id': '9c992789-ebdc-54f2-949b-beb83d2b03f5',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202511157911105',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 19000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c992789-ebdc-54f2-949b-beb83d2b03f5/9c992789-ebdc-54f2-949b-beb83d2b03f5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 197866,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/409d01dfe978427dba5dccce9d864331.jpg',
             'Width': 1280}],
 'price': 6999,
 'price_includes_vat': True,
 'registration_date': '2013-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'SKODA Fabia 1.2 TSI Elegance Estate 5dr Petrol DSG Euro 5 (105 ps) '
          'Euro 6,12 Months warranty.',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2013}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202511157911105%27 HTTP/1.1" 200 None
2026-03-25 17:47:39 [auto_selling_autotrader.co.uk] INFO: Saving data for 202511157911105: {'created_time': 1774460859.353662, 'last_price_update_time': 1774460859.353668}
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202511157911105') HTTP/1.1" 204 0
2026-03-25 17:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe4d790-3bec-5f46-b80e-7dd233ef5c38 with identifier: 202602169957143
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 5fe4d790-3bec-5f46-b80e-7dd233ef5c38
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f77ce895083412190718dc1ccf8a7c2.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f77ce895083412190718dc1ccf8a7c2.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 21c1cc19-9219-538f-a756-e91cee5edcf9 with identifier: 202602119846881
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 21c1cc19-9219-538f-a756-e91cee5edcf9
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe2f9d86a4c314c6caf2def4f61a1eb64.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e2f9d86a4c314c6caf2def4f61a1eb64.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ec291d99-1f0f-5d6f-8288-75879670bd5c with identifier: 202602119845502
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item ec291d99-1f0f-5d6f-8288-75879670bd5c
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e0b89ef27b94034a9f4a5d4c936e3fb.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e0b89ef27b94034a9f4a5d4c936e3fb.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b82d2bd9-d867-5bdc-9d08-9b78f2541b96 with identifier: 202602109816138
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item b82d2bd9-d867-5bdc-9d08-9b78f2541b96
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ace21c3794d45479b237e46dafb3df9.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ace21c3794d45479b237e46dafb3df9.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: dd36ad3c-1eb4-5cff-b2db-667f5af6d018 with identifier: 202602079751429
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item dd36ad3c-1eb4-5cff-b2db-667f5af6d018
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c8b8d88a17c43bab07807344321c709.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c8b8d88a17c43bab07807344321c709.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0543d837-4ae2-5a98-a973-f1604aebe43e with identifier: 202602079751302
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 0543d837-4ae2-5a98-a973-f1604aebe43e
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4935d1f5795b4209a62e19afa278b282.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4935d1f5795b4209a62e19afa278b282.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 614747a4-c893-56cc-8b04-ae3e632c7eff with identifier: 202601319573569
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 614747a4-c893-56cc-8b04-ae3e632c7eff
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa586af87b0b64aed853235845bd3236a.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a586af87b0b64aed853235845bd3236a.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06 with identifier: 202601309546285
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F409577182eed429580fd50e33d168834.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/409577182eed429580fd50e33d168834.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e806837-93a6-55e5-a0eb-b5a656b4c698 with identifier: 202601299510542
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 9e806837-93a6-55e5-a0eb-b5a656b4c698
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25c300b82e154055b0319f7352cabf0c.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25c300b82e154055b0319f7352cabf0c.jpg not downloaded yet
2026-03-25 17:47:45 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-25 17:47:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 59aa57ea-a882-528f-a300-901d0d9a8432 with identifier: 202601269424156
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 59aa57ea-a882-528f-a300-901d0d9a8432
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe67248c737704fba98c4e1a160a0482b.jpg%27 HTTP/1.1" 200 None
2026-03-25 17:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e67248c737704fba98c4e1a160a0482b.jpg not downloaded yet
2026-03-25 17:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/8f77ce895083412190718dc1ccf8a7c2.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/9e0b89ef27b94034a9f4a5d4c936e3fb.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e2f9d86a4c314c6caf2def4f61a1eb64.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0ace21c3794d45479b237e46dafb3df9.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/0c8b8d88a17c43bab07807344321c709.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/a586af87b0b64aed853235845bd3236a.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28bb8c90>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fe4d790-3bec-5f46-b80e-7dd233ef5c38/5fe4d790-3bec-5f46-b80e-7dd233ef5c38_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8f77ce895083412190718dc1ccf8a7c2.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8f77ce895083412190718dc1ccf8a7c2.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fe4d790-3bec-5f46-b80e-7dd233ef5c38
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fe4d790-3bec-5f46-b80e-7dd233ef5c38 sending to next pipeline
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 5fe4d790-3bec-5f46-b80e-7dd233ef5c38 with identifier 202602169957143
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 5fe4d790-3bec-5f46-b80e-7dd233ef5c38
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/8f77ce895083412190718dc1ccf8a7c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 89,
 'fuel_type': 'Petrol',
 'id': '5fe4d790-3bec-5f46-b80e-7dd233ef5c38',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169957143',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Corsa',
 'odometer': 44000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fe4d790-3bec-5f46-b80e-7dd233ef5c38/5fe4d790-3bec-5f46-b80e-7dd233ef5c38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176569,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/8f77ce895083412190718dc1ccf8a7c2.jpg',
             'Width': 1280}],
 'price': 5999,
 'price_includes_vat': True,
 'registration_date': '2015-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Corsa 1.4i ecoFLEX SRi Hatchback 5dr Petrol Manual Euro 6 '
          '(90 ps) Air con, Alloys',
 'transmission': 'manual',
 'trim': 'SRi',
 'year': 2015}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169957143%27 HTTP/1.1" 200 None
2026-03-25 17:47:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169957143: {'created_time': 1774460866.108135, 'last_price_update_time': 1774460866.108147}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169957143') HTTP/1.1" 204 0
2026-03-25 17:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/4935d1f5795b4209a62e19afa278b282.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/25c300b82e154055b0319f7352cabf0c.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/409577182eed429580fd50e33d168834.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://m.atcdn.co.uk/a/media/e67248c737704fba98c4e1a160a0482b.jpg> (referer: https://www.autotrader.co.uk/)
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c265e3250>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec291d99-1f0f-5d6f-8288-75879670bd5c/ec291d99-1f0f-5d6f-8288-75879670bd5c_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9e0b89ef27b94034a9f4a5d4c936e3fb.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9e0b89ef27b94034a9f4a5d4c936e3fb.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec291d99-1f0f-5d6f-8288-75879670bd5c
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec291d99-1f0f-5d6f-8288-75879670bd5c sending to next pipeline
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28ba1290>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21c1cc19-9219-538f-a756-e91cee5edcf9/21c1cc19-9219-538f-a756-e91cee5edcf9_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe2f9d86a4c314c6caf2def4f61a1eb64.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e2f9d86a4c314c6caf2def4f61a1eb64.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21c1cc19-9219-538f-a756-e91cee5edcf9
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21c1cc19-9219-538f-a756-e91cee5edcf9 sending to next pipeline
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c26540d10>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82d2bd9-d867-5bdc-9d08-9b78f2541b96/b82d2bd9-d867-5bdc-9d08-9b78f2541b96_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0ace21c3794d45479b237e46dafb3df9.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0ace21c3794d45479b237e46dafb3df9.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b82d2bd9-d867-5bdc-9d08-9b78f2541b96
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b82d2bd9-d867-5bdc-9d08-9b78f2541b96 sending to next pipeline
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28fcff90>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd36ad3c-1eb4-5cff-b2db-667f5af6d018/dd36ad3c-1eb4-5cff-b2db-667f5af6d018_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0c8b8d88a17c43bab07807344321c709.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0c8b8d88a17c43bab07807344321c709.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd36ad3c-1eb4-5cff-b2db-667f5af6d018
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd36ad3c-1eb4-5cff-b2db-667f5af6d018 sending to next pipeline
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c2653f690>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_614747a4-c893-56cc-8b04-ae3e632c7eff/614747a4-c893-56cc-8b04-ae3e632c7eff_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa586af87b0b64aed853235845bd3236a.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a586af87b0b64aed853235845bd3236a.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 614747a4-c893-56cc-8b04-ae3e632c7eff
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 614747a4-c893-56cc-8b04-ae3e632c7eff sending to next pipeline
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ec291d99-1f0f-5d6f-8288-75879670bd5c with identifier 202602119845502
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ec291d99-1f0f-5d6f-8288-75879670bd5c
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/9e0b89ef27b94034a9f4a5d4c936e3fb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1L',
 'engine_horse_power': 67,
 'fuel_type': 'Petrol',
 'id': 'ec291d99-1f0f-5d6f-8288-75879670bd5c',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602119845502',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Toyota',
 'model': 'AYGO',
 'odometer': 29000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec291d99-1f0f-5d6f-8288-75879670bd5c/ec291d99-1f0f-5d6f-8288-75879670bd5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 209691,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/9e0b89ef27b94034a9f4a5d4c936e3fb.jpg',
             'Width': 1280}],
 'price': 6999,
 'price_includes_vat': True,
 'registration_date': '2017-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 VVT-i x-play Hatchback 5dr Petrol Manual Euro 6 (68 '
          'ps) Economical .',
 'transmission': 'manual',
 'trim': 'x-play',
 'year': 2017}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119845502%27 HTTP/1.1" 200 None
2026-03-25 17:47:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602119845502: {'created_time': 1774460866.451186, 'last_price_update_time': 1774460866.451193}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602119845502') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 21c1cc19-9219-538f-a756-e91cee5edcf9 with identifier 202602119846881
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 21c1cc19-9219-538f-a756-e91cee5edcf9
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e2f9d86a4c314c6caf2def4f61a1eb64.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 141,
 'fuel_type': 'Petrol Hybrid',
 'id': '21c1cc19-9219-538f-a756-e91cee5edcf9',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602119846881',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 10000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 60,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21c1cc19-9219-538f-a756-e91cee5edcf9/21c1cc19-9219-538f-a756-e91cee5edcf9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232848,
             'Height': 959,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e2f9d86a4c314c6caf2def4f61a1eb64.jpg',
             'Width': 1280}],
 'price': 16999,
 'price_includes_vat': True,
 'registration_date': '2023-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.6 N-Connecta SUV 5dr Petrol Hybrid Auto Euro 6 (143 '
          'ps) Half Leather, Navigation.',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2023}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602119846881%27 HTTP/1.1" 200 None
2026-03-25 17:47:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602119846881: {'created_time': 1774460866.49737, 'last_price_update_time': 1774460866.497378}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602119846881') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b82d2bd9-d867-5bdc-9d08-9b78f2541b96 with identifier 202602109816138
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b82d2bd9-d867-5bdc-9d08-9b78f2541b96
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0ace21c3794d45479b237e46dafb3df9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': 'b82d2bd9-d867-5bdc-9d08-9b78f2541b96',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109816138',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 22000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82d2bd9-d867-5bdc-9d08-9b78f2541b96/b82d2bd9-d867-5bdc-9d08-9b78f2541b96_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246799,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0ace21c3794d45479b237e46dafb3df9.jpg',
             'Width': 1280}],
 'price': 7999,
 'price_includes_vat': True,
 'registration_date': '2016-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 DIG-T N-Connecta SUV 5dr Petrol Manual Euro 6 (s/s) '
          '(115 ps) Economical .Navigation. Sunroof .',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109816138%27 HTTP/1.1" 200 None
2026-03-25 17:47:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109816138: {'created_time': 1774460866.540992, 'last_price_update_time': 1774460866.540999}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109816138') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: dd36ad3c-1eb4-5cff-b2db-667f5af6d018 with identifier 202602079751429
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item dd36ad3c-1eb4-5cff-b2db-667f5af6d018
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/0c8b8d88a17c43bab07807344321c709.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '2L',
 'engine_horse_power': 197,
 'fuel_type': 'Petrol',
 'id': 'dd36ad3c-1eb4-5cff-b2db-667f5af6d018',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602079751429',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Jaguar',
 'model': 'E-PACE',
 'odometer': 43000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 61,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd36ad3c-1eb4-5cff-b2db-667f5af6d018/dd36ad3c-1eb4-5cff-b2db-667f5af6d018_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186065,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/0c8b8d88a17c43bab07807344321c709.jpg',
             'Width': 1280}],
 'price': 16999,
 'price_includes_vat': True,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace 2.0 P200 R-Dynamic S SUV 5dr Petrol Auto AWD Euro 6 '
          '(s/s) (200 ps) Leather, Navigation.',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2019}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079751429%27 HTTP/1.1" 200 None
2026-03-25 17:47:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602079751429: {'created_time': 1774460866.592404, 'last_price_update_time': 1774460866.592411}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079751429') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 614747a4-c893-56cc-8b04-ae3e632c7eff with identifier 202601319573569
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 614747a4-c893-56cc-8b04-ae3e632c7eff
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/a586af87b0b64aed853235845bd3236a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'fuel_type': 'Petrol',
 'id': '614747a4-c893-56cc-8b04-ae3e632c7eff',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601319573569',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 46000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 59,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_614747a4-c893-56cc-8b04-ae3e632c7eff/614747a4-c893-56cc-8b04-ae3e632c7eff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210428,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/a586af87b0b64aed853235845bd3236a.jpg',
             'Width': 1280}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2015-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman 1.6 Cooper SUV 5dr Petrol Auto Euro 6 (122 ps) REAR '
          'SENSORS, Euro 6',
 'transmission': 'automatic',
 'trim': 'Cooper',
 'year': 2015}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601319573569%27 HTTP/1.1" 200 None
2026-03-25 17:47:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601319573569: {'created_time': 1774460866.632567, 'last_price_update_time': 1774460866.632573}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601319573569') HTTP/1.1" 204 0
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28ba3ad0>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0543d837-4ae2-5a98-a973-f1604aebe43e/0543d837-4ae2-5a98-a973-f1604aebe43e_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4935d1f5795b4209a62e19afa278b282.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4935d1f5795b4209a62e19afa278b282.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0543d837-4ae2-5a98-a973-f1604aebe43e
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0543d837-4ae2-5a98-a973-f1604aebe43e sending to next pipeline
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28b85810>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e806837-93a6-55e5-a0eb-b5a656b4c698/9e806837-93a6-55e5-a0eb-b5a656b4c698_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25c300b82e154055b0319f7352cabf0c.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25c300b82e154055b0319f7352cabf0c.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e806837-93a6-55e5-a0eb-b5a656b4c698
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e806837-93a6-55e5-a0eb-b5a656b4c698 sending to next pipeline
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28fd5c90>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06/6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F409577182eed429580fd50e33d168834.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/409577182eed429580fd50e33d168834.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06 sending to next pipeline
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9c28fdcc90>
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-25 17:47:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59aa57ea-a882-528f-a300-901d0d9a8432/59aa57ea-a882-528f-a300-901d0d9a8432_image_0.jpg HTTP/1.1" 201 0
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autotrader.co.uk',RowKey='https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe67248c737704fba98c4e1a160a0482b.jpg') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e67248c737704fba98c4e1a160a0482b.jpg saved to cache
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59aa57ea-a882-528f-a300-901d0d9a8432
2026-03-25 17:47:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59aa57ea-a882-528f-a300-901d0d9a8432 sending to next pipeline
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0543d837-4ae2-5a98-a973-f1604aebe43e with identifier 202602079751302
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0543d837-4ae2-5a98-a973-f1604aebe43e
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/4935d1f5795b4209a62e19afa278b282.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 113,
 'fuel_type': 'Petrol',
 'id': '0543d837-4ae2-5a98-a973-f1604aebe43e',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602079751302',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 22000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0543d837-4ae2-5a98-a973-f1604aebe43e/0543d837-4ae2-5a98-a973-f1604aebe43e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84786,
             'Height': 768,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/4935d1f5795b4209a62e19afa278b282.jpg',
             'Width': 1280}],
 'price': 8999,
 'price_includes_vat': True,
 'registration_date': '2017-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.2 DIG-T Tekna SUV 5dr Petrol Manual Euro 6 (s/s) (115 '
          'ps) Economical .Navigation.',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2017}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602079751302%27 HTTP/1.1" 200 None
2026-03-25 17:47:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602079751302: {'created_time': 1774460866.907577, 'last_price_update_time': 1774460866.907587}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079751302') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9e806837-93a6-55e5-a0eb-b5a656b4c698 with identifier 202601299510542
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9e806837-93a6-55e5-a0eb-b5a656b4c698
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/25c300b82e154055b0319f7352cabf0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 138,
 'fuel_type': 'Petrol',
 'id': '9e806837-93a6-55e5-a0eb-b5a656b4c698',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299510542',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Zafira Tourer',
 'odometer': 31000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 63,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e806837-93a6-55e5-a0eb-b5a656b4c698/9e806837-93a6-55e5-a0eb-b5a656b4c698_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196071,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/25c300b82e154055b0319f7352cabf0c.jpg',
             'Width': 1280}],
 'price': 9999,
 'price_includes_vat': True,
 'registration_date': '2016-07-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Vauxhall Zafira Tourer 1.4i Turbo SRi MPV 5dr Petrol Auto Euro 6 '
          '(140 ps) 7 Seats,Leather.',
 'transmission': 'automatic',
 'trim': 'SRi',
 'year': 2016}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299510542%27 HTTP/1.1" 200 None
2026-03-25 17:47:46 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299510542: {'created_time': 1774460866.950251, 'last_price_update_time': 1774460866.95026}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299510542') HTTP/1.1" 204 0
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06 with identifier 202601309546285
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:46 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06
2026-03-25 17:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/409577182eed429580fd50e33d168834.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'Pink',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'Euro 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'fuel_type': 'Petrol',
 'id': '6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601309546285',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Fiat',
 'model': '500',
 'odometer': 27000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 51,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06/6a263fc2-40fb-57c4-bb3b-3c4d5d4f1b06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207150,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/409577182eed429580fd50e33d168834.jpg',
             'Width': 1280}],
 'price': 6999,
 'price_includes_vat': True,
 'registration_date': '2016-03-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge Hatchback 3dr Petrol Manual Euro 6 (s/s) (69 '
          'bhp) Panoramic Sunroof, 2 OWNERS',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-25 17:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601309546285%27 HTTP/1.1" 200 None
2026-03-25 17:47:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601309546285: {'created_time': 1774460867.009238, 'last_price_update_time': 1774460867.009246}
2026-03-25 17:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601309546285') HTTP/1.1" 204 0
2026-03-25 17:47:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 59aa57ea-a882-528f-a300-901d0d9a8432 with identifier 202601269424156
2026-03-25 17:47:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 59aa57ea-a882-528f-a300-901d0d9a8432
2026-03-25 17:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://m.atcdn.co.uk/a/media/e67248c737704fba98c4e1a160a0482b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'Euro 6',
 'engine': '1.4L',
 'engine_horse_power': 99,
 'fuel_type': 'Petrol',
 'id': '59aa57ea-a882-528f-a300-901d0d9a8432',
 'is_damaged': False,
 'is_operable': True,
 'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601269424156',
 'listing': 'directbuy',
 'location': 'Reading, Berkshire',
 'make': 'Vauxhall',
 'model': 'Meriva',
 'odometer': 48000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 56,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59aa57ea-a882-528f-a300-901d0d9a8432/59aa57ea-a882-528f-a300-901d0d9a8432_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200984,
             'Height': 960,
             'OriginUrl': 'https://m.atcdn.co.uk/a/media/e67248c737704fba98c4e1a160a0482b.jpg',
             'Width': 1280}],
 'price': 5499,
 'price_includes_vat': True,
 'registration_date': '2017-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Vauxhall Meriva 1.4i Tech Line MPV 5dr Petrol Manual Euro 6 (100 '
          'ps) Economical .',
 'transmission': 'manual',
 'trim': 'Tech Line',
 'year': 2017}
2026-03-25 17:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601269424156%27 HTTP/1.1" 200 None
2026-03-25 17:47:47 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601269424156: {'created_time': 1774460867.064627, 'last_price_update_time': 1774460867.064635}
2026-03-25 17:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601269424156') HTTP/1.1" 204 0
2026-03-25 17:47:47 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-25 17:47:47 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-25 17:47:47 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-25 17:47:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-25 17:47:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item a9e31110287211f18f76c264925fbcfa
2026-03-25 17:47:47 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-25 17:47:47 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-25 17:47:47 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:47:47 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-25 17:47:47 [azure.servicebus._pyamqp._transport] DEBUG: Transport endpoint is already disconnected: OSError(107, 'Transport endpoint is not connected')
2026-03-25 17:47:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-25 17:47:47 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-25 17:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-25 17:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773164867 HTTP/1.1" 200 None
2026-03-25 17:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202505292924099') HTTP/1.1" 204 0
2026-03-25 17:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601149123684') HTTP/1.1" 204 0
2026-03-25 17:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601259404983') HTTP/1.1" 204 0
2026-03-25 17:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602079757481') HTTP/1.1" 204 0
2026-03-25 17:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602099786486') HTTP/1.1" 204 0
2026-03-25 17:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602149930045') HTTP/1.1" 204 0
2026-03-25 17:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602270271087') HTTP/1.1" 204 0
2026-03-25 17:47:48 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (60 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/a9e31110287211f18f76c264925fbcfa.jl
2026-03-25 17:47:48 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 480217,
 'downloader/request_count': 69,
 'downloader/request_method_count/GET': 60,
 'downloader/request_method_count/POST': 9,
 'downloader/response_bytes': 12391588,
 'downloader/response_count': 69,
 'downloader/response_status_count/200': 69,
 'elapsed_time_seconds': 28.6039,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 25, 17, 47, 48, 477190, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 60,
 'log_count/DEBUG': 1074,
 'log_count/INFO': 914,
 'memusage/max': 149012480,
 'memusage/startup': 149012480,
 'photo_download_count': 60,
 'request_depth_max': 4,
 'response_received_count': 9,
 'scheduler/dequeued': 69,
 'scheduler/dequeued/memory': 69,
 'scheduler/enqueued': 69,
 'scheduler/enqueued/memory': 69,
 'scrape_type/new': 60,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 9,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.782934211091035,
 'scrapy-zyte-api/mean_response_seconds': 2.9351633601925444,
 'scrapy-zyte-api/processed': 9,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 9,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 8,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 9,
 'scrapy-zyte-api/request_args/httpRequestBody': 9,
 'scrapy-zyte-api/request_args/httpRequestMethod': 9,
 'scrapy-zyte-api/request_args/httpResponseBody': 9,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 9,
 'scrapy-zyte-api/request_args/url': 9,
 'scrapy-zyte-api/status_codes/200': 9,
 'scrapy-zyte-api/success': 9,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 3, 25, 17, 47, 19, 873290, tzinfo=datetime.timezone.utc)}
2026-03-25 17:47:48 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-25 17:47:48 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9c2a727810>
2026-03-25 17:47:48 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9c2a7380d0>