PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)
2026-03-30 15:07:22 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 15:07:22 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 15:07:22 [auto_selling_autotrader.co.uk] INFO: Starting auto_selling_autotrader.co.uk spider
2026-03-30 15:07:22 [auto_selling_autotrader.co.uk] INFO: Quick mode enabled: batching detail requests in groups of 10
2026-03-30 15:07:22 [auto_selling_autotrader.co.uk] INFO: _job: 4a62a7cc2c1f11f18e133aacc95538c6, SCRAPY_JOB: None
2026-03-30 15:07:22 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 15:07:22 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 15:07:22 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 15:07:22 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 15:07:22 [scrapy.extensions.telnet] INFO: Telnet Password: a477046a89fbf1aa
2026-03-30 15:07:22 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 15:07:22 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 3600,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autotrader.co.uk/4a62a7cc2c1f11f18e133aacc95538c6.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 15:07:22 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:22 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 15:07:22 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 15:07:22 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2026-03-30 15:07:22 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 15:07:22 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2026-03-30 15:07:22 [scrapy.core.engine] INFO: Spider opened
2026-03-30 15:07:22 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:07:22 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2026-03-30 15:07:22 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2026-03-30 15:07:22 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 15:07:22 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-30 15:07:22 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-30 15:07:22 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:22 [scrapy-playwright] INFO: Starting download handler
2026-03-30 15:07:27 [auto_selling_autotrader.co.uk] INFO: Scraper started with retailer ID: 19972 and multipost_profile_id: ca10a4ea-0336-41a3-8a60-36a05b36cd6d and job_id: 4a62a7cc2c1f11f18e133aacc95538c6 and url: https://www.autotrader.co.uk/cars/retailer/stock?advertising-location=at_cars&advertising-location=at_profile_cars&onesearchad=Used&onesearchad=Nearly%20New&onesearchad=New&postcode=OX3%209JY&retailerId=19972&sort=price-asc
2026-03-30 15:07:27 [auto_selling_autotrader.co.uk] INFO: Getting list for retailer ID: 19972, page: 1
2026-03-30 15:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery> (referer: None) ['zyte-api']
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] DEBUG: response: <200 https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery>
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Page: 1/1, total results: 17
2026-03-30 15:07:29 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-30 15:07:29 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281097678%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603281097678: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190841191%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190841191: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190823204%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603190823204: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170770605%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603170770605: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160726682%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603160726682: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130664553%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603130664553: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110609057%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603110609057: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060466689%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603060466689: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050436093%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603050436093: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030360175%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202603030360175: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179988751%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602179988751: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169958761%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602169958761: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109807835%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602109807835: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602069730407%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202602069730407: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299520737%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601299520737: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601129093118%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202601129093118: 1
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508065178989%27 HTTP/1.1" 200 None
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Scrape type for 202508065178989: 1
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 10 detail requests (batch 1)
2026-03-30 15:07:29 [auto_selling_autotrader.co.uk] INFO: Quick mode: batching 7 detail requests (batch 2)
2026-03-30 15:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 15:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autotrader.co.uk/at-graphql> (referer: https://www.autotrader.co.uk/at-gateway?opname=SearchResultsListingsGridQuery&opname=SearchResultsFacetsWithGroupsQuery) ['zyte-api']
2026-03-30 15:07:31 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:31 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d5855c56-04fa-54cc-9fe8-5b505a255ecc with identifier: 202602179988751
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5855c56-04fa-54cc-9fe8-5b505a255ecc
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9f095513cf1d4a1c87b64c8605248863.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9f095513cf1d4a1c87b64c8605248863.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F80779147b09e413caf550252608a8d7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/80779147b09e413caf550252608a8d7a.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fea0b618140064507b6f9863956272972.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ea0b618140064507b6f9863956272972.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4a5f26184134c91b89bccc563dc8aed.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4a5f26184134c91b89bccc563dc8aed.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F26860271a4254f44a4ad715711acaf65.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/26860271a4254f44a4ad715711acaf65.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7a4c28703b83445c970fc72308cd7d7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7a4c28703b83445c970fc72308cd7d7f.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F39753d894f954176920e34a9235386f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/39753d894f954176920e34a9235386f3.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F163fce0402f14aadbf5f7f1524f89834.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/163fce0402f14aadbf5f7f1524f89834.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ccdb008a6fc4ec08b3feae76db87be2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ccdb008a6fc4ec08b3feae76db87be2.jpg already downloaded
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff914ddb3888241b98d16ab79aff25b6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f914ddb3888241b98d16ab79aff25b6e.jpg already downloaded
2026-03-30 15:07:31 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d5855c56-04fa-54cc-9fe8-5b505a255ecc with identifier 202602179988751
2026-03-30 15:07:31 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2026-03-30 15:07:31 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:07:31 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2026-03-30 15:07:31 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2026-03-30 15:07:31 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2026-03-30 15:07:31 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:31 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:31 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:31 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:31 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2026-03-30 15:07:31 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2026-03-30 15:07:31 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2026-03-30 15:07:31 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:31 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:32 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:32 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2029
2026-03-30 15:07:32 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883252
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1774883252
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2026-03-30 15:07:32 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d5855c56-04fa-54cc-9fe8-5b505a255ecc
2026-03-30 15:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 193,
'color': 'Red',
'currency': 'GBP',
'description': 'Honda CRV 2.0cc V Tec Auto Petrol, Finished off In A Red '
'Bodywork And Has A Grey Leather Interior, Alloy Wheels, '
'Remote Central Locking, Electric Windows Front And Rear, '
'Electric Power fold Door Mirrors, Electric Drivers Seat, '
'Heated Front Seats, Air Conditioning, Radio Cd With '
'Bluetooth, Satnav, Multifunctional Steering Wheel, Cruise '
'Control, Front Armrests, USB Socket In Top Glovebox, 12v '
'Socket, Cupholders, Panaramic Sunroof With Blinds, Two Remote '
'Keys, Space Saver Spare Wheel, Front And Rear Parking Sensors '
'With Rear Reversing Camera, Comes With 11 Stamps Of Service '
'History, 12 Months Mot, 6 Months Parts And Labour Warranty, '
'Part Exchange Considered, Clean And Tidy Car Drives Well,',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Petrol',
'id': 'd5855c56-04fa-54cc-9fe8-5b505a255ecc',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602179988751',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Honda',
'model': 'CR-V',
'odometer': 74667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9f095513cf1d4a1c87b64c8605248863.jpg',
'https://m.atcdn.co.uk/a/media/80779147b09e413caf550252608a8d7a.jpg',
'https://m.atcdn.co.uk/a/media/ea0b618140064507b6f9863956272972.jpg',
'https://m.atcdn.co.uk/a/media/c4a5f26184134c91b89bccc563dc8aed.jpg',
'https://m.atcdn.co.uk/a/media/26860271a4254f44a4ad715711acaf65.jpg',
'https://m.atcdn.co.uk/a/media/7a4c28703b83445c970fc72308cd7d7f.jpg',
'https://m.atcdn.co.uk/a/media/39753d894f954176920e34a9235386f3.jpg',
'https://m.atcdn.co.uk/a/media/163fce0402f14aadbf5f7f1524f89834.jpg',
'https://m.atcdn.co.uk/a/media/4ccdb008a6fc4ec08b3feae76db87be2.jpg',
'https://m.atcdn.co.uk/a/media/f914ddb3888241b98d16ab79aff25b6e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367822,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9f095513cf1d4a1c87b64c8605248863.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322936,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/80779147b09e413caf550252608a8d7a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637140,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ea0b618140064507b6f9863956272972.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525335,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c4a5f26184134c91b89bccc563dc8aed.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 574486,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/26860271a4254f44a4ad715711acaf65.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648499,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7a4c28703b83445c970fc72308cd7d7f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508544,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/39753d894f954176920e34a9235386f3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559696,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/163fce0402f14aadbf5f7f1524f89834.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306542,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ccdb008a6fc4ec08b3feae76db87be2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5855c56-04fa-54cc-9fe8-5b505a255ecc/d5855c56-04fa-54cc-9fe8-5b505a255ecc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371750,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f914ddb3888241b98d16ab79aff25b6e.jpg',
'Width': 2048}],
'price': 8695,
'price_includes_vat': True,
'registration_date': '2012-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Cr-V 2.0 i-VTEC EX Auto 4WD Euro 5 5dr',
'transmission': 'automatic',
'trim': 'EX',
'year': 2012}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602179988751%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602179988751: {'created_time': 1774883252.512445, 'last_price_update_time': 1774883252.512456}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602179988751') HTTP/1.1" 204 0
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d88e41a2-bf58-5066-8dd4-1c58a92ec9a7 with identifier: 202602169958761
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d88e41a2-bf58-5066-8dd4-1c58a92ec9a7
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa3167511ca884485b2de9e9cac86f018.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a3167511ca884485b2de9e9cac86f018.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F921306b5d16646738afbe60eb9161bf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/921306b5d16646738afbe60eb9161bf2.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F494d5de179374587a03ec8327309cbde.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/494d5de179374587a03ec8327309cbde.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F88324db673004427817e6ad4e5b1463f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/88324db673004427817e6ad4e5b1463f.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F47284da593b24f539f6c3867c1bf79aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/47284da593b24f539f6c3867c1bf79aa.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa0adb42dfd364f87b7b2104d2a52c4a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a0adb42dfd364f87b7b2104d2a52c4a2.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F671085ad210549edb6116b5d1f9db449.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/671085ad210549edb6116b5d1f9db449.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd7e972d5ba7044cda9116476829076df.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d7e972d5ba7044cda9116476829076df.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd910943e754a4bb8bf9ad25e64c4ac9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d910943e754a4bb8bf9ad25e64c4ac9e.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff9e5fe7759084a16966ce28ed06c89c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f9e5fe7759084a16966ce28ed06c89c1.jpg already downloaded
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d88e41a2-bf58-5066-8dd4-1c58a92ec9a7 with identifier 202602169958761
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d88e41a2-bf58-5066-8dd4-1c58a92ec9a7
2026-03-30 15:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'Red',
'currency': 'GBP',
'description': 'Ford Ka 1.2cc Zetec 3 Dr, Finished off In A Sunrise Red '
'Bodywork And Has A Grey Cloth Interior, Alloy Wheels, Front '
'Fog Lights, Remote Central Locking With Two Keys, Radio Cd '
'Player With Aux Socket, 12v Socket, Electric Front Windows, '
'Air Conditioning, Heated Rear Screen, Electric Mirrors, Cup '
'Holder, Adjustable Steering Wheel, Has Service History, Mot '
'January 2027, Clean And Tidy Car, 3 Months Parts And Labour '
'Warranty, Part Exchange Considered,',
'doors_number': 3,
'emission_standard': 'Euro 4',
'engine': '1.2L',
'engine_horse_power': 68,
'fuel_type': 'Petrol',
'id': 'd88e41a2-bf58-5066-8dd4-1c58a92ec9a7',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602169958761',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Ford',
'model': 'Ka',
'odometer': 74721,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://m.atcdn.co.uk/a/media/a3167511ca884485b2de9e9cac86f018.jpg',
'https://m.atcdn.co.uk/a/media/921306b5d16646738afbe60eb9161bf2.jpg',
'https://m.atcdn.co.uk/a/media/494d5de179374587a03ec8327309cbde.jpg',
'https://m.atcdn.co.uk/a/media/88324db673004427817e6ad4e5b1463f.jpg',
'https://m.atcdn.co.uk/a/media/47284da593b24f539f6c3867c1bf79aa.jpg',
'https://m.atcdn.co.uk/a/media/a0adb42dfd364f87b7b2104d2a52c4a2.jpg',
'https://m.atcdn.co.uk/a/media/671085ad210549edb6116b5d1f9db449.jpg',
'https://m.atcdn.co.uk/a/media/d7e972d5ba7044cda9116476829076df.jpg',
'https://m.atcdn.co.uk/a/media/d910943e754a4bb8bf9ad25e64c4ac9e.jpg',
'https://m.atcdn.co.uk/a/media/f9e5fe7759084a16966ce28ed06c89c1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382093,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a3167511ca884485b2de9e9cac86f018.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 660835,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/921306b5d16646738afbe60eb9161bf2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638875,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/494d5de179374587a03ec8327309cbde.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609784,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/88324db673004427817e6ad4e5b1463f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650736,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/47284da593b24f539f6c3867c1bf79aa.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664548,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a0adb42dfd364f87b7b2104d2a52c4a2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683245,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/671085ad210549edb6116b5d1f9db449.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634894,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d7e972d5ba7044cda9116476829076df.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 689730,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d910943e754a4bb8bf9ad25e64c4ac9e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88e41a2-bf58-5066-8dd4-1c58a92ec9a7/d88e41a2-bf58-5066-8dd4-1c58a92ec9a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338460,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f9e5fe7759084a16966ce28ed06c89c1.jpg',
'Width': 2048}],
'price': 2295,
'price_includes_vat': True,
'registration_date': '2009-08-11',
'seats_number': 4,
'seller_name': None,
'title': 'Ford KA 1.2 Zetec Euro 4 3dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2009}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602169958761%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602169958761: {'created_time': 1774883252.867729, 'last_price_update_time': 1774883252.867742}
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602169958761') HTTP/1.1" 204 0
2026-03-30 15:07:32 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 77aa9dbf-805c-58bc-a923-8db8892a7635 with identifier: 202602109807835
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77aa9dbf-805c-58bc-a923-8db8892a7635
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73b55acd8d674e9e9718e71eb4ed0857.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73b55acd8d674e9e9718e71eb4ed0857.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ffa7af5cf2784466bb7befe2b4228a332.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/fa7af5cf2784466bb7befe2b4228a332.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1e6f246099b74934a85dc21b5e91c800.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1e6f246099b74934a85dc21b5e91c800.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2e4f01a46d94427c8d60e26c4c343c01.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2e4f01a46d94427c8d60e26c4c343c01.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F85fb3e547fce4bc3805403d1ee194c95.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/85fb3e547fce4bc3805403d1ee194c95.jpg already downloaded
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F759132a75b1d46f08abd73ddeaff8b30.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/759132a75b1d46f08abd73ddeaff8b30.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0979d9bb0279402aa2f711e737a25bdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0979d9bb0279402aa2f711e737a25bdc.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fdb235a3aea7a4e82a7bb58ca8fd020f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/db235a3aea7a4e82a7bb58ca8fd020f7.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0158192d2efb4db59714cb97072c34e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0158192d2efb4db59714cb97072c34e8.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0dc3dfb9aa8241579af797f58a46a5b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0dc3dfb9aa8241579af797f58a46a5b1.jpg already downloaded
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a4bd184a-c66c-5d04-87a3-411319b06d0f with identifier: 202603281097678
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4bd184a-c66c-5d04-87a3-411319b06d0f
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5df5a850e47e412e9b8af81504ec9fb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5df5a850e47e412e9b8af81504ec9fb0.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fae3770babac0430c8530dbc9afcb5203.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ae3770babac0430c8530dbc9afcb5203.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbeac71d99c7447a095623652db5497b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/beac71d99c7447a095623652db5497b1.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55f8b0aaa08740b9b5c3b242a412d073.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55f8b0aaa08740b9b5c3b242a412d073.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc630a57d601a4f09bfb2c3c43c480c16.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c630a57d601a4f09bfb2c3c43c480c16.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F870b191cf5f64d3a9bb06977b4222de0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/870b191cf5f64d3a9bb06977b4222de0.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0e02b1f2e29146918876d3028abd7147.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0e02b1f2e29146918876d3028abd7147.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F860cbdc1173f46cc9fbe9ec124d2d2b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/860cbdc1173f46cc9fbe9ec124d2d2b3.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F05e3fa4d91a74fdbb1f0787c206d1e3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/05e3fa4d91a74fdbb1f0787c206d1e3b.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc0d27d5dd3a940d895d9846bb877165d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c0d27d5dd3a940d895d9846bb877165d.jpg already downloaded
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 77aa9dbf-805c-58bc-a923-8db8892a7635 with identifier 202602109807835
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 77aa9dbf-805c-58bc-a923-8db8892a7635
2026-03-30 15:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 158,
'color': 'Grey',
'currency': 'GBP',
'description': 'VW Tiguan 2.0Tdi DSG, 5 Dr Hatchback, Finished off In A '
'Metallic Grey Bodywork And Has A Grey Suede Interior, Comes '
'With Alloy Wheels, Front Fog Lights, Remote Central Locking '
'With Two Keys, Front And Rear Electric Windows, Heated '
'Electric Mirrors, Front And Rear Parking Sensors With On '
'Screen Display, Daytime Running Lights, Heated Front Seats '
'With Seat Height Adjustment, Radio Cd With Bluetooth And '
'Satnav And Media Socket In Centre Armrest,Cupholders,12v '
'Socket, Adjustable Steering Wheel, Auto Lights, Spare Wheel, '
'Has Part Service History, Mot Dec 2026, Clean And Tidy Car '
'Drives Well, 6 Months Parts And Labour Warranty, Part '
'Exchange Considered,',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 138,
'fuel_type': 'Diesel',
'id': '77aa9dbf-805c-58bc-a923-8db8892a7635',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602109807835',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 46447,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photo_urls': ['https://m.atcdn.co.uk/a/media/73b55acd8d674e9e9718e71eb4ed0857.jpg',
'https://m.atcdn.co.uk/a/media/fa7af5cf2784466bb7befe2b4228a332.jpg',
'https://m.atcdn.co.uk/a/media/1e6f246099b74934a85dc21b5e91c800.jpg',
'https://m.atcdn.co.uk/a/media/2e4f01a46d94427c8d60e26c4c343c01.jpg',
'https://m.atcdn.co.uk/a/media/85fb3e547fce4bc3805403d1ee194c95.jpg',
'https://m.atcdn.co.uk/a/media/759132a75b1d46f08abd73ddeaff8b30.jpg',
'https://m.atcdn.co.uk/a/media/0979d9bb0279402aa2f711e737a25bdc.jpg',
'https://m.atcdn.co.uk/a/media/db235a3aea7a4e82a7bb58ca8fd020f7.jpg',
'https://m.atcdn.co.uk/a/media/0158192d2efb4db59714cb97072c34e8.jpg',
'https://m.atcdn.co.uk/a/media/0dc3dfb9aa8241579af797f58a46a5b1.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339385,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73b55acd8d674e9e9718e71eb4ed0857.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620941,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/fa7af5cf2784466bb7befe2b4228a332.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626854,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1e6f246099b74934a85dc21b5e91c800.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563837,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2e4f01a46d94427c8d60e26c4c343c01.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 580719,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/85fb3e547fce4bc3805403d1ee194c95.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513211,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/759132a75b1d46f08abd73ddeaff8b30.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565464,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0979d9bb0279402aa2f711e737a25bdc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462027,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/db235a3aea7a4e82a7bb58ca8fd020f7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 615068,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0158192d2efb4db59714cb97072c34e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77aa9dbf-805c-58bc-a923-8db8892a7635/77aa9dbf-805c-58bc-a923-8db8892a7635_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316904,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0dc3dfb9aa8241579af797f58a46a5b1.jpg',
'Width': 2048}],
'price': 10495,
'price_includes_vat': True,
'registration_date': '2013-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI BlueMotion Tech SE DSG 4WD Euro 5 (s/s) '
'5dr',
'transmission': 'automatic',
'trim': 'SE',
'year': 2013}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602109807835%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602109807835: {'created_time': 1774883253.560189, 'last_price_update_time': 1774883253.560203}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602109807835') HTTP/1.1" 204 0
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a4bd184a-c66c-5d04-87a3-411319b06d0f with identifier 202603281097678
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:33 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a4bd184a-c66c-5d04-87a3-411319b06d0f
2026-03-30 15:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 165,
'color': 'Grey',
'currency': 'GBP',
'description': 'Ford Mondeo 2.2 TDCi Titanium X, Estate, Metallic Grey, Part '
'Exchange To Clear, MOT Expires 30/09/2026, Documented Service '
'History, Usual Refinements, Good Condition For Mileage and '
'Year',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '2.2L',
'engine_horse_power': 173,
'fuel_type': 'Diesel',
'id': 'a4bd184a-c66c-5d04-87a3-411319b06d0f',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603281097678',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 198694,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photo_urls': ['https://m.atcdn.co.uk/a/media/5df5a850e47e412e9b8af81504ec9fb0.jpg',
'https://m.atcdn.co.uk/a/media/ae3770babac0430c8530dbc9afcb5203.jpg',
'https://m.atcdn.co.uk/a/media/beac71d99c7447a095623652db5497b1.jpg',
'https://m.atcdn.co.uk/a/media/55f8b0aaa08740b9b5c3b242a412d073.jpg',
'https://m.atcdn.co.uk/a/media/c630a57d601a4f09bfb2c3c43c480c16.jpg',
'https://m.atcdn.co.uk/a/media/870b191cf5f64d3a9bb06977b4222de0.jpg',
'https://m.atcdn.co.uk/a/media/0e02b1f2e29146918876d3028abd7147.jpg',
'https://m.atcdn.co.uk/a/media/860cbdc1173f46cc9fbe9ec124d2d2b3.jpg',
'https://m.atcdn.co.uk/a/media/05e3fa4d91a74fdbb1f0787c206d1e3b.jpg',
'https://m.atcdn.co.uk/a/media/c0d27d5dd3a940d895d9846bb877165d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584660,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5df5a850e47e412e9b8af81504ec9fb0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585888,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ae3770babac0430c8530dbc9afcb5203.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602802,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/beac71d99c7447a095623652db5497b1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503448,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55f8b0aaa08740b9b5c3b242a412d073.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573228,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c630a57d601a4f09bfb2c3c43c480c16.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598048,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/870b191cf5f64d3a9bb06977b4222de0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 630095,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0e02b1f2e29146918876d3028abd7147.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534391,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/860cbdc1173f46cc9fbe9ec124d2d2b3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395943,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/05e3fa4d91a74fdbb1f0787c206d1e3b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4bd184a-c66c-5d04-87a3-411319b06d0f/a4bd184a-c66c-5d04-87a3-411319b06d0f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422700,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c0d27d5dd3a940d895d9846bb877165d.jpg',
'Width': 2048}],
'price': 1495,
'price_includes_vat': True,
'registration_date': '2008-09-05',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Mondeo 2.2 TDCi Titanium X 5dr',
'transmission': 'manual',
'trim': 'Titanium X',
'year': 2008}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603281097678%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603281097678: {'created_time': 1774883253.623822, 'last_price_update_time': 1774883253.623832}
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603281097678') HTTP/1.1" 204 0
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d72403b-e0a9-51e1-80cd-f9173f4e5b08 with identifier: 202602069730407
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d72403b-e0a9-51e1-80cd-f9173f4e5b08
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe6c5627e74bc4a4fbd952b0231b863d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e6c5627e74bc4a4fbd952b0231b863d2.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F21fed8cbce6d449ca9134406c8b79453.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/21fed8cbce6d449ca9134406c8b79453.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa6e49ed64944417faba3474fb814603f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a6e49ed64944417faba3474fb814603f.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6dbb179cbd8843b898c4dc9e70fbd5b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6dbb179cbd8843b898c4dc9e70fbd5b8.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fda7825de5e754cacadee0c9055b10f83.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/da7825de5e754cacadee0c9055b10f83.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc61f12737efe481f9953fa4a6b9b9ca2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c61f12737efe481f9953fa4a6b9b9ca2.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff1220700bc554ea6a636a267b5bceeac.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f1220700bc554ea6a636a267b5bceeac.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4d40d9fa45f34521b2fa142d80fc4bd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4d40d9fa45f34521b2fa142d80fc4bd7.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Feae344b08d7a49bc96d3be929cbbf019.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/eae344b08d7a49bc96d3be929cbbf019.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc8601eba785948c1a1aec9f75df1c6b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c8601eba785948c1a1aec9f75df1c6b6.jpg already downloaded
2026-03-30 15:07:33 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ab728670-bd9c-5e39-8eeb-c9f6f383a4a9 with identifier: 202603190841191
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab728670-bd9c-5e39-8eeb-c9f6f383a4a9
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6abfba9545764b7285dc7898d640573c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6abfba9545764b7285dc7898d640573c.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb8dde4c29fab47c39a99d78d8f153b09.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b8dde4c29fab47c39a99d78d8f153b09.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1a2b955fd1c640cd9801da5d8edbb657.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1a2b955fd1c640cd9801da5d8edbb657.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F322706cb16204d44a1c67268152b64e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/322706cb16204d44a1c67268152b64e1.jpg already downloaded
2026-03-30 15:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91289cf8abbd4ebcaa9270ec3e7c8069.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91289cf8abbd4ebcaa9270ec3e7c8069.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed44ca4ccb4f407798962fe0794fc1ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed44ca4ccb4f407798962fe0794fc1ae.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd171c2b06fe2436ea2ff1cb0bd495bba.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d171c2b06fe2436ea2ff1cb0bd495bba.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F44375ee876634fb88a689048042d5145.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/44375ee876634fb88a689048042d5145.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0d5813c10f845a3bd4e22f4df54421e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0d5813c10f845a3bd4e22f4df54421e.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb0b871c80e2a47d8bbde8d5399be0fa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b0b871c80e2a47d8bbde8d5399be0fa3.jpg already downloaded
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3d72403b-e0a9-51e1-80cd-f9173f4e5b08 with identifier 202602069730407
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3d72403b-e0a9-51e1-80cd-f9173f4e5b08
2026-03-30 15:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'White',
'currency': 'GBP',
'description': 'Seat Leon 2.0cc Fr Coupe, Finished Off In A White Bodywork '
'And Has A Grey Cloth Interior, Alloy Wheels, Front Fog '
'Lights, Remote Central Locking With Two Remote Keys, Electric '
'Windows Front, Electric Powerfold Mirrors, Front And And Rear '
'Parking Sensors With Park Pilot, Heated Front And Rear '
'Screen, Air Conditioning, Dab Radio With Bluetooth, Satnav, '
'Cd Player In Glovebox With Sd Card Slots And Media Socket, '
'12v Socket In Centre Armrest With Cup Holders '
',Multifunctional Steering Wheel, Cruise Control, Front Seat '
'Height Adjustment, Daytime Running Lights, Spare Wheel, Has A '
'Good Service History With Cambelt And Waterpump Replacement '
'In March 2024 @ 72744 Miles, Mot September 2026,Clean And '
'Tidy Car Drives Well, Part Exchange Considered,6 Months Parts '
'And Labour Warranty,',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 181,
'fuel_type': 'Diesel',
'id': '3d72403b-e0a9-51e1-80cd-f9173f4e5b08',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202602069730407',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'SEAT',
'model': 'Leon',
'odometer': 87433,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://m.atcdn.co.uk/a/media/e6c5627e74bc4a4fbd952b0231b863d2.jpg',
'https://m.atcdn.co.uk/a/media/21fed8cbce6d449ca9134406c8b79453.jpg',
'https://m.atcdn.co.uk/a/media/a6e49ed64944417faba3474fb814603f.jpg',
'https://m.atcdn.co.uk/a/media/6dbb179cbd8843b898c4dc9e70fbd5b8.jpg',
'https://m.atcdn.co.uk/a/media/da7825de5e754cacadee0c9055b10f83.jpg',
'https://m.atcdn.co.uk/a/media/c61f12737efe481f9953fa4a6b9b9ca2.jpg',
'https://m.atcdn.co.uk/a/media/f1220700bc554ea6a636a267b5bceeac.jpg',
'https://m.atcdn.co.uk/a/media/4d40d9fa45f34521b2fa142d80fc4bd7.jpg',
'https://m.atcdn.co.uk/a/media/eae344b08d7a49bc96d3be929cbbf019.jpg',
'https://m.atcdn.co.uk/a/media/c8601eba785948c1a1aec9f75df1c6b6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309255,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e6c5627e74bc4a4fbd952b0231b863d2.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567858,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/21fed8cbce6d449ca9134406c8b79453.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552664,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a6e49ed64944417faba3474fb814603f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552562,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6dbb179cbd8843b898c4dc9e70fbd5b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555932,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/da7825de5e754cacadee0c9055b10f83.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530630,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c61f12737efe481f9953fa4a6b9b9ca2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564417,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f1220700bc554ea6a636a267b5bceeac.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496052,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4d40d9fa45f34521b2fa142d80fc4bd7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557353,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/eae344b08d7a49bc96d3be929cbbf019.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d72403b-e0a9-51e1-80cd-f9173f4e5b08/3d72403b-e0a9-51e1-80cd-f9173f4e5b08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187442,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c8601eba785948c1a1aec9f75df1c6b6.jpg',
'Width': 2048}],
'price': 6950,
'price_includes_vat': True,
'registration_date': '2013-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT Leon 2.0 TDI CR FR Sport Coupe Euro 5 (s/s) 3dr',
'transmission': 'manual',
'trim': 'FR',
'year': 2013}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202602069730407%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202602069730407: {'created_time': 1774883254.133313, 'last_price_update_time': 1774883254.133325}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202602069730407') HTTP/1.1" 204 0
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ab728670-bd9c-5e39-8eeb-c9f6f383a4a9 with identifier 202603190841191
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ab728670-bd9c-5e39-8eeb-c9f6f383a4a9
2026-03-30 15:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'White',
'currency': 'GBP',
'description': 'Hyundai I10 5dr 1.0cc Se,Finished Off In A White Bodywork And '
'Has A Grey And Blue Cloth Interior, Has Electric Windows '
'Front And Rear, AirCon, Front And Rear Parking Sensors, '
'Daytime Running Lights, Drivers Seat Height Adjustment, Radio '
'Cd With Aux, Usb And 12v Sockets, Multifunctional Steering '
'Wheel,Cruise Control With Speed Limiter, Electric Mirrors, '
'Spare Wheel, Heated Rear Screen, Has A Good Service History, '
'Mot January 2027, Comes With 6 Months Parts And Labour '
'Warranty, Part Exchange Considerd, Clean And Tidy Car Drives '
'Well,',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1L',
'engine_horse_power': 65,
'fuel_type': 'Petrol',
'id': 'ab728670-bd9c-5e39-8eeb-c9f6f383a4a9',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190841191',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Hyundai',
'model': 'i10',
'odometer': 44605,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://m.atcdn.co.uk/a/media/6abfba9545764b7285dc7898d640573c.jpg',
'https://m.atcdn.co.uk/a/media/b8dde4c29fab47c39a99d78d8f153b09.jpg',
'https://m.atcdn.co.uk/a/media/1a2b955fd1c640cd9801da5d8edbb657.jpg',
'https://m.atcdn.co.uk/a/media/322706cb16204d44a1c67268152b64e1.jpg',
'https://m.atcdn.co.uk/a/media/91289cf8abbd4ebcaa9270ec3e7c8069.jpg',
'https://m.atcdn.co.uk/a/media/ed44ca4ccb4f407798962fe0794fc1ae.jpg',
'https://m.atcdn.co.uk/a/media/d171c2b06fe2436ea2ff1cb0bd495bba.jpg',
'https://m.atcdn.co.uk/a/media/44375ee876634fb88a689048042d5145.jpg',
'https://m.atcdn.co.uk/a/media/e0d5813c10f845a3bd4e22f4df54421e.jpg',
'https://m.atcdn.co.uk/a/media/b0b871c80e2a47d8bbde8d5399be0fa3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306388,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6abfba9545764b7285dc7898d640573c.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610464,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b8dde4c29fab47c39a99d78d8f153b09.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634786,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1a2b955fd1c640cd9801da5d8edbb657.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613943,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/322706cb16204d44a1c67268152b64e1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556530,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/91289cf8abbd4ebcaa9270ec3e7c8069.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583807,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed44ca4ccb4f407798962fe0794fc1ae.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 589799,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d171c2b06fe2436ea2ff1cb0bd495bba.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555593,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/44375ee876634fb88a689048042d5145.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 542960,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0d5813c10f845a3bd4e22f4df54421e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab728670-bd9c-5e39-8eeb-c9f6f383a4a9/ab728670-bd9c-5e39-8eeb-c9f6f383a4a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416882,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b0b871c80e2a47d8bbde8d5399be0fa3.jpg',
'Width': 2048}],
'price': 5795,
'price_includes_vat': True,
'registration_date': '2014-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i10 1.0 SE Euro 5 5dr',
'transmission': 'manual',
'trim': 'SE',
'year': 2014}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190841191%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190841191: {'created_time': 1774883254.184562, 'last_price_update_time': 1774883254.184574}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190841191') HTTP/1.1" 204 0
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b9ae4513-d94b-58fd-ad15-bdb6dfcb02be with identifier: 202601299520737
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b9ae4513-d94b-58fd-ad15-bdb6dfcb02be
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff4b5db5678084f5e8cf2aebc587c9761.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f4b5db5678084f5e8cf2aebc587c9761.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbe676389c10d4a35afba2287ae4e970d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/be676389c10d4a35afba2287ae4e970d.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff40b04ed55cf4f838a1e8600484ec39f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f40b04ed55cf4f838a1e8600484ec39f.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F88a79c8172d14fc58c7ba61554cd4e4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/88a79c8172d14fc58c7ba61554cd4e4e.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbd3d715502a440468be9ea2f856633b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bd3d715502a440468be9ea2f856633b6.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9775333b49c7465eb30cf5c225860af3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9775333b49c7465eb30cf5c225860af3.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcf63e11af95e47aeab12f5790a150280.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cf63e11af95e47aeab12f5790a150280.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F701f044993324de687655924fae494a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/701f044993324de687655924fae494a2.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd4085601555942bdba5494f6623e1bfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d4085601555942bdba5494f6623e1bfc.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F255014cd46e646b59bcab23a9f1139ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/255014cd46e646b59bcab23a9f1139ae.jpg already downloaded
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: da080f54-d248-5863-b7ef-86b0f5a5b2d5 with identifier: 202603190823204
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da080f54-d248-5863-b7ef-86b0f5a5b2d5
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2cc0631f664843ecbcedb78fa31de651.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2cc0631f664843ecbcedb78fa31de651.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F61662860688e466bbfc48e9163ebed14.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/61662860688e466bbfc48e9163ebed14.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F306136fbe8a343fe8f68ce6ea479f25f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/306136fbe8a343fe8f68ce6ea479f25f.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a759e792110448a9316bdc7ed9c506c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a759e792110448a9316bdc7ed9c506c.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F24f7b443233448eda7465513f31b95a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/24f7b443233448eda7465513f31b95a3.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F92d780bba8bd4e418b569aaebbdcaf5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/92d780bba8bd4e418b569aaebbdcaf5c.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2d446178fd33460a8186a53616279f03.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2d446178fd33460a8186a53616279f03.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb2a0ca7e31a94b628a4abab72655b80d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b2a0ca7e31a94b628a4abab72655b80d.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8eb0bc48b70a4ae4b02aaaa86103962f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8eb0bc48b70a4ae4b02aaaa86103962f.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F89cac85f8f1d47a79ac157b1cf697927.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/89cac85f8f1d47a79ac157b1cf697927.jpg already downloaded
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b9ae4513-d94b-58fd-ad15-bdb6dfcb02be with identifier 202601299520737
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b9ae4513-d94b-58fd-ad15-bdb6dfcb02be
2026-03-30 15:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 171,
'color': 'White',
'currency': 'GBP',
'description': 'Audi A3 5dr 1.6cc Finished Off In A White Bodywork And Has A '
'Grey Cloth Interior, Has Alloy Wheels, Electric Windows Front '
'And Rear, Remote Central Locking, Radio Cd Player, Air '
'Conditioning, Front Seat Height Adjustment, 12v Socket, Spare '
'Wheel, Centre Armrest, Electric Mirrors, Some Service Bills, '
'Mot October 2026, Clean And Tidy Car Drives Well, Part '
'Exchange Considered, 3 Months Parts And Labour Warranty, '
'Please Note This Car Is A Category C Insurance Claim In 2015,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.6L',
'engine_horse_power': 101,
'fuel_type': 'Petrol',
'id': 'b9ae4513-d94b-58fd-ad15-bdb6dfcb02be',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601299520737',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Audi',
'model': 'A3',
'odometer': 86337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://m.atcdn.co.uk/a/media/f4b5db5678084f5e8cf2aebc587c9761.jpg',
'https://m.atcdn.co.uk/a/media/be676389c10d4a35afba2287ae4e970d.jpg',
'https://m.atcdn.co.uk/a/media/f40b04ed55cf4f838a1e8600484ec39f.jpg',
'https://m.atcdn.co.uk/a/media/88a79c8172d14fc58c7ba61554cd4e4e.jpg',
'https://m.atcdn.co.uk/a/media/bd3d715502a440468be9ea2f856633b6.jpg',
'https://m.atcdn.co.uk/a/media/9775333b49c7465eb30cf5c225860af3.jpg',
'https://m.atcdn.co.uk/a/media/cf63e11af95e47aeab12f5790a150280.jpg',
'https://m.atcdn.co.uk/a/media/701f044993324de687655924fae494a2.jpg',
'https://m.atcdn.co.uk/a/media/d4085601555942bdba5494f6623e1bfc.jpg',
'https://m.atcdn.co.uk/a/media/255014cd46e646b59bcab23a9f1139ae.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324413,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f4b5db5678084f5e8cf2aebc587c9761.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651058,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/be676389c10d4a35afba2287ae4e970d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640065,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f40b04ed55cf4f838a1e8600484ec39f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581973,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/88a79c8172d14fc58c7ba61554cd4e4e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606571,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bd3d715502a440468be9ea2f856633b6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 657055,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9775333b49c7465eb30cf5c225860af3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583803,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cf63e11af95e47aeab12f5790a150280.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597231,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/701f044993324de687655924fae494a2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324978,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d4085601555942bdba5494f6623e1bfc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b9ae4513-d94b-58fd-ad15-bdb6dfcb02be/b9ae4513-d94b-58fd-ad15-bdb6dfcb02be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266527,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/255014cd46e646b59bcab23a9f1139ae.jpg',
'Width': 2048}],
'price': 2695,
'price_includes_vat': True,
'registration_date': '2008-04-16',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 1.6 Special Edition Sportback 5dr',
'transmission': 'manual',
'year': 2008}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601299520737%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601299520737: {'created_time': 1774883254.691331, 'last_price_update_time': 1774883254.691343}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601299520737') HTTP/1.1" 204 0
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: da080f54-d248-5863-b7ef-86b0f5a5b2d5 with identifier 202603190823204
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item da080f54-d248-5863-b7ef-86b0f5a5b2d5
2026-03-30 15:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 160,
'color': 'Orange',
'currency': 'GBP',
'description': 'Ford C Max Zetec 1.6cc, Finished Off In A Bronze Bodywork And '
'Has A Grey Cloth Interior, Has Alloy Wheels, Electric Front '
'Windows, Heated Front And Rear Screen, Radio Cd With Mounted '
'Steering Controls, 12v Socket, Cup Holders, Remote Central '
'Locking With Two Keys, Front Fog Lights, Spare Wheel, Clean '
'And Tidy Car For Year Drives Well, Has Part Service History, '
'Cambelt Kit Replaced At 99500 Mile In April 2025, MOT Expires '
'27/03/2027, 3 Months Parts And Labour Warranty, Part Exchange '
'Considered,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.6L',
'engine_horse_power': 113,
'fuel_type': 'Petrol',
'id': 'da080f54-d248-5863-b7ef-86b0f5a5b2d5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603190823204',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Ford',
'model': 'Focus C-Max',
'odometer': 103531,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://m.atcdn.co.uk/a/media/2cc0631f664843ecbcedb78fa31de651.jpg',
'https://m.atcdn.co.uk/a/media/61662860688e466bbfc48e9163ebed14.jpg',
'https://m.atcdn.co.uk/a/media/306136fbe8a343fe8f68ce6ea479f25f.jpg',
'https://m.atcdn.co.uk/a/media/4a759e792110448a9316bdc7ed9c506c.jpg',
'https://m.atcdn.co.uk/a/media/24f7b443233448eda7465513f31b95a3.jpg',
'https://m.atcdn.co.uk/a/media/92d780bba8bd4e418b569aaebbdcaf5c.jpg',
'https://m.atcdn.co.uk/a/media/2d446178fd33460a8186a53616279f03.jpg',
'https://m.atcdn.co.uk/a/media/b2a0ca7e31a94b628a4abab72655b80d.jpg',
'https://m.atcdn.co.uk/a/media/8eb0bc48b70a4ae4b02aaaa86103962f.jpg',
'https://m.atcdn.co.uk/a/media/89cac85f8f1d47a79ac157b1cf697927.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322371,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2cc0631f664843ecbcedb78fa31de651.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 527041,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/61662860688e466bbfc48e9163ebed14.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 554502,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/306136fbe8a343fe8f68ce6ea479f25f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533338,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a759e792110448a9316bdc7ed9c506c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 555960,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/24f7b443233448eda7465513f31b95a3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 591224,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/92d780bba8bd4e418b569aaebbdcaf5c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590967,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2d446178fd33460a8186a53616279f03.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 546573,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b2a0ca7e31a94b628a4abab72655b80d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583116,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8eb0bc48b70a4ae4b02aaaa86103962f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da080f54-d248-5863-b7ef-86b0f5a5b2d5/da080f54-d248-5863-b7ef-86b0f5a5b2d5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403020,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/89cac85f8f1d47a79ac157b1cf697927.jpg',
'Width': 2048}],
'price': 1695,
'price_includes_vat': True,
'registration_date': '2005-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus C-Max 1.6 16v Zetec 5dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2005}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603190823204%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603190823204: {'created_time': 1774883254.744509, 'last_price_update_time': 1774883254.74452}
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603190823204') HTTP/1.1" 204 0
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8ad633-6cc2-5ff0-b3a5-21e619946a1d with identifier: 202601129093118
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac8ad633-6cc2-5ff0-b3a5-21e619946a1d
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F234d505c742e4bde965600b318b5fa64.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/234d505c742e4bde965600b318b5fa64.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F5fd069e9fd0240388637a1ae6acb8255.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/5fd069e9fd0240388637a1ae6acb8255.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0bb9f24928cc4e788551d9ba961f21ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0bb9f24928cc4e788551d9ba961f21ea.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e70023cea9f45a78b34ff1a4bb17c13.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e70023cea9f45a78b34ff1a4bb17c13.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe9274cc263744b4ba07d02d2f11f023d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e9274cc263744b4ba07d02d2f11f023d.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F02920a6c0bb44955aaf59d92be0aa57c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/02920a6c0bb44955aaf59d92be0aa57c.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F083e610cd42843088f696462b58ff67d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/083e610cd42843088f696462b58ff67d.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc55c9d947e4640e3a536382f2ec026ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c55c9d947e4640e3a536382f2ec026ba.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd81eff5523a74cb4b77dbb8774c421f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d81eff5523a74cb4b77dbb8774c421f3.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd224478bd89e439bace1e4374680a930.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d224478bd89e439bace1e4374680a930.jpg already downloaded
2026-03-30 15:07:34 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c073d971-545b-5f63-bf80-816e9c2854fe with identifier: 202603170770605
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c073d971-545b-5f63-bf80-816e9c2854fe
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F092a0530b0344cd99b243f29011cddef.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/092a0530b0344cd99b243f29011cddef.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F799064b7a16b4564aac32fc6d567fc73.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/799064b7a16b4564aac32fc6d567fc73.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4acd96a769de401c81ba2c8219df999c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4acd96a769de401c81ba2c8219df999c.jpg already downloaded
2026-03-30 15:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F90ecd01905c64bffae27edb4ce651958.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/90ecd01905c64bffae27edb4ce651958.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F75326b456870432bb1efddf0a08f8a9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/75326b456870432bb1efddf0a08f8a9a.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F392aed6147f34430a9b08081983ea228.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/392aed6147f34430a9b08081983ea228.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fadba9ff0b16648ef9501e2ee5eefd9b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/adba9ff0b16648ef9501e2ee5eefd9b8.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd9b82c61a7d748438a0e7de5cec8edda.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d9b82c61a7d748438a0e7de5cec8edda.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8fbb59a36b84495f9fab20e71c58c2e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8fbb59a36b84495f9fab20e71c58c2e6.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fd7ed20e662d24de686aa22c10a9b2f0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/d7ed20e662d24de686aa22c10a9b2f0c.jpg already downloaded
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ac8ad633-6cc2-5ff0-b3a5-21e619946a1d with identifier 202601129093118
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ac8ad633-6cc2-5ff0-b3a5-21e619946a1d
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Blue',
'currency': 'GBP',
'description': 'Fiat 500 Lounge 1.2 cc 3dr Hatchback Finished Off In A Blue '
'Bodywork And Has A Grey Cloth And cream leather Interior, Has '
'Alloy Wheels, Daytime Running Lights, Remote Central Locking, '
'Electric Front Windows, Electric Mirrors, Heated Rear Screen, '
'Air Conditioning, Touch Screen Dab Radio With Bluetooth '
'Compatible, Aux, Usb And 12v Sockets In Centre Consol With '
'Cup Holders, Multifunctional Steering Wheel, Cruise Control, '
'Adjustable Steering Wheel, Tyre Repair Kit, Panoramic Sunroof '
'With Blind, Has Service History, Mot, 6 Months Parts And '
'Labour Warranty, Part Exchange Considered, Clean And Tidy Car '
'Drives Well,',
'doors_number': 3,
'emission_standard': 'Euro 6',
'engine': '1.2L',
'engine_horse_power': 69,
'fuel_type': 'Petrol',
'id': 'ac8ad633-6cc2-5ff0-b3a5-21e619946a1d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202601129093118',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Fiat',
'model': '500',
'odometer': 58758,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://m.atcdn.co.uk/a/media/234d505c742e4bde965600b318b5fa64.jpg',
'https://m.atcdn.co.uk/a/media/5fd069e9fd0240388637a1ae6acb8255.jpg',
'https://m.atcdn.co.uk/a/media/0bb9f24928cc4e788551d9ba961f21ea.jpg',
'https://m.atcdn.co.uk/a/media/3e70023cea9f45a78b34ff1a4bb17c13.jpg',
'https://m.atcdn.co.uk/a/media/e9274cc263744b4ba07d02d2f11f023d.jpg',
'https://m.atcdn.co.uk/a/media/02920a6c0bb44955aaf59d92be0aa57c.jpg',
'https://m.atcdn.co.uk/a/media/083e610cd42843088f696462b58ff67d.jpg',
'https://m.atcdn.co.uk/a/media/c55c9d947e4640e3a536382f2ec026ba.jpg',
'https://m.atcdn.co.uk/a/media/d81eff5523a74cb4b77dbb8774c421f3.jpg',
'https://m.atcdn.co.uk/a/media/d224478bd89e439bace1e4374680a930.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360159,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/234d505c742e4bde965600b318b5fa64.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411685,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/5fd069e9fd0240388637a1ae6acb8255.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371217,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0bb9f24928cc4e788551d9ba961f21ea.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357672,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e70023cea9f45a78b34ff1a4bb17c13.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378317,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e9274cc263744b4ba07d02d2f11f023d.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370438,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/02920a6c0bb44955aaf59d92be0aa57c.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 404114,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/083e610cd42843088f696462b58ff67d.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356626,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c55c9d947e4640e3a536382f2ec026ba.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412806,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d81eff5523a74cb4b77dbb8774c421f3.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ad633-6cc2-5ff0-b3a5-21e619946a1d/ac8ad633-6cc2-5ff0-b3a5-21e619946a1d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175800,
'Height': 1152,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d224478bd89e439bace1e4374680a930.jpg',
'Width': 1536}],
'price': 5595,
'price_includes_vat': True,
'registration_date': '2017-05-17',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 1.2 500 My17 1.2 69hp Lounge 3dr',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202601129093118%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202601129093118: {'created_time': 1774883255.13491, 'last_price_update_time': 1774883255.134924}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202601129093118') HTTP/1.1" 204 0
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c073d971-545b-5f63-bf80-816e9c2854fe with identifier 202603170770605
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c073d971-545b-5f63-bf80-816e9c2854fe
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'Blue',
'currency': 'GBP',
'description': 'Skoda Octavia 2.0 Tdi Est Finshed Off In A Blue Paintwork And '
'Has A Beige Leather Interior, Alloy Wheels, Daytime Running '
'Lights, Remote Central Locking With Two Remote Keys, Electric '
'Windows Front And Rear, Electric Powerfold Mirrors, Auto '
'Lights, Heated Rear Screen,Dab Touch Screen Radio With Media, '
'Phone,Nav, Cd Player In Glovebox With Sd Card Slots, Aux And '
'USB Socket In Centre Consol, 12v Socket, Cup Holders, Centre '
'Armrest, Multifunctional Steering Wheel With Cruise Control, '
'Air Conditioning, Panoramic Sunroof With Electric Blind, '
'Comes With Some Service History, And A Full Mot, 6 Months '
'Parts And Labour Warranty, Part Exchange Considered, Clean '
'And Tidy Car Drives Well ,',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'c073d971-545b-5f63-bf80-816e9c2854fe',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603170770605',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 93763,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/092a0530b0344cd99b243f29011cddef.jpg',
'https://m.atcdn.co.uk/a/media/799064b7a16b4564aac32fc6d567fc73.jpg',
'https://m.atcdn.co.uk/a/media/4acd96a769de401c81ba2c8219df999c.jpg',
'https://m.atcdn.co.uk/a/media/90ecd01905c64bffae27edb4ce651958.jpg',
'https://m.atcdn.co.uk/a/media/75326b456870432bb1efddf0a08f8a9a.jpg',
'https://m.atcdn.co.uk/a/media/392aed6147f34430a9b08081983ea228.jpg',
'https://m.atcdn.co.uk/a/media/adba9ff0b16648ef9501e2ee5eefd9b8.jpg',
'https://m.atcdn.co.uk/a/media/d9b82c61a7d748438a0e7de5cec8edda.jpg',
'https://m.atcdn.co.uk/a/media/8fbb59a36b84495f9fab20e71c58c2e6.jpg',
'https://m.atcdn.co.uk/a/media/d7ed20e662d24de686aa22c10a9b2f0c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389176,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/092a0530b0344cd99b243f29011cddef.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631090,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/799064b7a16b4564aac32fc6d567fc73.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700350,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4acd96a769de401c81ba2c8219df999c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 644701,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/90ecd01905c64bffae27edb4ce651958.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650852,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/75326b456870432bb1efddf0a08f8a9a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 651329,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/392aed6147f34430a9b08081983ea228.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700989,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/adba9ff0b16648ef9501e2ee5eefd9b8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198470,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d9b82c61a7d748438a0e7de5cec8edda.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 634897,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8fbb59a36b84495f9fab20e71c58c2e6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c073d971-545b-5f63-bf80-816e9c2854fe/c073d971-545b-5f63-bf80-816e9c2854fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709524,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/d7ed20e662d24de686aa22c10a9b2f0c.jpg',
'Width': 2048}],
'price': 6795,
'price_includes_vat': True,
'registration_date': '2013-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Octavia 2.0 TDI Elegance Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2013}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603170770605%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603170770605: {'created_time': 1774883255.184034, 'last_price_update_time': 1774883255.184043}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603170770605') HTTP/1.1" 204 0
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b53c4bcf-d797-5c8b-9065-390df0b8330e with identifier: 202508065178989
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b53c4bcf-d797-5c8b-9065-390df0b8330e
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F51475feca2f6478aa755002eab78110b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/51475feca2f6478aa755002eab78110b.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe6733267b02f4fa991497caf8dd5b46f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e6733267b02f4fa991497caf8dd5b46f.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6d37538c7a564e0ab46a81f630c5b9a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6d37538c7a564e0ab46a81f630c5b9a9.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1e684a78f01a4870a26be2313129bc19.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1e684a78f01a4870a26be2313129bc19.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc4dcd19c955e40f0a6931ad3007186e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c4dcd19c955e40f0a6931ad3007186e0.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F67f0bb6c1f7d4c4bb4c80a68244482ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/67f0bb6c1f7d4c4bb4c80a68244482ef.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa9f51fe7de5f4d81aa494655dce7006f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a9f51fe7de5f4d81aa494655dce7006f.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F7ae35288425a497cb64bb770c4759af2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/7ae35288425a497cb64bb770c4759af2.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fb9a77115687f42f887e19a010d812c14.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/b9a77115687f42f887e19a010d812c14.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F93abcb2c5bae4d6fb24bc4814bc4b969.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/93abcb2c5bae4d6fb24bc4814bc4b969.jpg already downloaded
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f780af67-7348-5114-a021-e5f7864cb77e with identifier: 202603160726682
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f780af67-7348-5114-a021-e5f7864cb77e
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe0a11b2d51964e4ba6810dedd236fe33.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e0a11b2d51964e4ba6810dedd236fe33.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3688dbae99dc4ac8bf9bd9ae0143228d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3688dbae99dc4ac8bf9bd9ae0143228d.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fa9ae1b5a64ec4d16988d2d9312caa5dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/a9ae1b5a64ec4d16988d2d9312caa5dc.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fef9a487e7bcf4a68a731f611caed8911.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ef9a487e7bcf4a68a731f611caed8911.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F924ada3dd0d840389fde30fe218cbf3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/924ada3dd0d840389fde30fe218cbf3a.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F55b8fa8db78b4911bc31e5c23b816705.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/55b8fa8db78b4911bc31e5c23b816705.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91e8d64fcb614138b21cf8f4ead01b33.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91e8d64fcb614138b21cf8f4ead01b33.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8897adea4e3541868a4022c21b35c7d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8897adea4e3541868a4022c21b35c7d7.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F04422e6d443646bd9997c53ef1b9118f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/04422e6d443646bd9997c53ef1b9118f.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F719462406c96452a975b50b6c90f58f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/719462406c96452a975b50b6c90f58f2.jpg already downloaded
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b53c4bcf-d797-5c8b-9065-390df0b8330e with identifier 202508065178989
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b53c4bcf-d797-5c8b-9065-390df0b8330e
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 179,
'color': 'White',
'currency': 'GBP',
'description': 'Toyota Hilux 2.4 ,4 D Active, Finished Off In A White '
'Bodywork And Has A Grey Cloth Interior, Electric Front And '
'Rear, Heated Rear Screen, Electric Mirrors, Auto Lights, '
'Remote Central Locking, Air Conditioning, Touch Screen Radio '
'Cd With Bluetooth, Multifunctional Steering Wheel, Aux And '
'USB Socket, 12v Socket, Airbags, Adjustable Steering Wheel, '
'Centre Armrest, Spare Wheel, MOT Expires 14/07/2026, 6 Months '
'Parts & Labour Warranty, Service History, Finance Available '
'Subject To Status\n'
'\n'
'With only one owner and very low mileage for its age at 30302 '
'miles, this 2019 Toyota Hilux D-4D Active is a smart pick-up '
'choice. The Hilux, in its Active trim, is powered by a 2.4L '
'diesel engine and offers four-wheel drive capability. This '
'Hilux derivative is the 2.4 D-4D Active 4WD Euro 6 4dr '
'(3.5t).\n'
'\n'
'This Hilux includes manual air conditioning, incorporating '
'air conditioning for your comfort. The dusk sensor, including '
'automatic headlights, adds a layer of convenience. The audio '
'system, featuring an AM-FM radio, CD player, and Bluetooth '
'connectivity with four speakers, ensures you stay connected '
'and entertained. With its Euro 6 emission class and low CO2 '
'emissions, this Hilux is kinder to the environment than '
'similar vehicles. It also boasts a substantial towing '
'capacity of 3500 kg. For peace of mind, it comes with a '
'6-month warranty and an MOT valid until July 2026.',
'doors_number': 4,
'emission_standard': 'Euro 6',
'engine': '2.4L',
'engine_horse_power': 148,
'fuel_type': 'Diesel',
'id': 'b53c4bcf-d797-5c8b-9065-390df0b8330e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202508065178989',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Toyota',
'model': 'Hilux',
'odometer': 30302,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photo_urls': ['https://m.atcdn.co.uk/a/media/51475feca2f6478aa755002eab78110b.jpg',
'https://m.atcdn.co.uk/a/media/e6733267b02f4fa991497caf8dd5b46f.jpg',
'https://m.atcdn.co.uk/a/media/6d37538c7a564e0ab46a81f630c5b9a9.jpg',
'https://m.atcdn.co.uk/a/media/1e684a78f01a4870a26be2313129bc19.jpg',
'https://m.atcdn.co.uk/a/media/c4dcd19c955e40f0a6931ad3007186e0.jpg',
'https://m.atcdn.co.uk/a/media/67f0bb6c1f7d4c4bb4c80a68244482ef.jpg',
'https://m.atcdn.co.uk/a/media/a9f51fe7de5f4d81aa494655dce7006f.jpg',
'https://m.atcdn.co.uk/a/media/7ae35288425a497cb64bb770c4759af2.jpg',
'https://m.atcdn.co.uk/a/media/b9a77115687f42f887e19a010d812c14.jpg',
'https://m.atcdn.co.uk/a/media/93abcb2c5bae4d6fb24bc4814bc4b969.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d9ea30-41bc-5d18-b773-0ea601c19a51/96d9ea30-41bc-5d18-b773-0ea601c19a51_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276353,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/51475feca2f6478aa755002eab78110b.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d9ea30-41bc-5d18-b773-0ea601c19a51/96d9ea30-41bc-5d18-b773-0ea601c19a51_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 579362,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e6733267b02f4fa991497caf8dd5b46f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df53dac5-a1f9-5539-bc94-a0a0b8ccf836/df53dac5-a1f9-5539-bc94-a0a0b8ccf836_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 14282,
'Height': 250,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6d37538c7a564e0ab46a81f630c5b9a9.jpg',
'Width': 300},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d9ea30-41bc-5d18-b773-0ea601c19a51/96d9ea30-41bc-5d18-b773-0ea601c19a51_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559054,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1e684a78f01a4870a26be2313129bc19.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d9ea30-41bc-5d18-b773-0ea601c19a51/96d9ea30-41bc-5d18-b773-0ea601c19a51_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 530413,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c4dcd19c955e40f0a6931ad3007186e0.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d9ea30-41bc-5d18-b773-0ea601c19a51/96d9ea30-41bc-5d18-b773-0ea601c19a51_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473584,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/67f0bb6c1f7d4c4bb4c80a68244482ef.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d9ea30-41bc-5d18-b773-0ea601c19a51/96d9ea30-41bc-5d18-b773-0ea601c19a51_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577321,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a9f51fe7de5f4d81aa494655dce7006f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d9ea30-41bc-5d18-b773-0ea601c19a51/96d9ea30-41bc-5d18-b773-0ea601c19a51_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500795,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/7ae35288425a497cb64bb770c4759af2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96d9ea30-41bc-5d18-b773-0ea601c19a51/96d9ea30-41bc-5d18-b773-0ea601c19a51_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525061,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/b9a77115687f42f887e19a010d812c14.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a89c21b7-11e0-5049-9b6f-7dc5e79f7e6e/a89c21b7-11e0-5049-9b6f-7dc5e79f7e6e_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21731,
'Height': 385,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/93abcb2c5bae4d6fb24bc4814bc4b969.jpg',
'Width': 385}],
'price': 22434,
'price_includes_vat': True,
'registration_date': '2019-10-17',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Hilux 2.4 D-4D Active 4WD Euro 6 4dr (3.5t)',
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202508065178989%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202508065178989: {'created_time': 1774883255.588208, 'last_price_update_time': 1774883255.588218}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202508065178989') HTTP/1.1" 204 0
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f780af67-7348-5114-a021-e5f7864cb77e with identifier 202603160726682
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f780af67-7348-5114-a021-e5f7864cb77e
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 129,
'color': 'White',
'currency': 'GBP',
'description': 'Ford Fiesta 1.25 Zetec 3rd Finished Off In Frozen White '
'Bodywork And Has A Grey Cloth Interior, Has Alloy Wheels, '
'Front Fog Lights, Remote Central Locking With Two Remote '
'Keys, Electric Windows Front, Air Conditioning, Radio Cd With '
'Bluetooth, Aux, Usb And 12v Sockets In Centre Consol, Heated '
'Front And Rear Screen, Tyre Repair Kit,Comes With Full '
'Service History, Mot February 2027, Clean And Tidy Car Drives '
'Well 6 Months Parts And Labour Warranty, Part Exchange '
'Considerd,',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1.25L',
'engine_horse_power': 81,
'fuel_type': 'Petrol',
'id': 'f780af67-7348-5114-a021-e5f7864cb77e',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603160726682',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 46601,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://m.atcdn.co.uk/a/media/e0a11b2d51964e4ba6810dedd236fe33.jpg',
'https://m.atcdn.co.uk/a/media/3688dbae99dc4ac8bf9bd9ae0143228d.jpg',
'https://m.atcdn.co.uk/a/media/a9ae1b5a64ec4d16988d2d9312caa5dc.jpg',
'https://m.atcdn.co.uk/a/media/ef9a487e7bcf4a68a731f611caed8911.jpg',
'https://m.atcdn.co.uk/a/media/924ada3dd0d840389fde30fe218cbf3a.jpg',
'https://m.atcdn.co.uk/a/media/55b8fa8db78b4911bc31e5c23b816705.jpg',
'https://m.atcdn.co.uk/a/media/91e8d64fcb614138b21cf8f4ead01b33.jpg',
'https://m.atcdn.co.uk/a/media/8897adea4e3541868a4022c21b35c7d7.jpg',
'https://m.atcdn.co.uk/a/media/04422e6d443646bd9997c53ef1b9118f.jpg',
'https://m.atcdn.co.uk/a/media/719462406c96452a975b50b6c90f58f2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332252,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e0a11b2d51964e4ba6810dedd236fe33.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620293,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3688dbae99dc4ac8bf9bd9ae0143228d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577724,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/a9ae1b5a64ec4d16988d2d9312caa5dc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484526,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ef9a487e7bcf4a68a731f611caed8911.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518648,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/924ada3dd0d840389fde30fe218cbf3a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571577,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/55b8fa8db78b4911bc31e5c23b816705.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510837,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/91e8d64fcb614138b21cf8f4ead01b33.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516914,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8897adea4e3541868a4022c21b35c7d7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 594379,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/04422e6d443646bd9997c53ef1b9118f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f780af67-7348-5114-a021-e5f7864cb77e/f780af67-7348-5114-a021-e5f7864cb77e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273363,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/719462406c96452a975b50b6c90f58f2.jpg',
'Width': 2048}],
'price': 4895,
'price_includes_vat': True,
'registration_date': '2012-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Zetec 3dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2012}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603160726682%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603160726682: {'created_time': 1774883255.637857, 'last_price_update_time': 1774883255.637867}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603160726682') HTTP/1.1" 204 0
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 39423c45-1dd4-52eb-999d-64fe16be96dc with identifier: 202603130664553
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39423c45-1dd4-52eb-999d-64fe16be96dc
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F23b272965dc947078927f520bcb7c280.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/23b272965dc947078927f520bcb7c280.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62f9587a68aa4d8db98aea6ced8e5368.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62f9587a68aa4d8db98aea6ced8e5368.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F96ae910abe1c431d9a40a386339446c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/96ae910abe1c431d9a40a386339446c8.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ac40033f49e47a3bb45d9c1bfb89582.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ac40033f49e47a3bb45d9c1bfb89582.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F74e12b147ecf40b2865755069705e65a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/74e12b147ecf40b2865755069705e65a.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6fd1934710e444bfb703fe541929be60.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6fd1934710e444bfb703fe541929be60.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1b82b27718604f58aa5ad1e2c026a9a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1b82b27718604f58aa5ad1e2c026a9a6.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8ca8ce85662a45ae8633980c17b5a97a.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8ca8ce85662a45ae8633980c17b5a97a.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F2a4473bce7c1426fbf773fade21efb61.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/2a4473bce7c1426fbf773fade21efb61.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F64fb8a624d9140c08d7ea55e7b5fef59.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/64fb8a624d9140c08d7ea55e7b5fef59.jpg already downloaded
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 39423c45-1dd4-52eb-999d-64fe16be96dc with identifier 202603130664553
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 39423c45-1dd4-52eb-999d-64fe16be96dc
2026-03-30 15:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 95,
'color': 'Black',
'currency': 'GBP',
'description': 'Toyota Aygo 1.0 Vvti X Style,5dr Finished Off In A Black '
'Paintwork And A Grey Cloth Interior Has A Full Fabric '
'Electric Sunroof, With Black Alloy Wheels, Daytime Running '
'Lights, Electric Front Windows, Electric Door Mirrors, Dab '
'Touch Screen Radio With Bluetooth And Sat Nav With Rear '
'Parking Camera, Air Conditioning, Multifunctional Steering '
'Wheel,Heated Rear Screen, Aux, Usb And 12v Sockets With Cup '
'Holders In Centre Consol, Drivers Seat Height Adjustment, '
'Tyre Repair Kit, Remote Central Locking With Two Keys, Speed '
'Limiter, Clean And Tidy Car Drives Well,Full Mot, Service '
'History, 6 Months Parts And Labour Warranty, Part Exchange '
'Considered,',
'doors_number': 5,
'emission_standard': 'Euro 6',
'engine': '1L',
'engine_horse_power': 67,
'fuel_type': 'Petrol',
'id': '39423c45-1dd4-52eb-999d-64fe16be96dc',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603130664553',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Toyota',
'model': 'AYGO',
'odometer': 59020,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/23b272965dc947078927f520bcb7c280.jpg',
'https://m.atcdn.co.uk/a/media/62f9587a68aa4d8db98aea6ced8e5368.jpg',
'https://m.atcdn.co.uk/a/media/96ae910abe1c431d9a40a386339446c8.jpg',
'https://m.atcdn.co.uk/a/media/6ac40033f49e47a3bb45d9c1bfb89582.jpg',
'https://m.atcdn.co.uk/a/media/74e12b147ecf40b2865755069705e65a.jpg',
'https://m.atcdn.co.uk/a/media/6fd1934710e444bfb703fe541929be60.jpg',
'https://m.atcdn.co.uk/a/media/1b82b27718604f58aa5ad1e2c026a9a6.jpg',
'https://m.atcdn.co.uk/a/media/8ca8ce85662a45ae8633980c17b5a97a.jpg',
'https://m.atcdn.co.uk/a/media/2a4473bce7c1426fbf773fade21efb61.jpg',
'https://m.atcdn.co.uk/a/media/64fb8a624d9140c08d7ea55e7b5fef59.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355440,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/23b272965dc947078927f520bcb7c280.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605693,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62f9587a68aa4d8db98aea6ced8e5368.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718757,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/96ae910abe1c431d9a40a386339446c8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638550,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ac40033f49e47a3bb45d9c1bfb89582.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 607798,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/74e12b147ecf40b2865755069705e65a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625327,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6fd1934710e444bfb703fe541929be60.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693857,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1b82b27718604f58aa5ad1e2c026a9a6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586286,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8ca8ce85662a45ae8633980c17b5a97a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639762,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/2a4473bce7c1426fbf773fade21efb61.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39423c45-1dd4-52eb-999d-64fe16be96dc/39423c45-1dd4-52eb-999d-64fe16be96dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297859,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/64fb8a624d9140c08d7ea55e7b5fef59.jpg',
'Width': 2048}],
'price': 6795,
'price_includes_vat': True,
'registration_date': '2017-10-26',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo 1.0 VVT-i x-style Euro 6 5dr',
'transmission': 'manual',
'trim': 'x-style',
'year': 2017}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603130664553%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603130664553: {'created_time': 1774883255.86093, 'last_price_update_time': 1774883255.860939}
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603130664553') HTTP/1.1" 204 0
2026-03-30 15:07:35 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a76accd7-1e56-5147-97a8-9c04ffebc5a8 with identifier: 202603110609057
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a76accd7-1e56-5147-97a8-9c04ffebc5a8
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fed404b07dfa84e45ad8cef597fd8df25.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/ed404b07dfa84e45ad8cef597fd8df25.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1590a32ae48549bc9b15e03067c25464.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1590a32ae48549bc9b15e03067c25464.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F0145e8517d3c45ca9b2071438afad744.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/0145e8517d3c45ca9b2071438afad744.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F27973e71b3034a5aa77f58b78982bbe5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/27973e71b3034a5aa77f58b78982bbe5.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F8cb526d3dc3a45c888102191a0a0332e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/8cb526d3dc3a45c888102191a0a0332e.jpg already downloaded
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F25a9373b8e154bce9823877ae1c5a2fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/25a9373b8e154bce9823877ae1c5a2fb.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F16f1ae470e9c492d98c0ecf8cc0de049.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/16f1ae470e9c492d98c0ecf8cc0de049.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe6a9adbe83e3452f89bdc54dceb0485d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e6a9adbe83e3452f89bdc54dceb0485d.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fde29d1447a1747a091973be763123ae4.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/de29d1447a1747a091973be763123ae4.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc908714cc1fc47159f6cfea1c8488020.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c908714cc1fc47159f6cfea1c8488020.jpg already downloaded
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a76accd7-1e56-5147-97a8-9c04ffebc5a8 with identifier 202603110609057
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a76accd7-1e56-5147-97a8-9c04ffebc5a8
2026-03-30 15:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'Silver',
'currency': 'GBP',
'description': 'Ford B/Max 1.5Tdci ,Finished Off In Tectonic Silver Bodywork '
'And Has A Grey Cloth Interior, Comes With Alloy Wheels, '
'Daytime Running Lights, Rear Parking Sensors, Remote Central '
'Locking With Two Remote Keys, Front And Rear Heated Screen, '
'Drivers Seat Height Adjustment, Electric Windows Front And '
'Rear, Adjustable Steering Wheel,Dab Radio Cd, Aux And 12v '
'Socket, Multifunctional Steering Wheel, Twin Cup Holders, Air '
'Conditioning, Spare Wheel, Electric Mirrors, Comes With '
'Service History, Mot November 2026,Clean And Tidy Car Drives '
'Well, Part Exchange Considerd, 6 Months Parts And Labour '
'Warranty,0',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '1.5L',
'engine_horse_power': 74,
'fuel_type': 'Diesel',
'id': 'a76accd7-1e56-5147-97a8-9c04ffebc5a8',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603110609057',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Ford',
'model': 'B-Max',
'odometer': 55097,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://m.atcdn.co.uk/a/media/ed404b07dfa84e45ad8cef597fd8df25.jpg',
'https://m.atcdn.co.uk/a/media/1590a32ae48549bc9b15e03067c25464.jpg',
'https://m.atcdn.co.uk/a/media/0145e8517d3c45ca9b2071438afad744.jpg',
'https://m.atcdn.co.uk/a/media/27973e71b3034a5aa77f58b78982bbe5.jpg',
'https://m.atcdn.co.uk/a/media/8cb526d3dc3a45c888102191a0a0332e.jpg',
'https://m.atcdn.co.uk/a/media/25a9373b8e154bce9823877ae1c5a2fb.jpg',
'https://m.atcdn.co.uk/a/media/16f1ae470e9c492d98c0ecf8cc0de049.jpg',
'https://m.atcdn.co.uk/a/media/e6a9adbe83e3452f89bdc54dceb0485d.jpg',
'https://m.atcdn.co.uk/a/media/de29d1447a1747a091973be763123ae4.jpg',
'https://m.atcdn.co.uk/a/media/c908714cc1fc47159f6cfea1c8488020.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367775,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/ed404b07dfa84e45ad8cef597fd8df25.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640593,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1590a32ae48549bc9b15e03067c25464.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681780,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/0145e8517d3c45ca9b2071438afad744.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 571471,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/27973e71b3034a5aa77f58b78982bbe5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 564352,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/8cb526d3dc3a45c888102191a0a0332e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 712444,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/25a9373b8e154bce9823877ae1c5a2fb.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605499,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/16f1ae470e9c492d98c0ecf8cc0de049.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668325,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e6a9adbe83e3452f89bdc54dceb0485d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551734,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/de29d1447a1747a091973be763123ae4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76accd7-1e56-5147-97a8-9c04ffebc5a8/a76accd7-1e56-5147-97a8-9c04ffebc5a8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590698,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c908714cc1fc47159f6cfea1c8488020.jpg',
'Width': 2048}],
'price': 4795,
'price_includes_vat': True,
'registration_date': '2014-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'Ford B-Max 1.5 TDCi Zetec Euro 5 5dr',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2014}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603110609057%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603110609057: {'created_time': 1774883256.100601, 'last_price_update_time': 1774883256.100612}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603110609057') HTTP/1.1" 204 0
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da82127-bd39-508b-974c-f6f3f820309d with identifier: 202603060466689
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6da82127-bd39-508b-974c-f6f3f820309d
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F9bbec669479c4f7d899b0c21000c2510.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/9bbec669479c4f7d899b0c21000c2510.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1df4f4f1066441caa77e48a8fec07638.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1df4f4f1066441caa77e48a8fec07638.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F98f6bdb129e24a38805f882e39db8f6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/98f6bdb129e24a38805f882e39db8f6e.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F421e54251f3f4cdba0f5e313824284b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/421e54251f3f4cdba0f5e313824284b7.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F1dc2e48e411644f9be4bb6cda5f1ebd5.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/1dc2e48e411644f9be4bb6cda5f1ebd5.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F08eba4797a44418fab8fab3482acb743.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/08eba4797a44418fab8fab3482acb743.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6c9373c8d6c2409fa80068cf73d28d49.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6c9373c8d6c2409fa80068cf73d28d49.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F73d8fa7ae27e4f199dfd43b64cd8425f.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/73d8fa7ae27e4f199dfd43b64cd8425f.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc252acab2ff040d39e4a7a373ddbbf34.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c252acab2ff040d39e4a7a373ddbbf34.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F95aff16f108145e18e0cad073a50d5e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/95aff16f108145e18e0cad073a50d5e3.jpg already downloaded
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6da82127-bd39-508b-974c-f6f3f820309d with identifier 202603060466689
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6da82127-bd39-508b-974c-f6f3f820309d
2026-03-30 15:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 113,
'color': 'Black',
'currency': 'GBP',
'description': 'Fiat 500 S 1.2cc Finished Off In A Black Paintwork And Has A '
'Black Interior of Cloth and suede and vinly,Has Alloy '
'Wheels, Daytime Running Lights, Remote Central Locking With '
'Two Keys, Air Conditioning, Heated Rear Screen, Radio Cd With '
'Blue&Me , USB And Aux Socket, 12v Socket, Cup Holders, '
'Multifunctional Steering Wheel, Spare Wheel, Comes With A '
'Good Service History, Mot December 2026, Clean And Tidy Car '
'Drives Well, 6 Months Parts And Labour Warranty, Part '
'Exchange Considerd,',
'doors_number': 3,
'emission_standard': 'Euro 5',
'engine': '1.2L',
'engine_horse_power': 69,
'fuel_type': 'Petrol',
'id': '6da82127-bd39-508b-974c-f6f3f820309d',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603060466689',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Fiat',
'model': '500',
'odometer': 71800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photo_urls': ['https://m.atcdn.co.uk/a/media/9bbec669479c4f7d899b0c21000c2510.jpg',
'https://m.atcdn.co.uk/a/media/1df4f4f1066441caa77e48a8fec07638.jpg',
'https://m.atcdn.co.uk/a/media/98f6bdb129e24a38805f882e39db8f6e.jpg',
'https://m.atcdn.co.uk/a/media/421e54251f3f4cdba0f5e313824284b7.jpg',
'https://m.atcdn.co.uk/a/media/1dc2e48e411644f9be4bb6cda5f1ebd5.jpg',
'https://m.atcdn.co.uk/a/media/08eba4797a44418fab8fab3482acb743.jpg',
'https://m.atcdn.co.uk/a/media/6c9373c8d6c2409fa80068cf73d28d49.jpg',
'https://m.atcdn.co.uk/a/media/73d8fa7ae27e4f199dfd43b64cd8425f.jpg',
'https://m.atcdn.co.uk/a/media/c252acab2ff040d39e4a7a373ddbbf34.jpg',
'https://m.atcdn.co.uk/a/media/95aff16f108145e18e0cad073a50d5e3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365530,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/9bbec669479c4f7d899b0c21000c2510.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 611631,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1df4f4f1066441caa77e48a8fec07638.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709871,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/98f6bdb129e24a38805f882e39db8f6e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677263,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/421e54251f3f4cdba0f5e313824284b7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 573107,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/1dc2e48e411644f9be4bb6cda5f1ebd5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665564,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/08eba4797a44418fab8fab3482acb743.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638046,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6c9373c8d6c2409fa80068cf73d28d49.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 668903,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/73d8fa7ae27e4f199dfd43b64cd8425f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665128,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c252acab2ff040d39e4a7a373ddbbf34.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6da82127-bd39-508b-974c-f6f3f820309d/6da82127-bd39-508b-974c-f6f3f820309d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 497940,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/95aff16f108145e18e0cad073a50d5e3.jpg',
'Width': 2048}],
'price': 3995,
'price_includes_vat': True,
'registration_date': '2013-08-08',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 S Euro 5 (s/s) 3dr',
'transmission': 'manual',
'trim': 'S',
'year': 2013}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603060466689%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603060466689: {'created_time': 1774883256.35682, 'last_price_update_time': 1774883256.356829}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603060466689') HTTP/1.1" 204 0
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ed331a4a-00e2-5e3d-8a92-6ad46d205bd5 with identifier: 202603050436093
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed331a4a-00e2-5e3d-8a92-6ad46d205bd5
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Faeba259851f34776b6a1b649a6acb18d.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/aeba259851f34776b6a1b649a6acb18d.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fbdbcbcd2e444473e95f4e0017b0b4591.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/bdbcbcd2e444473e95f4e0017b0b4591.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff78492a30caa4719a9e73af83a937c66.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f78492a30caa4719a9e73af83a937c66.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fe8400d38225c4c7b851c5bd1a3affaef.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/e8400d38225c4c7b851c5bd1a3affaef.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3ad4daba620446e28cd5a1ae37c3b03b.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3ad4daba620446e28cd5a1ae37c3b03b.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fcb7e8b43010e4141a65181ae328d17e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/cb7e8b43010e4141a65181ae328d17e8.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6ecf8f3fcb42494595edb2f8e74ed462.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6ecf8f3fcb42494595edb2f8e74ed462.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Ff8054ca1902a439089b20bcca8ade657.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/f8054ca1902a439089b20bcca8ade657.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc3de8f0b961f4b5380e8a03544755871.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c3de8f0b961f4b5380e8a03544755871.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F6fe393ffd71d4ab798ea98cb0bb960c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/6fe393ffd71d4ab798ea98cb0bb960c3.jpg already downloaded
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ed331a4a-00e2-5e3d-8a92-6ad46d205bd5 with identifier 202603050436093
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ed331a4a-00e2-5e3d-8a92-6ad46d205bd5
2026-03-30 15:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'Black',
'currency': 'GBP',
'description': 'Ford Fiesta 1.4 Titanium 5dr Finished Off In A Black '
'Paintwork And Has A Grey Cloth Interior, Has Alloy Wheels, '
'Remote Central Locking, Electric Front Windows, Heated Front '
'And Rear Screen, Air Conditioning, Radio Cd With Bluetooth, '
'Aux And USB Socket In Centre Consol, 12v Socket, Cup Holders, '
'Spare Wheel, Multifunctional Steering Wheel, Drivers Seat '
'Height Adjustment,Mot March 2027,\n'
'Has 14 Service Stamps, Has 6 Months Parts And Labour '
'Warranty, Part Exchange Considerd, Clean And Tidy Car Drives '
'Well,',
'doors_number': 5,
'emission_standard': 'Euro 4',
'engine': '1.4L',
'engine_horse_power': 94,
'fuel_type': 'Petrol',
'id': 'ed331a4a-00e2-5e3d-8a92-6ad46d205bd5',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603050436093',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 68249,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://m.atcdn.co.uk/a/media/aeba259851f34776b6a1b649a6acb18d.jpg',
'https://m.atcdn.co.uk/a/media/bdbcbcd2e444473e95f4e0017b0b4591.jpg',
'https://m.atcdn.co.uk/a/media/f78492a30caa4719a9e73af83a937c66.jpg',
'https://m.atcdn.co.uk/a/media/e8400d38225c4c7b851c5bd1a3affaef.jpg',
'https://m.atcdn.co.uk/a/media/3ad4daba620446e28cd5a1ae37c3b03b.jpg',
'https://m.atcdn.co.uk/a/media/cb7e8b43010e4141a65181ae328d17e8.jpg',
'https://m.atcdn.co.uk/a/media/6ecf8f3fcb42494595edb2f8e74ed462.jpg',
'https://m.atcdn.co.uk/a/media/f8054ca1902a439089b20bcca8ade657.jpg',
'https://m.atcdn.co.uk/a/media/c3de8f0b961f4b5380e8a03544755871.jpg',
'https://m.atcdn.co.uk/a/media/6fe393ffd71d4ab798ea98cb0bb960c3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384401,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/aeba259851f34776b6a1b649a6acb18d.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650987,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/bdbcbcd2e444473e95f4e0017b0b4591.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681478,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f78492a30caa4719a9e73af83a937c66.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 627587,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/e8400d38225c4c7b851c5bd1a3affaef.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 664289,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3ad4daba620446e28cd5a1ae37c3b03b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 636358,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/cb7e8b43010e4141a65181ae328d17e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 704153,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6ecf8f3fcb42494595edb2f8e74ed462.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 665076,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/f8054ca1902a439089b20bcca8ade657.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 693554,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c3de8f0b961f4b5380e8a03544755871.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed331a4a-00e2-5e3d-8a92-6ad46d205bd5/ed331a4a-00e2-5e3d-8a92-6ad46d205bd5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357202,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/6fe393ffd71d4ab798ea98cb0bb960c3.jpg',
'Width': 2048}],
'price': 4295,
'price_includes_vat': True,
'registration_date': '2008-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.4 Titanium 5dr',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2008}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603050436093%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603050436093: {'created_time': 1774883256.579279, 'last_price_update_time': 1774883256.579291}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603050436093') HTTP/1.1" 204 0
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Extracted item from batch: None
2026-03-30 15:07:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ffd11a-d7f9-542f-90ea-9ebb5448b6dc with identifier: 202603030360175
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20ffd11a-d7f9-542f-90ea-9ebb5448b6dc
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4a1b007f1d174e3caaddc7957dc22cb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4a1b007f1d174e3caaddc7957dc22cb0.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F924819d7642f419ea66cf8c2ec9d3ca2.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/924819d7642f419ea66cf8c2ec9d3ca2.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Facce37a2c73249db84d2fe7c3324d93e.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/acce37a2c73249db84d2fe7c3324d93e.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252Fc780447e7ba04e01853814914f74e0db.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/c780447e7ba04e01853814914f74e0db.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F3e369e9cfd45439ab33125e92384ee66.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/3e369e9cfd45439ab33125e92384ee66.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4ae0dfd1b73743b58c32355ebc3689ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4ae0dfd1b73743b58c32355ebc3689ca.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F62c127c0778145dd896d3dd047af9b82.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/62c127c0778145dd896d3dd047af9b82.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F19dc5646a79048ef9dda4ae27b256d72.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/19dc5646a79048ef9dda4ae27b256d72.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F91d1a44c34bc46cdbbd29c05e0e4fbee.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/91d1a44c34bc46cdbbd29c05e0e4fbee.jpg already downloaded
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fm.atcdn.co.uk%252Fa%252Fmedia%252F4b2ec4556e1243c3b7b4de5895f8c9aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://m.atcdn.co.uk/a/media/4b2ec4556e1243c3b7b4de5895f8c9aa.jpg already downloaded
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 20ffd11a-d7f9-542f-90ea-9ebb5448b6dc with identifier 202603030360175
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 20ffd11a-d7f9-542f-90ea-9ebb5448b6dc
2026-03-30 15:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autotrader.co.uk/at-graphql>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'White',
'currency': 'GBP',
'description': 'Skoda Octavia Vrs 2.0Tdi Est, Finshed Off In A White Bodywork '
'And Has A Black Cloth And Leather Interior, Alloy '
'Wheels,Front Fog Lights, Daytime Running Lights, Electric '
'Windows Front And Rear, Electric Mirrors, Remote Central '
'Locking With Two Remote Keys, Auto Lights, Dab Radio Touch '
'Screen With Bluetooth, Cd Player With Sd Card Slot In '
'Glovebox, Aux And USB Socket In Centre Consol, 12v Socket, '
'Cup Holders, Heated Rear Screen, Air '
'Conditioning,Multifunctional Steering Wheel, Rear Parking '
'Sensors With Park Pilot, Front Seat Height Adjustment, Front '
'And Rear Armrest,Comes With Service History, Mot January '
'2027, Clean And Tidy Car Drives Well, 6 Months Parts And '
'Labour Warranty, Part Exchange Considered,',
'doors_number': 5,
'emission_standard': 'Euro 5',
'engine': '2L',
'engine_horse_power': 181,
'fuel_type': 'Diesel',
'id': '20ffd11a-d7f9-542f-90ea-9ebb5448b6dc',
'is_damaged': False,
'is_operable': True,
'link_to_web_offer': 'https://www.autotrader.co.uk/car-details/202603030360175',
'listing': 'directbuy',
'location': 'St. Ives, Cambridgeshire, Cambridgeshire',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 101234,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photo_urls': ['https://m.atcdn.co.uk/a/media/4a1b007f1d174e3caaddc7957dc22cb0.jpg',
'https://m.atcdn.co.uk/a/media/924819d7642f419ea66cf8c2ec9d3ca2.jpg',
'https://m.atcdn.co.uk/a/media/acce37a2c73249db84d2fe7c3324d93e.jpg',
'https://m.atcdn.co.uk/a/media/c780447e7ba04e01853814914f74e0db.jpg',
'https://m.atcdn.co.uk/a/media/3e369e9cfd45439ab33125e92384ee66.jpg',
'https://m.atcdn.co.uk/a/media/4ae0dfd1b73743b58c32355ebc3689ca.jpg',
'https://m.atcdn.co.uk/a/media/62c127c0778145dd896d3dd047af9b82.jpg',
'https://m.atcdn.co.uk/a/media/19dc5646a79048ef9dda4ae27b256d72.jpg',
'https://m.atcdn.co.uk/a/media/91d1a44c34bc46cdbbd29c05e0e4fbee.jpg',
'https://m.atcdn.co.uk/a/media/4b2ec4556e1243c3b7b4de5895f8c9aa.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315438,
'Height': 1080,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4a1b007f1d174e3caaddc7957dc22cb0.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 595067,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/924819d7642f419ea66cf8c2ec9d3ca2.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 559277,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/acce37a2c73249db84d2fe7c3324d93e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 566266,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/c780447e7ba04e01853814914f74e0db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 540401,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/3e369e9cfd45439ab33125e92384ee66.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 619356,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4ae0dfd1b73743b58c32355ebc3689ca.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570243,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/62c127c0778145dd896d3dd047af9b82.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 513763,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/19dc5646a79048ef9dda4ae27b256d72.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562250,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/91d1a44c34bc46cdbbd29c05e0e4fbee.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20ffd11a-d7f9-542f-90ea-9ebb5448b6dc/20ffd11a-d7f9-542f-90ea-9ebb5448b6dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286765,
'Height': 1536,
'OriginUrl': 'https://m.atcdn.co.uk/a/media/4b2ec4556e1243c3b7b4de5895f8c9aa.jpg',
'Width': 2048}],
'price': 8595,
'price_includes_vat': True,
'registration_date': '2014-03-07',
'seats_number': 5,
'seller_name': None,
'title': 'SKODA Octavia 2.0 TDI vRS Euro 5 (s/s) 5dr',
'transmission': 'manual',
'trim': 'vRS',
'year': 2014}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20RowKey%20eq%20%27202603030360175%27 HTTP/1.1" 200 None
2026-03-30 15:07:36 [auto_selling_autotrader.co.uk] INFO: Saving data for 202603030360175: {'created_time': 1774883256.807489, 'last_price_update_time': 1774883256.807499}
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autotrader.co.uk',RowKey='202603030360175') HTTP/1.1" 204 0
2026-03-30 15:07:36 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 15:07:36 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2026-03-30 15:07:36 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2026-03-30 15:07:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 4a62a7cc2c1f11f18e133aacc95538c6
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2026-03-30 15:07:36 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2026-03-30 15:07:36 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:36 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2026-03-30 15:07:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2026-03-30 15:07:37 [auto_selling_autotrader.co.uk] INFO: auto_selling_autotrader.co.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 15:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autotrader.co.uk%27%20and%20last_price_update_time%20lt%201773587258 HTTP/1.1" 200 None
2026-03-30 15:07:38 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (17 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autotrader.co.uk/4a62a7cc2c1f11f18e133aacc95538c6.jl
2026-03-30 15:07:38 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 127386,
'downloader/request_count': 3,
'downloader/request_method_count/POST': 3,
'downloader/response_bytes': 602000,
'downloader/response_count': 3,
'downloader/response_status_count/200': 3,
'elapsed_time_seconds': 15.67612,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 15, 7, 38, 443151, tzinfo=datetime.timezone.utc),
'item_scraped_count': 17,
'log_count/DEBUG': 539,
'log_count/INFO': 334,
'memusage/max': 149204992,
'memusage/startup': 149204992,
'request_depth_max': 1,
'response_received_count': 3,
'scheduler/dequeued': 3,
'scheduler/dequeued/memory': 3,
'scheduler/enqueued': 3,
'scheduler/enqueued/memory': 3,
'scrape_type/new': 17,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 3,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 1.4629606076826651,
'scrapy-zyte-api/mean_response_seconds': 1.6102873242149751,
'scrapy-zyte-api/processed': 3,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
'scrapy-zyte-api/request_args/experimental.responseCookies': 3,
'scrapy-zyte-api/request_args/httpRequestBody': 3,
'scrapy-zyte-api/request_args/httpRequestMethod': 3,
'scrapy-zyte-api/request_args/httpResponseBody': 3,
'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
'scrapy-zyte-api/request_args/url': 3,
'scrapy-zyte-api/status_codes/200': 3,
'scrapy-zyte-api/success': 3,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 3, 30, 15, 7, 22, 767031, tzinfo=datetime.timezone.utc)}
2026-03-30 15:07:38 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 15:07:38 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f77a5f51f10>
2026-03-30 15:07:38 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f77a5f53a50>
PROJECT (sourcing_v2)
SPIDER (auto_selling_autotrader.co.uk)